Knowledge Diffusion for Distillation
Open paper
Benchmark
Model
Rank
Results
knowledge-distillation-on-imagenet
DiffKD (T:Swin-L S: Swin-T)
#9
Top-1 accuracy %: 82.5
knowledge-distillation-on-imagenet
DiffKD (T:Swin-L S: ResNet-50)
#14
Top-1 accuracy %: 80.5
Rank counts only results with a code link.