Knowledge Diffusion for Distillation

Benchmark Model Rank Results
knowledge-distillation-on-imagenetDiffKD (T:Swin-L S: Swin-T)#9Top-1 accuracy %: 82.5
knowledge-distillation-on-imagenetDiffKD (T:Swin-L S: ResNet-50)#14Top-1 accuracy %: 80.5