One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillation

Benchmark Model Rank Results
knowledge-distillation-on-imagenetOFA (T: ViT-B S: ResNet-50)#13Top-1 accuracy %: 81.33