Meta Knowledge Distillation

Benchmark Model Rank Results
image-classification-on-imagenetMKD ViT-B–Top 1 Accuracy: 85.1%
image-classification-on-imagenetMKD ViT-L–Top 1 Accuracy: 86.5%
image-classification-on-imagenetMKD ViT-S–Top 1 Accuracy: 83.1%
image-classification-on-imagenetMKD ViT-T–Top 1 Accuracy: 77.1%