Meta Knowledge Distillation

Benchmark Model Rank Results
image-classification-on-imagenetMKD ViT-BTop 1 Accuracy: 85.1%
image-classification-on-imagenetMKD ViT-LTop 1 Accuracy: 86.5%
image-classification-on-imagenetMKD ViT-STop 1 Accuracy: 83.1%
image-classification-on-imagenetMKD ViT-TTop 1 Accuracy: 77.1%