MoE-KD: Your Teacher Model is Worth Mixture-of-Experts for Knowledge Distillation
Open paper
Benchmark
Model
Rank
Results
image-classification-on-imagenet
MoE-KD
–
Top 1 Accuracy: 79.0%
Rank counts only results with a code link.