Show, Attend and Distill:Knowledge Distillation via Attention-based Feature Matching

Open paper
Benchmark Model Rank Results
knowledge-distillation-on-imagenetAFD (T: ResNet-34 S:ResNet-18)#51Top-1 accuracy %: 71.38

Rank counts only results with a code link.