A Comprehensive Overhaul of Feature Distillation

Benchmark Model Rank Results
knowledge-distillation-on-imagenetOverhual (T: ResNet-34 S:ResNet-18)#52Top-1 accuracy %: 70.81