Knowledge Distillation with the Reused Teacher Classifier

Benchmark Model Rank Results
knowledge-distillation-on-cifar-100resnet8x4 (T: resnet32x4 S: resnet8x4 [modified])#5Top-1 Accuracy (%): 78.08