Logit Standardization in Knowledge Distillation

Open paper
Benchmark Model Rank Results
knowledge-distillation-on-cifar-100shufflenet-v2(T:resnet-32x4, S:shufflenet-v2)#2Top-1 Accuracy (%): 78.76
knowledge-distillation-on-cifar-100resnet8x4 (T: resnet32x4 S: resnet8x4)#4Top-1 Accuracy (%): 78.28

Rank counts only results with a code link.