Distilling Knowledge via Knowledge Review

Benchmark Model Rank Results
knowledge-distillation-on-cifar-100resnet8x4 (T: resnet32x4 S: resnet8x4)#16Top-1 Accuracy (%): 75.63
knowledge-distillation-on-cifar-100vgg8 (T:vgg13 S:vgg8)#19Top-1 Accuracy (%): 74.84
knowledge-distillation-on-imagenetKnowledge Review (T: ResNet-34 S:ResNet-18)#47Top-1 accuracy %: 71.61CRD training setting: ✓