Contrastive Representation Distillation

Benchmark Model Rank Results
knowledge-distillation-on-cifar-100resnet8x4 (T: resnet32x4 S: resnet8x4)#17Top-1 Accuracy (%): 75.51
knowledge-distillation-on-cifar-100vgg8 (T:vgg13 S:vgg8)#20Top-1 Accuracy (%): 74.29
knowledge-distillation-on-cifar-100resnet110 (T:resnet110 S:resnet20)#25Top-1 Accuracy (%): 71.56
knowledge-distillation-on-imagenetCRD (T: ResNet-34 S:ResNet-18)#50Top-1 accuracy %: 71.38