Wasserstein Contrastive Representation Distillation

Benchmark Model Rank Results
knowledge-distillation-on-cifar-100resnet110 (T:resnet110 S:resnet20)–Top-1 Accuracy (%): 71.88
knowledge-distillation-on-cifar-100resnet8x4 (T: resnet32x4 S: resnet8x4)–Top-1 Accuracy (%): 76.15
knowledge-distillation-on-cifar-100vgg8 (T:vgg13 S:vgg8)–Top-1 Accuracy (%): 74.72