Complementary Relation Contrastive Distillation

Benchmark Model Rank Results
knowledge-distillation-on-imagenetCRCD (T: ResNet-34 S:ResNet-18)#40Top-1 accuracy %: 71.96CRD training setting: ✓