Exploring Inter-Channel Correlation for Diversity-Preserved Knowledge Distillation

Benchmark Model Rank Results
knowledge-distillation-on-imagenetICKD (T: ResNet-34 S:ResNet-18)#34Top-1 accuracy %: 72.19CRD training setting: ✘