Self-Knowledge Distillation with Progressive Refinement of Targets

Benchmark Model Rank Results
image-classification-on-cifar-100PyramidNet-200 + Shakedrop + Cutmix + PS-KD#52Percentage correct: 86.41
image-classification-on-imagenetPS-KD (ResNet-152 + CutMix)#726Top 1 Accuracy: 79.24%
machine-translation-on-iwslt2015-englishPS-KD#1BLEU score: 30.00
machine-translation-on-iwslt2015-germanPS-KD#1BLEU score: 36.20
multimodal-machine-translation-on-multi30kPS-KD#7BLUE (DE-EN): 32.3
object-detection-on-pascal-voc-2007PS-KD (ResNet-152, CutMix)#11MAP: 79.7%