Self-Knowledge Distillation with Progressive Refinement of Targets

Benchmark Model Rank Results
machine-translation-on-iwslt2015-english-germanPS-KD#1BLEU score: 30.00
machine-translation-on-iwslt2015-german-englishPS-KD#1BLEU score: 36.20
multimodal-machine-translation-on-multi30kPS-KD#9BLUE (DE-EN): 32.3
object-detection-on-pascal-voc-2007PS-KD (ResNet-152, CutMix)#14MAP: 79.7%
image-classification-on-cifar-100PyramidNet-200 + Shakedrop + Cutmix + PS-KD#76Percentage correct: 86.41
image-classification-on-imagenetPS-KD (ResNet-152 + CutMix)#806Top 1 Accuracy: 79.24%