Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfer
Open paper
Benchmark
Model
Rank
Results
knowledge-distillation-on-imagenet
AT (T: ResNet-34 S:ResNet-18)
#54
CRD training setting: ✓
Rank counts only results with a code link.