Adaptive Distillation: Aggregating Knowledge from Multiple Paths for Efficient Distillation
Open paper
Benchmark
Model
Rank
Results
knowledge-distillation-on-imagenet
Adaptive (T:ResNet-50 S:ResNet-18)
#48
Top-1 accuracy %: 71.61
Rank counts only results with a code link.