Distilling Knowledge by Mimicking Features

Benchmark Model Rank Results
knowledge-distillation-on-cocoLSHFM (T: ResNet101 S: ResNet50)#3mAP: 77.16
knowledge-distillation-on-cocoLSHFM (T: ResNet101 S: MobileNetV2)#4mAP: 73.73
knowledge-distillation-on-imagenetLSHFM (T: ResNet-34 S:ResNet-18)#43Top-1 accuracy %: 71.72