When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism

Open paper
Benchmark Model Rank Results
semantic-segmentation-on-ade20kShift-B (UperNet)#147Validation mIoU: 49.2
semantic-segmentation-on-ade20kShift-B#172Validation mIoU: 47.9
semantic-segmentation-on-ade20kShift-S#174Validation mIoU: 47.8
semantic-segmentation-on-ade20kShift-T#192Validation mIoU: 46.3
object-detection-on-coco-val2017Shift-T#449APM: 42.3
image-classification-on-imagenetShift-B#475Top 1 Accuracy: 83.3%Number of params: 88MGFLOPs: 15.2
image-classification-on-imagenetShift-S#529Top 1 Accuracy: 82.8%Number of params: 50MGFLOPs: 8.5
image-classification-on-imagenetShift-T#654Top 1 Accuracy: 81.7%Number of params: 28MGFLOPs: 4.4

Rank counts only results with a code link.