Is Attention Better Than Matrix Decomposition?

Benchmark Model Rank Results
conditional-image-generation-on-imagenet-128x128HamGAN#17FID: 14.80Inception score: 58.75
semantic-segmentation-on-ade20kLight-Ham (VAN-Huge)#97Validation mIoU: 51.5Params (M): 61.1GFLOPs (512 x 512): 71.8
semantic-segmentation-on-ade20kLight-Ham (VAN-Large)#105Validation mIoU: 51.0Params (M): 45.6GFLOPs (512 x 512): 55.0
semantic-segmentation-on-ade20kLight-Ham (VAN-Base)#131Validation mIoU: 49.6Params (M): 27.4GFLOPs (512 x 512): 34.4
semantic-segmentation-on-ade20kHamNet (ResNet-101)#172Validation mIoU: 46.8
semantic-segmentation-on-ade20kLight-Ham (VAN-Small, D=256)#194Validation mIoU: 45.2Params (M): 13.8GFLOPs (512 x 512): 15.8
semantic-segmentation-on-ade20k-valLight-Ham (VAN-Huge, 61M, IN-1k, MS)#44mIoU: 51.5
semantic-segmentation-on-ade20k-valLight-Ham (VAN-Large, 46M, IN-1k, MS)#47mIoU: 51.0
semantic-segmentation-on-ade20k-valLight-Ham (VAN-Base, 27M, IN-1k, MS)#56mIoU: 49.6
semantic-segmentation-on-pascal-contextHamNet (ResNet-101)#26mIoU: 55.2
semantic-segmentation-on-pascal-voc-2012-testHamNet w/o COCO (ResNet-101)#7Mean IoU: 85.9%