A Few Gaussians Is All You Need: SSOG-Attention That Steers Instead of Scores

Benchmark Model Rank Results
image-classification-on-cifar-100SSOG factorized +μδ#210Percentage correct: 70.4
image-classification-on-imagenetSSOG +μδ+σδ+λ (12.0M)#1053Top 1 Accuracy: 72.02%