Multi-Head Normalization for Wide Vision Transformers
Open paper
Benchmark
Model
Rank
Results
image-classification-on-imagenet
MH-RMSNorm (ViT-H)
–
Top 1 Accuracy: 85.5%
Rank counts only results with a code link.