Vision Transformers Need Registers

Benchmark Model Rank Results
self-supervised-image-classification-on-imagenetDINOv2+reg (ViT-g/14)#1Top 1 Accuracy: 87.1Number of Params: 1100M
linear-probe-semantic-segmentation-on-ade20kDINOv2 with Registers (ViT-L/14) + Linear Probe#8mIoU: 47.9
image-classification-on-imagenetDINOv2 with Registers (ViT-L/14)#312Top 1 Accuracy: 84.8%