BEiT: BERT Pre-Training of Image Transformers

Benchmark Model Rank Results
document-layout-analysis-on-publaynet-valBEiT-B#7Overall: 0.931Text: 0.934Title: 0.866List: 0.924Table: 0.973…
self-supervised-image-classification-on-imagenet-finetunedBEiT-L (ViT)#14Top 1 Accuracy: 86.3%Number of Params: 307M
self-supervised-image-classification-on-imagenet-finetunedBEiT-B (ViT)#29Top 1 Accuracy: 84.6%Number of Params: 86M
semantic-segmentation-on-ade20k-valBEiT-L (ViT+UperNet, ImageNet-22k pretrain)#21mIoU: 57.0
image-classification-on-omnibenchmarkBeiT#22Average Top-1 Accuracy: 30.1
document-image-classification-on-rvl-cdipBEiT-B#24Accuracy: 91.09%Parameters: 87M
image-classification-on-cifar-100BEiT (extra data)#25Percentage correct: 91.8
semantic-segmentation-on-ade20kBEiT-L (ViT+UperNet)#36Validation mIoU: 57.0
image-classification-on-imagenetBEiT-L (ViT; ImageNet-22K pretrain)#40Top 1 Accuracy: 88.60%Number of params: 331M
image-classification-on-imagenetBEiT-L (ViT; ImageNet 1k pretrain)#168Top 1 Accuracy: 86.3%Number of params: 86M