DeepViT: Towards Deeper Vision Transformer

Benchmark Model Rank Results
image-classification-on-imagenetDeepVit-L* (DeiT training recipe)#495Top 1 Accuracy: 83.1%
image-classification-on-imagenetDeepVit-L#598Top 1 Accuracy: 82.2%Number of params: 55M