TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models

Benchmark Model Rank Results
handwritten-text-recognition-on-iam-line-levelTrOCR#1Test CER: 3.4
handwritten-text-recognition-on-iamTrOCR-large 558M#3CER: 2.89
handwritten-text-recognition-on-iamTrOCR-base 334M#4CER: 3.42
handwritten-text-recognition-on-iamTrOCR-small 62M#5CER: 4.22
handwritten-text-recognition-on-lam-line-levelTrOCR#5Test CER: 3.6Test WER: 11.6
scene-text-recognition-on-icdar2013-857-imagesTrOCR Base (Syn+Benchmark) (extra data)#6Accuracy: 98.4
scene-text-recognition-on-icdar2015-1-811-imagesTrOCR Large (Syn+Benchmark) (extra data)#8Accuracy: 88.1
scene-text-recognition-on-icdar2015TrOCR Large (Syn+Benchmark) (extra data)#18Accuracy: 84.1
scene-text-recognition-on-svtpTrOCR Large (Syn+Benchmark) (extra data)#20Accuracy: 93
scene-text-recognition-on-icdar2013TrOCR Base (Syn+Benchmark) (extra data)#21Accuracy: 97.4
scene-text-recognition-on-cute80TrOCR Large (Syn+Benchmark) (extra data)#23Accuracy: 95.1
scene-text-recognition-on-svtTrOCR Large (Syn+Benchmark) (extra data)#23Accuracy: 96.1
scene-text-recognition-on-iiit5kTrOCR Large (Syn+Benchmark) (extra data)#42Accuracy: 94.1