CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model

Benchmark Model Rank Results
scene-text-recognition-on-coco-textCLIP4STR-L#11:1 Accuracy: 81.9
scene-text-recognition-on-coco-textCLIP4STR-B#41:1 Accuracy: 81.1
scene-text-recognition-on-cute80CLIP4STR-L (DataComp-1B)#1Accuracy: 99.7
scene-text-recognition-on-cute80CLIP4STR-B#6Accuracy: 99.3
scene-text-recognition-on-cute80CLIP4STR-L#8Accuracy: 99.0
scene-text-recognition-on-hostCLIP4STR-L#11:1 Accuracy: 82.7
scene-text-recognition-on-hostCLIP4STR-B#21:1 Accuracy: 79.8
scene-text-recognition-on-ic19-artCLIP4STR-L (DataComp-1B)#1Accuracy (%): 86.4
scene-text-recognition-on-ic19-artCLIP4STR-L#2Accuracy (%): 85.9
scene-text-recognition-on-ic19-artCLIP4STR-B#3Accuracy (%): 85.8
scene-text-recognition-on-icdar2015-1-811-imagesCLIP4STR-L (DataComp-1B, RBU 6.5M)#1Accuracy: 91.9
scene-text-recognition-on-iiit5kCLIP4STR-L (DataComp-1B)#1Accuracy: 99.6
scene-text-recognition-on-iiit5kCLIP4STR-L#3Accuracy: 99.5
scene-text-recognition-on-iiit5kCLIP4STR-B (DataComp-1B)#4Accuracy: 99.5
scene-text-recognition-on-iiit5kCLIP4STR-B#10Accuracy: 99.2
scene-text-recognition-on-uber-textCLIP4STR-L (DataComp-1B)#1Accuracy (%): 92.2
scene-text-recognition-on-uber-textCLIP4STR-B#4Accuracy (%): 86.8
scene-text-recognition-on-wostCLIP4STR-H (DFN-5B)#11:1 Accuracy: 90.9
scene-text-recognition-on-wostCLIP4STR-L (DataComp-1B)#21:1 Accuracy: 90.6
scene-text-recognition-on-wostCLIP4STR-L#31:1 Accuracy: 88.8
scene-text-recognition-on-wostCLIP4STR-B#41:1 Accuracy: 87.0
scene-text-recognition-on-icdar2013CLIP4STR-L (DataComp-1B)#3Accuracy: 99.0
scene-text-recognition-on-icdar2013CLIP4STR-L#5Accuracy: 98.5
scene-text-recognition-on-icdar2013CLIP4STR-B#10Accuracy: 98.3
scene-text-recognition-on-svtCLIP4STR-H (DFN-5B)#3Accuracy: 99.1
scene-text-recognition-on-svtCLIP4STR-L (DataComp-1B)#8Accuracy: 98.6
scene-text-recognition-on-svtCLIP4STR-L#9Accuracy: 98.5
scene-text-recognition-on-svtCLIP4STR-B#12Accuracy: 98.3
scene-text-recognition-on-icdar2015CLIP4STR-L (DataComp-1B)#4Accuracy: 91.4
scene-text-recognition-on-icdar2015CLIP4STR-L#6Accuracy: 90.8
scene-text-recognition-on-icdar2015CLIP4STR-B#8Accuracy: 90.6
scene-text-recognition-on-svtpCLIP4STR-L (DataComp-1B)#5Accuracy: 98.1
scene-text-recognition-on-svtpCLIP4STR-L#6Accuracy: 97.4
scene-text-recognition-on-svtpCLIP4STR-B#7Accuracy: 97.2