CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model

Benchmark Model Rank Results
scene-text-recognition-on-coco-textCLIP4STR-L#11:1 Accuracy: 81.9
scene-text-recognition-on-coco-textCLIP4STR-B#31:1 Accuracy: 81.1
scene-text-recognition-on-cute80CLIP4STR-L (DataComp-1B)#1Accuracy: 99.7
scene-text-recognition-on-cute80CLIP4STR-B#5Accuracy: 99.3
scene-text-recognition-on-cute80CLIP4STR-L#7Accuracy: 99.0
scene-text-recognition-on-hostCLIP4STR-L#11:1 Accuracy: 82.7
scene-text-recognition-on-hostCLIP4STR-B#21:1 Accuracy: 79.8
scene-text-recognition-on-ic19-artCLIP4STR-L (DataComp-1B)#1Accuracy (%): 86.4
scene-text-recognition-on-ic19-artCLIP4STR-L#2Accuracy (%): 85.9
scene-text-recognition-on-ic19-artCLIP4STR-B#3Accuracy (%): 85.8
scene-text-recognition-on-icdar2013CLIP4STR-L (DataComp-1B)#3Accuracy: 99.0
scene-text-recognition-on-icdar2013CLIP4STR-L#5Accuracy: 98.5
scene-text-recognition-on-icdar2013CLIP4STR-B#9Accuracy: 98.3
scene-text-recognition-on-icdar2015CLIP4STR-L (DataComp-1B)#4Accuracy: 91.4
scene-text-recognition-on-icdar2015CLIP4STR-L#6Accuracy: 90.8
scene-text-recognition-on-icdar2015CLIP4STR-B#7Accuracy: 90.6
scene-text-recognition-on-iiit5kCLIP4STR-L (DataComp-1B)#1Accuracy: 99.6
scene-text-recognition-on-iiit5kCLIP4STR-L#3Accuracy: 99.5
scene-text-recognition-on-iiit5kCLIP4STR-B (DataComp-1B)#4Accuracy: 99.5
scene-text-recognition-on-iiit5kCLIP4STR-B#6Accuracy: 99.2
scene-text-recognition-on-svtCLIP4STR-H (DFN-5B)#1Accuracy: 99.1
scene-text-recognition-on-svtCLIP4STR-L (DataComp-1B)#5Accuracy: 98.6
scene-text-recognition-on-svtCLIP4STR-L#6Accuracy: 98.5
scene-text-recognition-on-svtCLIP4STR-B#8Accuracy: 98.3
scene-text-recognition-on-svtpCLIP4STR-L (DataComp-1B)#4Accuracy: 98.1
scene-text-recognition-on-svtpCLIP4STR-L#5Accuracy: 97.4
scene-text-recognition-on-svtpCLIP4STR-B#6Accuracy: 97.2
scene-text-recognition-on-uber-textCLIP4STR-L (DataComp-1B)#1Accuracy (%): 92.2
scene-text-recognition-on-uber-textCLIP4STR-B#3Accuracy (%): 86.8
scene-text-recognition-on-wostCLIP4STR-H (DFN-5B)#11:1 Accuracy: 90.9
scene-text-recognition-on-wostCLIP4STR-L (DataComp-1B)#21:1 Accuracy: 90.6
scene-text-recognition-on-wostCLIP4STR-L#31:1 Accuracy: 88.8
scene-text-recognition-on-wostCLIP4STR-B#41:1 Accuracy: 87.0