PerceptionLM: Open-Access Data and Models for Detailed Visual Understanding

Benchmark Model Rank Results
image-captioning-on-nocaps-val-overallPLM-8B#1CIDEr: 129.9
video-question-answering-on-perception-test-testPLM-8B#1Accuracy: 82.7
video-question-answering-on-tvbenchPLM-8B#1Average Accuracy: 63.5
video-question-answering-on-tvbenchPLM-3B#3Average Accuracy: 58.9
video-question-answering-on-tvbenchPLM-1B#9Average Accuracy: 50.4
visual-question-answering-vqa-on-textvqa-valPLM-8B#2Accuracy: 86.5
visual-question-answering-vqa-on-seed-seedbenchPLM-8B#3Accuracy: 79.3
video-question-answering-on-mvbenchPLM-8B#4Avg.: 77.1
video-question-answering-on-next-qaPLM-8B#4Accuracy: 84.1
video-question-answering-on-next-qaPLM-3B#6Accuracy: 83.4
video-question-answering-on-next-qaPLM-1B#11Accuracy: 80.3
video-question-answering-on-tempcompass-mcqPLM-8B#6Accuracy: 72.7
video-question-answering-on-tomatoPLM-8B#9Accuracy: 33.2
zero-shot-video-question-answer-on-egoschema-fullsetPLM-8B#9Accuracy: 68.8
visual-question-answering-vqa-on-mmePLM-8B#17Score: 1989
optical-character-recognition-ocr-on-ocrbenchPLM-8B#20Score: 870
visual-question-answering-vqa-on-realworldqaPLM-8B#25Accuracy: 75.0
visual-question-answering-vqa-on-blinkPLM-8B#36Accuracy: 56.0
chart-question-answering-on-chartqaPLM-8B#421:1 Accuracy: 85.5
multimodal-reasoning-on-mmmuPLM-8B#106Accuracy: 46.1