OpenCodePapers

document-understanding-on-extractbench

Document Understanding
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeValue F1ModelNameReleaseDate
ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction✓ Link95.65LlamaExtract Agentic2026-07-31
ExtractBench Leaderboard✓ Link94.68Claude Code (Sonnet 5.5 Evidence)2026-09-28
ExtractBench: A Benchmark for Schema-Guided Enterprise Document Extraction✓ Link94.21LlamaExtract Cost-Effective2026-07-31
ExtractBench Leaderboard✓ Link93.77Codex (GPT-5.6 Sol Evidence)2026-07-09
ExtractBench Leaderboard93.57Codex (GPT-5.5)2026-04-23
ExtractBench Leaderboard93.35Codex (GPT-5.5 Evidence)2026-04-23
ExtractBench Leaderboard✓ Link91.91OpenAI GPT-6 Astra2026-09-03
ExtractBench Leaderboard✓ Link91.16Codex (GPT-5.6 Luna Evidence)2026-07-09
ExtractBench Leaderboard91.01Codex (GPT-6 Luna Evidence)2026-09-22
ExtractBench Leaderboard✓ Link89.75Qwen3.8 27B2026-08-05
ExtractBench Leaderboard✓ Link88.11Qwen3.6 35B2026-04-21
ExtractBench Leaderboard✓ Link88.0Qwen3.5 35B2026-02-16
ExtractBench Leaderboard87.09Claude Code (Opus 4.8)2026-05-28
ExtractBench Leaderboard86.84Claude Code (Opus 4.8 Evidence)2026-05-28
ExtractBench Leaderboard✓ Link86.06Claude Code (Opus 5.5 Evidence)2026-09-22
ExtractBench Leaderboard✓ Link83.17Kimi K32026-07-27
ExtractBench Leaderboard✓ Link82.43Qwen3.5 4B2026-02-16
ExtractBench Leaderboard81.02NuExtract32026-05-12
ExtractBench Leaderboard✓ Link80.75GLM-5.3 Flash2026-08-26
ExtractBench Leaderboard✓ Link80.71Google Gemini 3.8 Flash2026-09-02
ExtractBench Leaderboard79.84Google Gemini 3.5 Flash2026-05-19
ExtractBench Leaderboard78.43Lift Datalab 9B2026-06-19
ExtractBench Leaderboard74.9OpenAI GPT-5.4 Nano2026-03-17
ExtractBench Leaderboard✓ Link70.27Gemma4 26B2026-07-02
ExtractBench Leaderboard✓ Link69.64Gemma4 E4B2026-07-02
ExtractBench Leaderboard✓ Link66.35InternVL3.5 14B2025-08-25
ExtractBench Leaderboard✓ Link63.4Qwen3.5 2B2026-02-16
ExtractBench Leaderboard✓ Link51.85Gemma4 E2B2026-07-02
ExtractBench Leaderboard49.42NuExtract 2.0 8B2025-05-06
ExtractBench Leaderboard✓ Link45.85MiniCPM-V 4.52025-09-16
ExtractBench Leaderboard✓ Link45.39Gemma4 12B2026-07-02
ExtractBench Leaderboard✓ Link45.19GLM-4.6V Flash2025-07-01
Check out how to contribute new results. Then edit this file on GitLab or GitHub.