OpenCodePapers

document-parsing-on-parsebench

Document UnderstandingDocument Parsing
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeOverall (ParseBench)ChartsTablesVisual GroundingSemantic FormattingContent FaithfulnessModelNameReleaseDate
ParseBench: A Document Parsing Benchmark for AI Agents✓ Link90.294.1893.3784.0987.1292.25LlamaParse Agentic Plus2026-04-09
ParseBench: A Document Parsing Benchmark for AI Agents✓ Link87.0188.6888.8884.2581.4491.78LlamaParse Agentic2026-04-09
ParseBench: A Document Parsing Benchmark for AI Agents✓ Link80.6177.9184.1983.7767.2989.87LlamaParse Cost Effective2026-04-09
ParseBench Leaderboard✓ Link79.8570.8994.2565.3377.0491.72Anthropic Opus 5.5 (Effort High)2026-09-22
ParseBench Leaderboard78.9267.0691.5268.376.5291.19Anthropic Fable 5.12026-09-01
ParseBench Leaderboard✓ Link78.0164.1293.8663.277.0491.81Anthropic Opus 5.52026-09-22
ParseBench Leaderboard77.2364.8986.4474.2871.6888.84rakedoc-nano2026-08-29
ParseBench Leaderboard76.7768.7885.8975.2166.0587.9aeddix-alpine-ocr (KDL pipeline)2026-10-06
ParseBench Leaderboard76.6965.1986.174.1470.6487.37florin-parser-nano2026-08-17
ParseBench Leaderboard✓ Link75.3568.6891.3951.3577.1688.16OpenAI GPT-5.6 Sol (Reasoning High)2026-07-09
ParseBench Leaderboard✓ Link75.166.183.868.367.689.9LightOnOCR-3-4B2026-10-08
ParseBench Leaderboard75.0564.7991.559.7768.3190.87Google Gemini 3 Flash (Thinking High)2025-12-17
ParseBench Leaderboard75.061.5691.0165.7967.9588.67Google Gemini 3 Flash (Thinking Medium)2025-12-17
ParseBench Leaderboard✓ Link74.664.784.568.266.788.9LightOnOCR-3-0.8B2026-10-08
ParseBench Leaderboard✓ Link74.4753.5292.6959.2775.2191.68Anthropic Opus 5.5 (Effort Low)2026-09-22
ParseBench Leaderboard✓ Link74.2861.386.474.959.189.7Infinity-Parser2-Pro2026-07-08
ParseBench Leaderboard74.0245.2790.4467.677.8588.92Google Gemini 3.5 Flash (Thinking High)2026-05-19
ParseBench Leaderboard✓ Link73.2555.5682.8880.6157.789.52Infinity-Parser2-Flash2026-07-08
ParseBench Leaderboard✓ Link72.7861.6477.5979.357.4987.88MinerU2.5-Pro-2605-1.2B2026-04-06
ParseBench Leaderboard72.3858.6185.7374.7555.0687.75KDL-Frontier-Parser-nano2026-06-10
ParseBench Leaderboard✓ Link72.0832.3489.1272.9176.3689.68Google Gemini 3.8 Flash (Thinking High)2026-09-02
ParseBench Leaderboard✓ Link71.457.384.861.764.588.6LightOnOCR-3-1B2026-10-08
ParseBench Leaderboard✓ Link71.2732.0790.1670.5674.9888.6Google Gemini 3.7 Flash (Thinking High)2026-08-13
ParseBench Leaderboard71.0464.8389.8555.9758.3586.19Google Gemini 3 Flash (Thinking Minimal)2025-12-17
ParseBench Leaderboard✓ Link70.7969.1766.8269.959.7788.28Qwen 3.8 27B (Thinking)2026-08-05
ParseBench Leaderboard✓ Link70.7852.2189.7949.2472.6290.02Anthropic Fable 52026-06-09
ParseBench Leaderboard✓ Link70.7835.1188.6668.6373.0588.45Google Gemini 3.7 Flash (Thinking Medium)2026-08-13
ParseBench Leaderboard✓ Link70.7554.9689.1841.7879.4988.34GLM-5.3 Flash2026-08-26
ParseBench Leaderboard✓ Link70.732.7289.0871.571.888.42Google Gemini 3.8 Flash (Thinking Medium)2026-09-02
ParseBench Leaderboard✓ Link70.6735.0893.1759.9975.5289.6OpenAI GPT-6 Astra (Reasoning Low)2026-09-03
ParseBench Leaderboard70.4837.1692.4458.7674.7889.25OpenAI GPT-6.1 Sol (Reasoning Low)2026-09-29
ParseBench Leaderboard✓ Link70.1837.6991.0458.9271.6391.64Anthropic Sonnet 5.52026-09-28
ParseBench Leaderboard✓ Link70.1535.0988.1872.2466.9988.25Google Gemini 3.8 Flash (Thinking Low)2026-09-02
ParseBench Leaderboard✓ Link70.165.189.251.261.483.7Chandra-ocr-22026-03-16
ParseBench Leaderboard70.0334.5389.364.9873.1188.21Google Gemini 3.6 Flash (Thinking High)2026-07-21
ParseBench Leaderboard69.9244.0191.1265.1459.1490.19Google Gemini 3.5 Flash (Thinking Medium)2026-05-19
ParseBench Leaderboard69.6948.0592.6352.0667.9187.81OpenAI GPT-6 Sol (Reasoning High)2026-09-22
ParseBench Leaderboard✓ Link69.5731.8487.9670.7168.8988.44Google Gemini 3.7 Flash (Thinking Low)2026-08-13
ParseBench Leaderboard69.1441.1391.070.9952.4390.16Google Gemini 3.1 Pro2026-02-19
ParseBench Leaderboard✓ Link68.3967.8686.7231.8268.4787.06OpenAI GPT-5.6 Terra (Reasoning Medium)2026-07-09
ParseBench Leaderboard✓ Link68.3449.1688.2752.7364.9586.57OpenAI GPT-5.6 Luna (Reasoning Max)2026-07-09
ParseBench Leaderboard✓ Link68.2449.4489.4248.6966.5187.13OpenAI GPT-5.6 Luna (Reasoning XHigh)2026-07-09
ParseBench Leaderboard✓ Link68.2340.1173.9471.1766.3789.55Mistral OCR 4 (Annotation)2026-06-23
ParseBench Leaderboard68.1946.4690.2749.0567.8887.3OpenAI GPT-6 Sol (Reasoning Medium)2026-09-22
ParseBench Leaderboard✓ Link68.0767.7186.9130.9767.9286.83OpenAI GPT-5.6 Terra (Reasoning Low)2026-07-09
ParseBench Leaderboard67.7665.5390.0536.2860.1286.81OpenAI GPT-5.5 (Reasoning Medium)2026-04-23
ParseBench Leaderboard✓ Link67.4354.2467.7777.854.6482.71PaddleOCR-VL-1.62026-06-02
ParseBench Leaderboard✓ Link67.3749.2588.7544.7467.1486.99OpenAI GPT-5.6 Luna (Reasoning High)2026-07-09
ParseBench Leaderboard66.7831.089.4767.2758.4687.7Google Gemini 3.6 Flash (Thinking Medium)2026-07-21
ParseBench Leaderboard66.142.0289.4945.2767.3286.38OpenAI GPT-6 Sol (Reasoning None)2026-09-22
ParseBench Leaderboard✓ Link65.9547.6267.3877.7854.2782.72PaddleOCR-VL-1.52026-01-29
ParseBench Leaderboard65.7745.7187.4249.4861.8184.44OpenAI GPT-6 Luna (Reasoning Max)2026-09-22
ParseBench Leaderboard✓ Link65.7251.1182.8233.8773.4887.33DeepSeek V4.1 Flash (Thinking High)2026-09-17
ParseBench Leaderboard65.624.7685.569.9464.4983.3Google Gemini 3.6 Flash (Thinking Minimal)2026-07-21
ParseBench Leaderboard✓ Link64.8321.9582.6871.5961.3686.57Surya OCR 22026-05-27
ParseBench Leaderboard64.3959.1189.3121.964.4687.17OpenAI GPT-5.5 (Reasoning None)2026-04-23
ParseBench Leaderboard64.3242.3888.0140.8665.3485.0OpenAI GPT-6 Luna (Reasoning XHigh)2026-09-22
ParseBench Leaderboard64.2144.2887.9739.9763.5885.27OpenAI GPT-6 Luna (Reasoning High)2026-09-22
ParseBench Leaderboard✓ Link64.1763.7586.2328.3559.9682.56OpenAI GPT-5.6 Terra (Reasoning None)2026-07-09
ParseBench Leaderboard✓ Link63.8655.9865.4563.7247.7386.44HunyuanOCR 1.52026-07-06
ParseBench Leaderboard63.749.7589.6518.6971.3889.02Anthropic Opus 4.82026-05-28
ParseBench Leaderboard✓ Link63.5846.9185.3234.665.885.27OpenAI GPT-5.6 Luna (Reasoning Medium)2026-07-09
ParseBench Leaderboard63.3455.8487.1713.9969.4290.26Anthropic Opus 4.72026-04-16
ParseBench Leaderboard63.0918.7486.2454.1868.0988.22Google Gemini 3.5 Flash (Thinking Minimal)2026-05-19
ParseBench Leaderboard✓ Link62.415.080.657.469.389.9Gemma-4-31B-it2026-07-02
ParseBench Leaderboard62.3842.9786.7436.1461.1384.94OpenAI GPT-6 Luna (Reasoning Medium)2026-09-22
ParseBench Leaderboard62.2365.2283.8916.9559.5285.57OpenAI GPT-5.4 (Reasoning None)2026-03-05
ParseBench Leaderboard62.1360.5386.6512.0364.9386.51Anthropic Sonnet 52026-06-30
ParseBench Leaderboard✓ Link62.1259.5789.3425.0950.4286.17OpenAI GPT-5.6 Sol (Reasoning None)2026-07-09
ParseBench Leaderboard✓ Link61.9728.1874.6155.1864.2387.63Qwen3-VL-8B-Instruct2025-11-26
ParseBench Leaderboard✓ Link61.2116.5984.5263.0655.2986.57Qwen 3.8 27B2026-08-05
ParseBench Leaderboard60.8211.4390.2969.745.5687.11Google Gemini 3.1 Pro (Thinking Low)2026-02-19
ParseBench Leaderboard✓ Link60.682.3573.9471.1766.3789.55Mistral OCR 42026-06-23
ParseBench Leaderboard60.6419.2783.3159.7554.0386.85Google Gemini 3.5 Flash Lite (Thinking High)2026-07-21
ParseBench Leaderboard✓ Link60.1838.9581.6730.2664.7585.28OpenAI GPT-5.6 Luna (Reasoning Low)2026-07-09
ParseBench Leaderboard59.3239.0584.228.5159.984.95OpenAI GPT-6 Luna (Reasoning Low)2026-09-22
ParseBench Leaderboard✓ Link58.679.9772.7480.1445.1385.39TeleOCR2026-08-13
ParseBench Leaderboard✓ Link58.514.270.059.265.183.8Gemma-4-26B-A4B-it2026-07-02
ParseBench Leaderboard58.329.9285.4848.3858.3889.46Google Gemini 3.1 Flash Lite2026-03-03
ParseBench Leaderboard58.1314.3583.4349.0556.1787.67Google Gemini 3.1 Flash Lite (Thinking Medium)2026-03-03
ParseBench Leaderboard57.410.1386.8534.1465.6490.24Anthropic Haiku 5.52026-10-07
ParseBench Leaderboard57.2930.8976.7638.9356.6183.28Google Gemini 3.1 Flash Lite (Thinking High)2026-03-03
ParseBench Leaderboard57.156.2673.4866.0357.7482.22Google Gemini 3.5 Flash Lite2026-07-21
ParseBench Leaderboard✓ Link56.5720.4679.6528.6166.0588.09DeepSeek V4.1 Flash (No Thinking)2026-09-17
ParseBench Leaderboard✓ Link56.3228.3281.325.4363.982.65OpenAI GPT-5.6 Luna (Reasoning None)2026-07-09
ParseBench Leaderboard✓ Link55.790.9585.1555.8146.9990.03Dots.mocr2026-03-13
ParseBench Leaderboard54.36.2372.8565.5548.0578.8Google Gemini 3.5 Flash Lite (Thinking Medium)2026-07-21
ParseBench Leaderboard54.0713.4986.5216.4764.1989.7Anthropic Opus 4.62026-02-05
ParseBench Leaderboard✓ Link54.040.7973.7767.7645.6782.21HPD-Parsing2026-07-21
ParseBench Leaderboard53.1227.3978.712.362.3684.83Anthropic Haiku 4.5 (Thinking)2025-10-15
ParseBench Leaderboard✓ Link53.080.8274.763.3747.9178.59Falcon-OCR2026-03-28
ParseBench Leaderboard52.9315.4881.4222.8559.8485.07OpenAI GPT-6 Luna (Reasoning None)2026-09-22
ParseBench Leaderboard51.5238.9674.613.0345.3585.68OpenAI GPT-5 Mini (Reasoning Medium)2025-08-07
ParseBench Leaderboard✓ Link50.6552.7666.4166.111.0366.93Docling-models2024-08-19
ParseBench Leaderboard✓ Link48.5131.4770.440.059.6980.97Nemotron-3-Nano-Omni-30B-A3B (Thinking)2026-04-27
ParseBench Leaderboard48.013.575.50.063.287.8LightOnOCR-2-1B2026-01-20
ParseBench Leaderboard46.8330.1369.826.1545.7782.3OpenAI GPT-5 Mini (Reasoning Minimal)2025-08-07
ParseBench Leaderboard✓ Link46.20.972.320.653.883.5Qianfan-OCR2026-03-11
ParseBench Leaderboard✓ Link46.171.3470.2171.520.9786.81Unlimited-OCR2026-06-22
ParseBench Leaderboard45.937.5274.90.060.6486.58Jina-OCR-v12026-09-02
ParseBench Leaderboard✓ Link45.91.171.771.54.580.8MinerU2.5-2509-1.2B2025-09-26
ParseBench Leaderboard45.1713.7777.216.7249.3978.74Anthropic Haiku 4.5 (Disable Thinking)2025-10-15
ParseBench Leaderboard✓ Link44.15.119.147.458.390.7Qwen3.6-35B-A3B2026-04-21
ParseBench Leaderboard43.3517.5760.166.4154.5678.05OpenAI GPT-5.4 Nano2026-03-17
ParseBench Leaderboard✓ Link42.631.1966.5174.541.4669.46MinerU-Diffusion-V1-0320-2.5B2026-03-23
ParseBench Leaderboard✓ Link41.21.161.77.054.082.0DeepSeek-OCR-22026-01-28
ParseBench Leaderboard✓ Link40.90.967.10.054.082.7PaddleOCR-VL2025-10-16
ParseBench Leaderboard40.841.0177.370.037.3588.47OvisOCR22026-07-15
ParseBench Leaderboard✓ Link40.57.725.035.852.581.4Gemma-4-E4B-it2026-07-02
ParseBench Leaderboard40.436.768.384.7845.2677.04Amazon Nova 2 Lite2025-12-02
ParseBench Leaderboard39.4547.4763.810.021.5264.43Granite Vision 4.1 4B2026-04-16
ParseBench Leaderboard✓ Link38.930.8670.410.046.2877.11WeVisDoc-2B2026-09-17
ParseBench Leaderboard✓ Link36.150.7965.860.043.6570.45WeVisDoc-4B2026-09-17
ParseBench Leaderboard✓ Link35.42.58.019.757.888.9Qwen3.5-4B2026-02-16
ParseBench Leaderboard✓ Link31.95.49.931.822.090.5Qwen3.5-9B2026-02-16
ParseBench Leaderboard✓ Link29.61.766.10.02.378.0GLM-OCR2026-03-11
ParseBench Leaderboard✓ Link28.40.41.515.043.182.0Qwen3.5-0.8B2026-02-16
ParseBench Leaderboard✓ Link27.30.10.018.331.187.2Qwen3.5-2B2026-02-16
Check out how to contribute new results. Then edit this file on GitLab or GitHub.