OpenCodePapers

code-generation-on-nl2repo

Code IntelligenceCode Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link68.2DeepSeek-V4.1-Flash-10172026-09-17
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link65.4DeepSeek-V4.1-Flash Max2026-09-17
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link61.5DeepSeek-V4-Pro-0813 (Max)2026-04-26
Hy4 preview✓ Link58.9Hy4 preview2026-08-28
GLM-5.3: Frontier Coding with Emergent Cyber Capabilities✓ Link58.0GLM-5.32026-08-14
On the Limitations of Non-GPU AI Accelerators for Large-Model Inference: A Field Study of MoE and Multimodal Serving on Huawei Ascend57.7DeepSeek-V4-Flash-Vision-Exp2026-07-09
GLM-5.3-Flash: Frontier Intelligence, Flash Cost✓ Link56.3GLM-5.3-Flash2026-08-26
Qwen3.8-Max: A New Bar for Coding and Cowork✓ Link55.9Qwen3.8-Max2026-08-03
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link54.2DeepSeek-V4-Flash-0731 (Max)2026-04-26
Introducing GPT-5.550.7GPT-5.5 (Max)2026-04-23
dots3-note Preview: A Small but Mighty Step Toward Long-Horizon Agency in Real Life✓ Link49.82dots3-note Preview2026-08-13
GLM-5.2: Built for Long-Horizon Tasks✓ Link48.9GLM-5.2 (Max)2026-06-16
Ornith-1.0: Self-Scaffolding LLMs for Agentic Coding✓ Link48.2Ornith-1.0-397B2026-06-21
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability✓ Link48.1Qwen3.8-Flash-Next2026-08-31
Seed2.1 Model Card: Agentic Intelligence for Productivity47.0Seed2.1 Pro2026-06-23
Ornith-1.5: From Self-Scaffolding to Self-Improvement46.2Ornith-1.5-35B-A3B2026-08-20
Hy3✓ Link45.6Hy32026-07-02
GLM-5.1: Towards Long-Horizon Tasks✓ Link42.7GLM-5.1 (Max)2026-04-03
Qwen3.8-27B✓ Link42.3Qwen3.8-27B2026-08-05
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence✓ Link39.8MiniMax-M2.7 (229.9B total, 9.8B activated)2026-05-26
Marathoner: Ultra-Long-Horizon Autonomous Intelligence34.7Marathoner-9B2026-09-28
Ornith-1.0: Self-Scaffolding LLMs for Agentic Coding✓ Link34.6Ornith-1.0-35B2026-06-21
Gemini 3.1 Pro: A smarter model for your most complex tasks33.4Gemini 3.1 Pro (Max)2026-02-19
Ornith-1.0: Self-Scaffolding LLMs for Agentic Coding✓ Link27.2Ornith-1.0-9B2026-06-21