OpenCodePapers

code-generation-on-scicode

Code IntelligenceCode Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracyModelNameReleaseDate
Gemini 3.1 Pro: A smarter model for your most complex tasks59Gemini 3.1 Pro2026-02-19
Kimi K3: Open Frontier Intelligence✓ Link58.7Kimi K3 (Max)2026-07-27
Introducing Muse Spark Open, The Most Capable US Open-Weight Model to Date✓ Link58.5Muse Spark Open2026-10-15
Kimi K2.6✓ Link52.2Kimi K2.62026-04-20
KAT-Coder-V2.5 Technical Report50.3KAT-Coder-V2.52026-07-06
Introducing Beam: Reflection's 501B open-weight model49.7Beam2026-10-05
Intern-S2-Preview: Scientific Agentic Foundation Model✓ Link49.11Intern-S2-Preview-397B2026-08-13
Kimi K2.5: Visual Agentic Intelligence✓ Link48.7Kimi K2.52026-02-02
Inkling-Small✓ Link48.7Inkling-Small2026-07-27
Priming Base Models for Agentic Post-Training: An Open Midtraining Recipe47.13NVIDIA Nemotron 3.5 Super VL 120B-A12B BF162026-10-15
The MiniMax-M2 Series: Mini Activations Unleashing Max Real-World Intelligence✓ Link47.0MiniMax-M2.72026-05-26
Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning✓ Link44.6Nemotron 3 Ultra2026-06-03
Scaling the Horizon, Not the Parameters: Reaching Trillion-Parameter Performance with a 35B Agent✓ Link44.3Agents-A12026-06-29
Sage-A1.5: From Long-Horizon Execution to Scientific Exploration with Capability Composition✓ Link44.3Sage-A1.52026-10-20
Muse Glimmer 30B: An On-Device Agentic Model✓ Link43.6Muse Glimmer-30B (High)2026-10-17
Magenta: Closing the Loop Between Mathematical Reasoning and Lean Verification42.7K2-Horizon-375B-A23B2026-09-10
NVIDIA Nemotron 3: Efficient and Open Intelligence✓ Link42.05Nemotron 3 Super2025-12-24
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link41.7GLM-4.5 (355B)2025-08-08
Motif 3: Technical Report✓ Link40.6Motif 32026-08-10
Granite 4.2 LLMs: How They're Built✓ Link38.76Granite-4.2-30B2026-08-25
Introducing North Mini Code: Cohere's first model for developers✓ Link38.2North Mini Code2026-06-09
GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Models✓ Link37.3GLM-4.5-Air2025-08-08
Nemotron-Cascade 2: Post-Training LLMs with Cascade RL and Multi-Domain On-Policy Distillation36.4Nemotron-Cascade-2-30B-A3B2026-03-19
Nanbeige4.2-3B: Unlocking Agentic Capabilities in a Compact Model✓ Link35.6Nanbeige4.2-3B2026-07-21
Unified Audio Intelligence Without Regressing on Text Intelligence35.2Audex 30B-A3B2026-07-06
Closing the Loop: Practical Training Recipes for Looped Language Models35.11Dory1.0-4B2026-09-30
TPPO: Tracking-Value PPO For Language Model Reasoning✓ Link35.0TPPO (Qwen3.5-9B)2026-10-12
Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs34.2Hypernova-60B2026-08-21
One Model to Loop Them All: Elastic Latent Recurrence for Language Models33.4Koi-4B2026-10-08
Nemotron 3 Nano: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning✓ Link33.3NVIDIA-Nemotron-3-Nano-30B-A3B-BF162025-12-23
LFM2.5-24B-A2B: Built for Fast On-Device Agents32.71LFM2.5-24B-A2B2026-10-13
NVIDIA Nemotron 3.5 Lightning✓ Link32.6NVIDIA Nemotron 3.5 Lightning 30B-A3B2026-08-11
Nemotron 3 Nano Omni: Efficient and Open Multimodal Intelligence✓ Link32.0Nemotron 3 Nano Omni2026-04-27
Introducing K2 Horizon: Frontier Performance, Radically Open✓ Link31.6K2-Horizon-7B2026-09-03
AgentMercury: Your Agent Can Synthesize Verifiable Environments for Business Scenarios at scale29.9Qwen3.5-35B-A3B + GRPO + Ours2026-08-21