OpenCodePapers

code-generation-on-frontiercode-1-1-extended

Code IntelligenceCode Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeScorePass RateModelNameReleaseDate
FrontierCode Leaderboard✓ Link65.2770.8Claude Opus 5.5 (Claude Code)2026-09-22
FrontierCode Leaderboard✓ Link64.9470.86Claude Fable 5 (Claude Code)2026-06-09
FrontierCode Leaderboard✓ Link64.4870.63GPT-6 Astra (Codex)2026-09-03
FrontierCode Leaderboard✓ Link64.4369.87Claude Sonnet 5.5 (Claude Code)2026-09-28
FrontierCode Leaderboard✓ Link63.6369.63Claude Opus 5 (Claude Code)2026-07-24
FrontierCode Leaderboard63.668.8Claude Fable 5.1 (Claude Code)2026-09-01
FrontierCode Leaderboard62.4668.44SWE-2 (devin)2026-09-10
FrontierCode Leaderboard61.3167.05Grok 4.6 (Grok Build)2026-08-12
FrontierCode Leaderboard60.6966.33GPT-6 Sol (Codex)2026-09-22
FrontierCode Leaderboard✓ Link60.5866.0Gemini 4 Argon (Chisel)2026-09-30
FrontierCode Leaderboard✓ Link60.5566.61GPT-5.6 Sol (Codex)2026-07-09
FrontierCode Leaderboard60.466.53GPT-6.1 Sol (Codex)2026-09-29
FrontierCode Leaderboard59.665.49Claude Opus 4.8 (Claude Code)2026-05-28
FrontierCode Leaderboard59.3565.23Grok 4.7 (Grok Build)2026-09-21
FrontierCode Leaderboard58.4364.7Claude Haiku 5.5 (Claude Code)2026-10-07
FrontierCode Leaderboard✓ Link58.1963.58Kimi K3 (MiniSWE-Agent)2026-07-27
FrontierCode Leaderboard56.6662.76GPT-5.5 (Codex)2026-04-23
FrontierCode Leaderboard✓ Link56.6262.03DeepSeek V4.1 Flash (Chisel)2026-09-17
FrontierCode Leaderboard56.5562.27Grok 4.5 (Grok Build)2026-07-08
FrontierCode Leaderboard✓ Link56.2762.33Gemini 3.7 Flash (Chisel)2026-08-13
FrontierCode Leaderboard56.1861.66Claude Sonnet 5 (Claude Code)2026-06-30
FrontierCode Leaderboard56.162.27GPT-6 Luna (Codex)2026-09-22
FrontierCode Leaderboard✓ Link55.8461.75GPT-5.6 Terra (Codex)2026-07-09
FrontierCode Leaderboard✓ Link55.0660.89GPT-5.6 Luna (Codex)2026-07-09
FrontierCode Leaderboard54.2660.33SWE-1.7 (Chisel)2026-07-08
FrontierCode Leaderboard53.9359.09Claude Opus 4.7 (Claude Code)2026-04-16
FrontierCode Leaderboard✓ Link53.4559.62Gemini 3.8 Flash (Chisel)2026-09-02
FrontierCode Leaderboard53.2158.07Mistral Large 4 (Preview) (Chisel)2026-10-06
FrontierCode Leaderboard✓ Link52.6357.73GLM 5.3 (Chisel)2026-08-14
FrontierCode Leaderboard48.0253.27Gemini 3.6 Flash (Chisel)2026-07-21
FrontierCode Leaderboard✓ Link46.2151.08GLM 5.3 Flash (Chisel)2026-08-26
FrontierCode Leaderboard45.3850.0Kimi K2.7 (MiniSWE-Agent)2026-06-11
FrontierCode Leaderboard✓ Link44.4548.93DeepSeek V4 Pro 0813 (Chisel)2026-04-26
FrontierCode Leaderboard43.6748.0Claude Opus 4.6 (Claude Code)2026-02-05
FrontierCode Leaderboard43.0147.94GPT-5.4-mini (Codex)2026-03-17
FrontierCode Leaderboard40.7545.13Composer 2.5 (Cursor CLI)2026-03-25
FrontierCode Leaderboard✓ Link40.0544.13GLM 5.2 (MiniSWE-Agent)2026-06-16
FrontierCode Leaderboard40.044.4Claude Sonnet 4.6 (Claude Code)2026-02-17
FrontierCode Leaderboard✓ Link31.734.96DeepSeek V4 Flash 0731 (Chisel)2026-04-26
FrontierCode Leaderboard✓ Link31.0134.49DeepSeek V4 Pro (MiniSWE-Agent)2026-04-26
FrontierCode Leaderboard✓ Link28.5431.46MiniMax M3 (MiniSWE-Agent)2026-05-31
FrontierCode Leaderboard✓ Link27.2130.27Nemotron 3 Ultra (Chisel)2026-06-03
FrontierCode Leaderboard✓ Link24.827.8Inkling (MiniSWE-Agent)2026-07-15
FrontierCode Leaderboard21.7824.13Qwen 3.7 Plus (MiniSWE-Agent)2026-06-02
FrontierCode Leaderboard20.522.67SWE-1.6 (Chisel)2026-04-07
FrontierCode Leaderboard18.6620.6Mistral 3.5 Medium (Chisel)2026-04-28