OpenCodePapers

code-generation-on-frontiercode-1-1-main

Code IntelligenceCode Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeScorePass RateModelNameReleaseDate
FrontierCode Leaderboard✓ Link54.6459.6Claude Opus 5.5 (Claude Code)2026-09-22
FrontierCode Leaderboard✓ Link53.4858.85Claude Fable 5 (Claude Code)2026-06-09
FrontierCode Leaderboard✓ Link53.3858.85Claude Opus 5 (Claude Code)2026-07-24
FrontierCode Leaderboard✓ Link53.2658.75GPT-6 Astra (Codex)2026-09-03
FrontierCode Leaderboard✓ Link52.0957.2Claude Sonnet 5.5 (Claude Code)2026-09-28
FrontierCode Leaderboard50.9155.45Claude Fable 5.1 (Claude Code)2026-09-01
FrontierCode Leaderboard50.2355.8GPT-6.1 Sol (Codex)2026-09-29
FrontierCode Leaderboard50.055.47SWE-2 (devin)2026-09-10
FrontierCode Leaderboard49.2754.3GPT-6 Sol (Codex)2026-09-22
FrontierCode Leaderboard48.0153.15Grok 4.6 (Grok Build)2026-08-12
FrontierCode Leaderboard47.5953.1Grok 4.7 (Grok Build)2026-09-21
FrontierCode Leaderboard✓ Link47.5552.8Gemini 4 Argon (Chisel)2026-09-30
FrontierCode Leaderboard✓ Link47.4952.91GPT-5.6 Sol (Codex)2026-07-09
FrontierCode Leaderboard46.551.65Claude Opus 4.8 (Claude Code)2026-05-28
Introducing Claude Haiku 5.546.4Claude Haiku 5.5 (max effort) (Claude Code)2026-10-07
FrontierCode Leaderboard46.3651.65Claude Haiku 5.5 (Claude Code)2026-10-07
FrontierCode Leaderboard✓ Link44.1748.91Kimi K3 (MiniSWE-Agent)2026-07-27
FrontierCode Leaderboard✓ Link43.8748.63DeepSeek V4.1 Flash (Chisel)2026-09-17
FrontierCode Leaderboard✓ Link43.5948.9Gemini 3.7 Flash (Chisel)2026-08-13
FrontierCode Leaderboard42.9648.24GPT-5.5 (Codex)2026-04-23
FrontierCode Leaderboard42.7347.59Claude Sonnet 5 (Claude Code)2026-06-30
FrontierCode Leaderboard42.4447.2Grok 4.5 (Grok Build)2026-07-08
FrontierCode Leaderboard42.4247.8GPT-6 Luna (Codex)2026-09-22
FrontierCode Leaderboard41.9947.4SWE-1.7 (Chisel)2026-07-08
FrontierCode Leaderboard✓ Link41.3146.32GPT-5.6 Terra (Codex)2026-07-09
FrontierCode Leaderboard✓ Link41.1946.73Gemini 3.8 Flash (Chisel)2026-09-02
FrontierCode Leaderboard✓ Link40.1444.7GLM 5.3 (Chisel)2026-08-14
FrontierCode Leaderboard✓ Link39.8144.74GPT-5.6 Luna (Codex)2026-07-09
FrontierCode Leaderboard39.4343.5Mistral Large 4 (Preview) (Chisel)2026-10-06
FrontierCode Leaderboard38.5442.83Claude Opus 4.7 (Claude Code)2026-04-16
FrontierCode Leaderboard34.3738.9Gemini 3.6 Flash (Chisel)2026-07-21
FrontierCode Leaderboard✓ Link31.8335.67GLM 5.3 Flash (Chisel)2026-08-26
FrontierCode Leaderboard30.0633.6Kimi K2.7 (MiniSWE-Agent)2026-06-11
FrontierCode Leaderboard✓ Link28.5531.8DeepSeek V4 Pro 0813 (Chisel)2026-04-26
FrontierCode Leaderboard27.0430.8GPT-5.4-mini (Codex)2026-03-17
FrontierCode Leaderboard26.6429.7Claude Opus 4.6 (Claude Code)2026-02-05
FrontierCode Leaderboard25.6429.34Composer 2.5 (Cursor CLI)2026-03-25
FrontierCode Leaderboard✓ Link24.527.4GLM 5.2 (MiniSWE-Agent)2026-06-16
FrontierCode Leaderboard24.3127.5Claude Sonnet 4.6 (Claude Code)2026-02-17
FrontierCode Leaderboard✓ Link18.821.08DeepSeek V4 Flash 0731 (Chisel)2026-04-26
FrontierCode Leaderboard✓ Link17.6420.0DeepSeek V4 Pro (MiniSWE-Agent)2026-04-26
FrontierCode Leaderboard✓ Link14.716.64MiniMax M3 (MiniSWE-Agent)2026-05-31
FrontierCode Leaderboard✓ Link14.015.9Inkling (MiniSWE-Agent)2026-07-15
FrontierCode Leaderboard✓ Link13.6115.4Nemotron 3 Ultra (Chisel)2026-06-03
FrontierCode Leaderboard10.211.46Qwen 3.7 Plus (MiniSWE-Agent)2026-06-02
FrontierCode Leaderboard9.3910.45SWE-1.6 (Chisel)2026-04-07
FrontierCode Leaderboard8.09.0Mistral 3.5 Medium (Chisel)2026-04-28