OpenCodePapers

code-generation-on-codecontests

Code Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeTest Set pass@1Test Set pass@5Val Set pass@1Val Set pass@5ModelNameReleaseDate
Execution Guided Line-by-Line Code Generation✓ Link58.18EG-CFG (DeepSeek-V3-0324)2025-06-12
Planning-Driven Programming: A Large Language Model Programming Workflow✓ Link34.7LPW (GPT-4o)2024-11-21
MapCoder: Multi-Agent Code Generation for Competitive Problem Solving✓ Link28.535.228.5MapCoder (GPT-4)2024-05-18
CODESIM: Multi-Agent Code Generation and Problem Solving through Simulation-Driven Planning and Debugging✓ Link28.4CodeSim (GPT4)2025-02-08
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks✓ Link26.3420.35MoTCoder-15B2023-12-26
MoTCoder: Elevating Large Language Models with Modular of Thought for Challenging Programming Tasks✓ Link20.7716.72MoTCoder-7B-v1.52023-12-26
CodeChain: Towards Modular Code Generation Through Chain of Self-revisions with Representative Sub-modules✓ Link2.353.292.483.30CodeChain + WizardCoder-15B2023-10-13
WizardCoder: Empowering Code Large Language Models with Evol-Instruct✓ Link1.113.181.983.27WizardCoder-15B2023-06-14
Check out how to contribute new results.