OpenCodePapers

code-generation-on-deepswe

Code IntelligenceCode Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodePass@1ModelNameReleaseDate
Muse Wonder: A Frontier Model For Personal & Professional AI Agents0.79Muse Wonder Full (max) (MiniSWE-Agent)2026-10-12
Muse Wonder: A Frontier Model For Personal & Professional AI Agents0.788Muse Wonder (max) (MiniSWE-Agent)2026-10-12
Gemini 4 Argon: our next era of frontier intelligence✓ Link0.779Gemini 4 Argon (mini-swe-agent)2026-09-30
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link0.77DeepSeek-V4.1-Flash-1017 (Mini-SWE-V2)2026-09-17
Introducing Muse Spark 1.30.754Muse Spark 1.3 (max effort) (mini-swe-agent)2026-09-02
Introducing GPT-6.1 Sol0.7522GPT-6.1 Sol (high effort) (mini-swe-agent)2026-09-29
DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression✓ Link0.742DeepSeek-V4.1-Flash Max (mini-SWE)2026-09-17
Introducing Claude Opus 5.5✓ Link0.742Claude Opus 5.52026-09-22
GPT-6 Astra: A new generation of intelligence✓ Link0.741GPT-6 Astra2026-09-03
Introducing Gemini 3.8 Flash and 3.8 Flash Cyber✓ Link0.737Gemini 3.8 Flash (high thinking) (mini-swe-agent)2026-09-02
Introducing SWE-2: Pushing the Pareto Frontier0.73SWE-2 (mini-swe-agent)2026-09-10
GPT-5.6: Frontier intelligence that scales with your ambition✓ Link0.727GPT-5.6 Sol2026-07-09
MiMo-V2.6: Scaling Reinforcement Learning Towards Self-Improvement✓ Link0.719MiMo-V2.6-Pro-RL (mini-swe-agent)2026-10-08
Introducing Grok 4.70.71Grok 4.7 (high effort)2026-09-21
Introducing Claude Sonnet 5.5✓ Link0.71Claude Sonnet 5.5 (max effort)2026-09-28
DeepSWE Leaderboard✓ Link0.6991Claude Fable 5 (xhigh) (MiniSWE-Agent)2026-06-09
Introducing GPT-6 Sol and Luna0.6881GPT-6 Sol (max effort) (mini-swe-agent)2026-09-22
Introducing Claude Opus 5✓ Link0.688Claude Opus 52026-07-24
Step 5 Preview0.677Step 5 Preview (High) (SWE-agent)2026-09-20
Kimi K3: Open Frontier Intelligence✓ Link0.675Kimi K3 (Max) (Kimi Code)2026-07-27
DeepSWE Leaderboard0.6748Grok 4.6 (medium) (MiniSWE-Agent)2026-08-12
Introducing Claude Fable 5.1 and Claude Mythos 5.10.674Claude Fable 5.1 (max effort)2026-09-01
DeepSWE Leaderboard0.6704GPT-5.5 (xhigh) (MiniSWE-Agent)2026-04-23
GLM-5.3: Frontier Coding with Emergent Cyber Capabilities✓ Link0.669GLM-5.3 (MiniSWE-Agent)2026-08-14
Introducing GPT-6 Sol and Luna0.6659GPT-6 Luna (max effort) (mini-swe-agent)2026-09-22
Introducing Gemini 3.7 Flash✓ Link0.653Gemini 3.7 Flash (High) (MiniSWE-Agent)2026-08-13
Hy4 preview✓ Link0.643Hy4 preview (mini-swe-agent)2026-08-28
GLM-5.3-Flash: Frontier Intelligence, Flash Cost✓ Link0.634GLM-5.3-Flash (mini-swe-agent)2026-08-26
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link0.627DeepSeek-V4-Pro-0813 (Max) (DeepSeek Harness)2026-04-26
Mistral Large 40.617Mistral Large 4 Preview2026-10-06
On the Limitations of Non-GPU AI Accelerators for Large-Model Inference: A Field Study of MoE and Multimodal Serving on Huawei Ascend0.593DeepSeek-V4-Flash-Vision-Exp (DeepSeek Harness)2026-07-09
DeepSWE Leaderboard0.5897Claude Opus 4.8 (max) (MiniSWE-Agent)2026-05-28
On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability✓ Link0.587Qwen3.8-Flash-Next (mini-SWE-agent)2026-08-31
Macaron-V1: Towards Open Continual Learning with Self-Improvement and Mixture-of-LoRA✓ Link0.584Macaron-V1-Venti (Claude Code)2026-08-10
DeepSWE Leaderboard✓ Link0.5746Qwen3.8 Max (xhigh) (MiniSWE-Agent)2026-08-03
DeepSWE Leaderboard0.5487Muse Spark 1.2 (xhigh) (MiniSWE-Agent)2026-08-05
DeepSeek-V4: Towards Highly Efficient Million-Token Context Intelligence✓ Link0.544DeepSeek-V4-Flash-0731 (Max) (DeepSeek Harness)2026-04-26
DeepSWE Leaderboard0.5385Claude Sonnet 5 (max) (MiniSWE-Agent)2026-06-30
Introducing Muse Spark 1.1✓ Link0.533Muse Spark 1.1 (MiniSWE-Agent)2026-07-09
Introducing Grok 4.50.53Grok 4.52026-07-08
DeepSWE Leaderboard0.5177GPT-5.4 (xhigh) (MiniSWE-Agent)2026-03-05
DeepSWE Leaderboard0.4668Gemini 3.6 Flash (high) (MiniSWE-Agent)2026-07-21
GLM-5.2: Built for Long-Horizon Tasks✓ Link0.462GLM-5.2 (MiniSWE-Agent)2026-06-16
Introducing Beam: Reflection's 501B open-weight model0.444Beam2026-10-05
Qwen3.8-27B✓ Link0.422Qwen3.8-27B (Claude Code)2026-08-05
Introducing Laguna S 2.1✓ Link0.404Laguna S 2.1 (pool)2026-07-21
DeepSWE Leaderboard0.3606Gemini 3.5 Flash (high) (MiniSWE-Agent)2026-05-19
Seed2.1 Model Card: Agentic Intelligence for Productivity0.327Seed2.1 Pro2026-06-23
DeepSWE Leaderboard0.3053Kimi K2.7 Code (MiniSWE-Agent)2026-06-11
DeepSWE Leaderboard0.2993Claude Sonnet 4.6 (high) (MiniSWE-Agent)2026-02-17
Hy3✓ Link0.28Hy32026-07-02
Ornith-1.5: From Self-Scaffolding to Self-Improvement0.22Ornith-1.5-35B-A3B (Claude Code)2026-08-20
CodeMidas: Scaling Agentic Coding RL Environments from Code Itself0.217MiMo-V2.5 (CodeMidas RL)2026-09-18
GLM-5.1: Towards Long-Horizon Tasks✓ Link0.18GLM-5.1 (Max) (MiniSWE-Agent)2026-04-03
MindForge: Teaching Small Language Models Whole-Life-Cycle Software Engineering via Source-Free Program Synthesis0.1592MindForge-27B (Mini-SWE-Agent)2026-07-29
DeepSWE Leaderboard0.1173Gemini 3.1 Pro Preview (high) (MiniSWE-Agent)2026-02-19