| code-generation-on-deepswe | Claude Fable 5 (xhigh) (MiniSWE-Agent) | #10 | Pass@1: 0.6991 |
| code-generation-on-deepswe | Qwen3.8 Max (xhigh) (MiniSWE-Agent) | #20 | Pass@1: 0.5746 |
| code-generation-on-deepswe | Claude Opus 4.8 (max) (MiniSWE-Agent) | – | Pass@1: 0.5897 |
| code-generation-on-deepswe | Claude Sonnet 4.6 (high) (MiniSWE-Agent) | – | Pass@1: 0.2993 |
| code-generation-on-deepswe | Claude Sonnet 5 (max) (MiniSWE-Agent) | – | Pass@1: 0.5385 |
| code-generation-on-deepswe | GPT-5.4 (xhigh) (MiniSWE-Agent) | – | Pass@1: 0.5177 |
| code-generation-on-deepswe | GPT-5.5 (xhigh) (MiniSWE-Agent) | – | Pass@1: 0.6704 |
| code-generation-on-deepswe | Gemini 3.1 Pro Preview (high) (MiniSWE-Agent) | – | Pass@1: 0.1173 |
| code-generation-on-deepswe | Gemini 3.5 Flash (high) (MiniSWE-Agent) | – | Pass@1: 0.3606 |
| code-generation-on-deepswe | Gemini 3.6 Flash (high) (MiniSWE-Agent) | – | Pass@1: 0.4668 |
| code-generation-on-deepswe | Grok 4.6 (medium) (MiniSWE-Agent) | – | Pass@1: 0.6748 |
| code-generation-on-deepswe | Kimi K2.7 Code (MiniSWE-Agent) | – | Pass@1: 0.3053 |
| code-generation-on-deepswe | Muse Spark 1.2 (xhigh) (MiniSWE-Agent) | – | Pass@1: 0.5487 |