| code-generation-on-res-q | QurrentOS-coder + Claude 3.5 Sonnet | #1 | pass@1: 58.0 |
| code-generation-on-res-q | QurrentOS-coder + GPT-4o | #2 | pass@1: 46.0 |
| code-generation-on-res-q | QurrentOS-coder + GPT-4 Turbo | #3 | pass@1: 37.0 |
| code-generation-on-res-q | QurrentOS-coder + Claude 3 Opus | #4 | pass@1: 36.0 |
| code-generation-on-res-q | QurrentOS-coder + GPT-4 | #5 | pass@1: 30.0 |
| code-generation-on-res-q | QurrentOS-coder + Gemini 1.5 Pro | #6 | pass@1: 30.0 |
| code-generation-on-res-q | QurrentOS-coder + DeepSeek-Coder-V2 | #7 | pass@1: 29.0 |
| code-generation-on-res-q | QurrentOS-coder + Llama 3 70b | #8 | pass@1: 20.0 |
| code-generation-on-res-q | QurrentOS-coder + Qwen-72B-Instruct | #9 | pass@1: 18.0 |