| Benchmark | Model | Rank | Results |
|---|---|---|---|
| code-generation-on-webapp1k-react | gpt-4o-2024-08-06 | #3 | pass@1: 0.885 |
| code-generation-on-webapp1k-react | claude-3.5-sonnet | #4 | pass@1: 0.8808 |
| code-generation-on-webapp1k-react | mistral-large-2 | #6 | pass@1: 0.7804 |
| code-generation-on-webapp1k-react | deepseek-coder-v2-instruct | #7 | pass@1: 0.7002 |
| code-generation-on-webapp1k-react | llama-v3p1-405b-instruct | #8 | pass@1: 0.302 |