| Benchmark | Model | Rank | Results |
|---|---|---|---|
| code-generation-on-apps | CodeSim (GPT4) | #9 | Introductory Pass@1: 26.04Interview Pass@1: 4.21… |
| code-generation-on-codecontests | CodeSim (GPT4) | #4 | Test Set pass@1: 28.4 |
| code-generation-on-mbpp | CodeSim (GPT4o) | #5 | Accuracy: 90.7 |