| code-generation-on-apps | code-davinci-002 175B (CodeT) | #4 | Introductory Pass@1: 47.3%Interview Pass@1: 14.3%… |
| code-generation-on-apps | code-davinci-002 175B | #6 | Introductory Pass@1: 31.92 |
| code-generation-on-mbpp | code-davinci-002 175B + CodeT | #64 | Accuracy: 67.7 |
| code-generation-on-mbpp | code-davinci-001 175B + CodeT | #82 | Accuracy: 61.9 |
| code-generation-on-mbpp | code-cushman-001 12B (CodeT) | #98 | Accuracy: 55.4 |
| code-generation-on-mbpp | CodeGen-Mono 16B + CodeT | #106 | Accuracy: 49.5 |
| code-generation-on-mbpp | InCoder 6.7B + CodeT | #146 | Accuracy: 34.4 |