| code-generation-on-mbpp | code-davinci-002 175B + Reviewer | #25 | Accuracy: 66.9 |
| code-generation-on-mbpp | code-davinci-002 175B + Coder-Reviewer | #26 | Accuracy: 66.4 |
| code-generation-on-mbpp | code-davinci-002 175B + MBR-Exec | #31 | Accuracy: 63 |
| code-generation-on-mbpp | code-cushman-001 12B + MBR-Exec | #55 | Accuracy: 48.3 |
| code-generation-on-mbpp | CodeGen 16B + MBR-Exec | #58 | Accuracy: 47.3 |
| code-generation-on-mbpp | CodeGen 16B + Coder-Reviewer | #62 | Accuracy: 46.2 |
| code-generation-on-mbpp | CodeGen 16B + Reviewer | #67 | Accuracy: 44.1 |
| code-generation-on-mbpp | InCoder 6.7B + MBR-Exec | #81 | Accuracy: 26.7 |
| code-generation-on-mbpp | InCoder 6.7B + Coder-Reviewer | #82 | Accuracy: 26.1 |
| code-generation-on-mbpp | InCoder 6.7B + Reviewer | #83 | Accuracy: 24.4 |