Natural Language to Code Translation with Execution
Open paper
Benchmark
Model
Rank
Results
code-generation-on-mbpp
code-davinci-001 175B + MBR-Exec
#39
Accuracy: 58.2
Rank counts only results with a code link.