Competition-Level Code Generation with AlphaCode
Open paper
Benchmark
Model
Rank
Results
code-generation-on-apps
AlphaCode 1B Filtered from 50000
#17
Competition Pass@any: 22.0
code-generation-on-apps
AlphaCode 1B
#18
Competition Pass@any: 7.75%
Interview Pass@any: 9.66%
…
Rank counts only results with a code link.