CodeRL: Mastering Code Generation through Pretrained Models and Deep Reinforcement Learning

Benchmark Model Rank Results
code-generation-on-appsCodeRL+CodeT5#10Introductory Pass@1: 20Interview Pass@1: 13.5Competition Pass@1: 33.3
code-generation-on-appsGPT-J 6B (Finetuned)#11Introductory Pass@1: 6.77%Interview Pass@1: 1.80%
code-generation-on-appsGPT-Neo 2.7B (Finetuned)#13Introductory Pass@1: 4.14%Interview Pass@1: 0.14%
code-generation-on-appsGPT2 1.5B (Finetuned)#15Introductory Pass@1: 3.90%Interview Pass@1: 0.57%