| Benchmark | Model | Rank | Results |
|---|---|---|---|
| code-completion-on-codexglue-github-java | CodeGPT-adapted | #1 | Accuracy (token-level): 77.13EM (line-level): 26.43… |
| code-completion-on-codexglue-py150 | CodeGPT-adapted | #1 | Accuracy (token-level): 75.11EM (line-level): 39.65… |
| code-search-on-codexglue-advtest | CodeBERT | #3 | MRR: 27.19 |