| code-search-on-codexglue-advtest | CodeT5+ 770M | #1 | MRR: 44.7 |
| code-search-on-codexglue-advtest | CodeT5+ 220M | #2 | MRR: 43.3 |
| code-completion-on-codexglue-github-java | CodeT5+ 770M | #2 | EM (line-level): 37.90Edit Sim (line-level): 72.25 |
| code-completion-on-codexglue-github-java | CodeT5+ 220M | #3 | EM (line-level): 35.17Edit Sim (line-level): 69.48 |
| code-completion-on-codexglue-py150 | CodeT5+ 770M | #2 | EM (line-level): 44.86Edit Sim (line-level): 74.22 |
| code-completion-on-codexglue-py150 | CodeT5+ 220M | #3 | EM (line-level): 43.42Edit Sim (line-level): 73.69 |
| code-search-on-codesearchnet | CodeT5+ 770M | #4 | Overall: 77.4Go: 92.7Ruby: 78.0Python: 75.8Java: 76.2… |
| code-search-on-codesearchnet | CodeT5+ 220M | #5 | Overall: 77.1Go: 92.4Ruby: 77.7Python: 75.6Java: 76.1… |
| arithmetic-reasoning-on-gsm8k | CodeT5+ | #189 | Accuracy: 73.8Parameters (Billion): 0.77 |