| Paper | Code | Accuracy (token-level) | EM (line-level) | Edit Sim (line-level) | ModelName | ReleaseDate |
|---|---|---|---|---|---|---|
| CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | ✓ Link | 77.13 | 26.43 | 63.03 | CodeGPT-adapted | 2021-02-09 |
| CodeT5+: Open Code Large Language Models for Code Understanding and Generation | ✓ Link | 37.90 | 72.25 | CodeT5+ 770M | 2023-05-13 | |
| CodeT5+: Open Code Large Language Models for Code Understanding and Generation | ✓ Link | 35.17 | 69.48 | CodeT5+ 220M | 2023-05-13 |