| Paper | Code | Accuracy (token-level) | EM (line-level) | Edit Sim (line-level) | ModelName | ReleaseDate |
|---|---|---|---|---|---|---|
| CodeXGLUE: A Machine Learning Benchmark Dataset for Code Understanding and Generation | ✓ Link | 75.11 | 39.65 | 69.84 | CodeGPT-adapted | 2021-02-09 |
| CodeT5+: Open Code Large Language Models for Code Understanding and Generation | ✓ Link | 44.86 | 74.22 | CodeT5+ 770M | 2023-05-13 | |
| CodeT5+: Open Code Large Language Models for Code Understanding and Generation | ✓ Link | 43.42 | 73.69 | CodeT5+ 220M | 2023-05-13 |