| Paper | Code | Smoothed BLEU-4 | ModelName | ReleaseDate |
|---|---|---|---|---|
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 26.79 | CodeBERT (MLM) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 26.66 | CodeBERT (MLM+RTD) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 26.39 | pre-train w/ code only | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 26.09 | RoBERTa | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 26.02 | CodeBERT (RTD) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 23.48 | seq2seq | 2020-02-19 |
| CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing | ✓ Link | 19.54 | CodeTrans-TF-Large | 2021-04-06 |