| Paper | Code | Smoothed BLEU-4 | ModelName | ReleaseDate |
|---|---|---|---|---|
| CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing | ✓ Link | 21.87 | CodeTrans-MT-Large | 2021-04-06 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 14.56 | CodeBERT (MLM+RTD) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 13.59 | CodeBERT (MLM) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 13.2 | RoBERTa | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 13.07 | pre-train w/ code only | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 12.72 | CodeBERT (RTD) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 12.57 | Transformer | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 11.42 | seq2seq | 2020-02-19 |