| Paper | Code | Smoothed BLEU-4 | ModelName | ReleaseDate |
|---|---|---|---|---|
| CodeTrans: Towards Cracking the Language of Silicon's Code Through Self-Supervised Deep Learning and High Performance Computing | ✓ Link | 20.39 | CodeTrans-MT-Base | 2021-04-06 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 15.48 | CodeBERT (MLM) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 15.41 | CodeBERT (MLM+RTD) | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 15.12 | pre-train w/ code only | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 14.92 | RoBERTa | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 13.44 | Transformer | 2020-02-19 |
| CodeBERT: A Pre-Trained Model for Programming and Natural Languages | ✓ Link | 13.04 | seq2seq | 2020-02-19 |