| code-documentation-generation-on | CodeBERT (MLM) | #2 | Smoothed BLEU-4: 15.48 |
| code-documentation-generation-on | CodeBERT (MLM+RTD) | #3 | Smoothed BLEU-4: 15.41 |
| code-documentation-generation-on | pre-train w/ code only | #4 | Smoothed BLEU-4: 15.12 |
| code-documentation-generation-on | RoBERTa | #5 | Smoothed BLEU-4: 14.92 |
| code-documentation-generation-on | Transformer | #6 | Smoothed BLEU-4: 13.44 |
| code-documentation-generation-on | seq2seq | #7 | Smoothed BLEU-4: 13.04 |
| code-documentation-generation-on-1 | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 14.56 |
| code-documentation-generation-on-1 | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 13.59 |
| code-documentation-generation-on-1 | RoBERTa | #4 | Smoothed BLEU-4: 13.2 |
| code-documentation-generation-on-1 | pre-train w/ code only | #5 | Smoothed BLEU-4: 13.07 |
| code-documentation-generation-on-1 | CodeBERT (RTD) | #6 | Smoothed BLEU-4: 12.72 |
| code-documentation-generation-on-1 | Transformer | #7 | Smoothed BLEU-4: 12.57 |
| code-documentation-generation-on-1 | seq2seq | #8 | Smoothed BLEU-4: 11.42 |
| code-documentation-generation-on-2 | CodeBERT (MLM) | #1 | Smoothed BLEU-4: 26.79 |
| code-documentation-generation-on-2 | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 26.66 |
| code-documentation-generation-on-2 | pre-train w/ code only | #3 | Smoothed BLEU-4: 26.39 |
| code-documentation-generation-on-2 | RoBERTa | #4 | Smoothed BLEU-4: 26.09 |
| code-documentation-generation-on-2 | CodeBERT (RTD) | #5 | Smoothed BLEU-4: 26.02 |
| code-documentation-generation-on-2 | seq2seq | #6 | Smoothed BLEU-4: 23.48 |
| code-documentation-generation-on-3 | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 21.32 |
| code-documentation-generation-on-3 | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 21 |
| code-documentation-generation-on-3 | pre-train w/ code only | #4 | Smoothed BLEU-4: 20.71 |
| code-documentation-generation-on-3 | CodeBERT (RTD) | #5 | Smoothed BLEU-4: 20.25 |
| code-documentation-generation-on-3 | RoBERTa | #6 | Smoothed BLEU-4: 19.9 |
| code-documentation-generation-on-3 | seq2seq | #7 | Smoothed BLEU-4: 18.4 |
| code-documentation-generation-on-3 | Transformer | #8 | Smoothed BLEU-4: 18.25 |
| code-documentation-generation-on-4 | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 8.46 |
| code-documentation-generation-on-4 | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 7.95 |
| code-documentation-generation-on-4 | Transformer | #4 | Smoothed BLEU-4: 7.87 |
| code-documentation-generation-on-4 | pre-train w/ code only | #5 | Smoothed BLEU-4: 7.36 |
| code-documentation-generation-on-4 | RoBERTa | #6 | Smoothed BLEU-4: 7.26 |
| code-documentation-generation-on-4 | seq2seq | #7 | Smoothed BLEU-4: 6.96 |
| code-documentation-generation-on-5 | Transformer | #1 | Smoothed BLEU-4: 25.61 |
| code-documentation-generation-on-5 | CodeBERT (MLM+RTD) | #3 | Smoothed BLEU-4: 9.54 |
| code-documentation-generation-on-5 | CodeBERT (RTD) | #4 | Smoothed BLEU-4: 8.73 |
| code-documentation-generation-on-5 | CodeBERT (MLM) | #5 | Smoothed BLEU-4: 8.51 |
| code-documentation-generation-on-5 | pre-train w/ code only | #6 | Smoothed BLEU-4: 8.3 |
| code-documentation-generation-on-5 | seq2seq | #7 | Smoothed BLEU-4: 6.88 |
| code-documentation-generation-on-5 | RoBERTa | #8 | Smoothed BLEU-4: 5.72 |
| code-search-on-codesearchnet | CodeBERT | #6 | Overall: 76.0Go: 69.3Ruby: 70.6Python: 84.0Java: 86.8… |
| type-prediction-on-manytypes4typescript | CodeBERT | #4 | Average Accuracy: 61.72Average Precision: 59.34Average Recall: 59.80… |