| code-documentation-generation-on-codesearchnet-go | CodeBERT (MLM) | #1 | Smoothed BLEU-4: 26.79 |
| code-documentation-generation-on-codesearchnet-go | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 26.66 |
| code-documentation-generation-on-codesearchnet-go | pre-train w/ code only | #3 | Smoothed BLEU-4: 26.39 |
| code-documentation-generation-on-codesearchnet-go | RoBERTa | #4 | Smoothed BLEU-4: 26.09 |
| code-documentation-generation-on-codesearchnet-go | CodeBERT (RTD) | #5 | Smoothed BLEU-4: 26.02 |
| code-documentation-generation-on-codesearchnet-go | seq2seq | #6 | Smoothed BLEU-4: 23.48 |
| code-documentation-generation-on-codesearchnet-javascript | Transformer | #1 | Smoothed BLEU-4: 25.61 |
| code-documentation-generation-on-codesearchnet-javascript | CodeBERT (MLM+RTD) | #3 | Smoothed BLEU-4: 9.54 |
| code-documentation-generation-on-codesearchnet-javascript | CodeBERT (RTD) | #4 | Smoothed BLEU-4: 8.73 |
| code-documentation-generation-on-codesearchnet-javascript | CodeBERT (MLM) | #5 | Smoothed BLEU-4: 8.51 |
| code-documentation-generation-on-codesearchnet-javascript | pre-train w/ code only | #6 | Smoothed BLEU-4: 8.3 |
| code-documentation-generation-on-codesearchnet-javascript | seq2seq | #7 | Smoothed BLEU-4: 6.88 |
| code-documentation-generation-on-codesearchnet-javascript | RoBERTa | #8 | Smoothed BLEU-4: 5.72 |
| code-documentation-generation-on-codesearchnet-java | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 14.56 |
| code-documentation-generation-on-codesearchnet-java | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 13.59 |
| code-documentation-generation-on-codesearchnet-java | RoBERTa | #4 | Smoothed BLEU-4: 13.2 |
| code-documentation-generation-on-codesearchnet-java | pre-train w/ code only | #5 | Smoothed BLEU-4: 13.07 |
| code-documentation-generation-on-codesearchnet-java | CodeBERT (RTD) | #6 | Smoothed BLEU-4: 12.72 |
| code-documentation-generation-on-codesearchnet-java | Transformer | #7 | Smoothed BLEU-4: 12.57 |
| code-documentation-generation-on-codesearchnet-java | seq2seq | #8 | Smoothed BLEU-4: 11.42 |
| code-documentation-generation-on-codesearchnet-php | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 21.32 |
| code-documentation-generation-on-codesearchnet-php | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 21 |
| code-documentation-generation-on-codesearchnet-php | pre-train w/ code only | #4 | Smoothed BLEU-4: 20.71 |
| code-documentation-generation-on-codesearchnet-php | CodeBERT (RTD) | #5 | Smoothed BLEU-4: 20.25 |
| code-documentation-generation-on-codesearchnet-php | RoBERTa | #6 | Smoothed BLEU-4: 19.9 |
| code-documentation-generation-on-codesearchnet-php | seq2seq | #7 | Smoothed BLEU-4: 18.4 |
| code-documentation-generation-on-codesearchnet-php | Transformer | #8 | Smoothed BLEU-4: 18.25 |
| code-documentation-generation-on-codesearchnet-python | CodeBERT (MLM) | #2 | Smoothed BLEU-4: 15.48 |
| code-documentation-generation-on-codesearchnet-python | CodeBERT (MLM+RTD) | #3 | Smoothed BLEU-4: 15.41 |
| code-documentation-generation-on-codesearchnet-python | pre-train w/ code only | #4 | Smoothed BLEU-4: 15.12 |
| code-documentation-generation-on-codesearchnet-python | RoBERTa | #5 | Smoothed BLEU-4: 14.92 |
| code-documentation-generation-on-codesearchnet-python | Transformer | #6 | Smoothed BLEU-4: 13.44 |
| code-documentation-generation-on-codesearchnet-python | seq2seq | #7 | Smoothed BLEU-4: 13.04 |
| code-documentation-generation-on-codesearchnet-ruby | CodeBERT (MLM+RTD) | #2 | Smoothed BLEU-4: 8.46 |
| code-documentation-generation-on-codesearchnet-ruby | CodeBERT (MLM) | #3 | Smoothed BLEU-4: 7.95 |
| code-documentation-generation-on-codesearchnet-ruby | Transformer | #4 | Smoothed BLEU-4: 7.87 |
| code-documentation-generation-on-codesearchnet-ruby | pre-train w/ code only | #5 | Smoothed BLEU-4: 7.36 |
| code-documentation-generation-on-codesearchnet-ruby | RoBERTa | #6 | Smoothed BLEU-4: 7.26 |
| code-documentation-generation-on-codesearchnet-ruby | seq2seq | #7 | Smoothed BLEU-4: 6.96 |
| type-prediction-on-manytypes4typescript | CodeBERT | #4 | Average Accuracy: 61.72Average Precision: 59.34Average Recall: 59.80… |
| code-search-on-codesearchnet | CodeBERT | #6 | Overall: 76.0Go: 69.3Ruby: 70.6Python: 84.0Java: 86.8… |