RoBERTa: A Robustly Optimized BERT Pretraining Approach

Benchmark Model Rank Results
text-classification-on-arxiv-10RoBERTa#2Accuracy: 0.779
natural-language-inference-on-anli-testRoBERTa (Large)#3A1: 72.4A2: 49.8A3: 44.4
semantic-textual-similarity-on-mrpcRoBERTa (ensemble)#3Accuracy: 92.3%
semantic-textual-similarity-on-sts-b-glue-devRoBERTa#3Pearson/Spearman Correlation: 92.4
natural-language-inference-on-qnliRoBERTa (ensemble)#4Accuracy: 98.9%
paraphrase-identification-on-mrpc-glue-devRoBERTa#4F1: 90.9
natural-language-understanding-on-glue-testRoBERTa#5GLUE (test): 88.5
question-answering-on-quora-question-pairsRoBERTa (ensemble)#5Accuracy: 90.2%
semantic-textual-similarity-on-sts-benchmarkRoBERTa#5Pearson Correlation: 0.922
type-prediction-on-manytypes4typescriptRoBERTa#5Average Accuracy: 59.84Average Precision: 57.45Average Recall: 57.62…
natural-language-inference-on-multinli-devRoBERTa#6Matched: 90.2
natural-language-inference-on-rte-glue-devRoBERTa#6Accuracy: 86.6
question-answering-on-squad20-devRoBERTa (no data aug)#6F1: 89.4EM: 86.5
linguistic-acceptability-on-cola-glue-devRoBERTa#7Matthews Correlation: 68.0
natural-language-inference-on-multinliRoBERTa#7Matched: 90.8
natural-language-inference-on-multinliRoBERTa (ensemble)#50Mismatched: 90.2
natural-language-inference-on-qnli-glue-devRoBERTa#7Accuracy: 94.7
natural-language-inference-on-wnliRoBERTa (ensemble)#8Accuracy: 89
reading-comprehension-on-raceRoBERTa#9Accuracy: 83.2Accuracy (Middle): 86.5Accuracy (High): 81.3
sentiment-analysis-on-sst-2-binary-classificationRoBERTa (ensemble)#11Accuracy: 96.7
stock-market-prediction-on-astockRoBERTa WWM Ext (News+Factors)#11Accuray: 62.49F1-score: 62.54Recall: 62.51Precision: 62.59
stock-market-prediction-on-astockRoBERTa WWM Ext (News)#12Accuray: 61.34F1-score: 61.48Recall: 61.32Precision: 61.97
question-answering-on-social-iqaRoBERTa-Large 355M (fine-tuned)#12Accuracy: 76.7
question-answering-on-squad20RoBERTa (single model)#12EM: 86.820F1: 89.795
linguistic-acceptability-on-colaRoBERTa (ensemble)#16Accuracy: 67.8%
common-sense-reasoning-on-commonsenseqaRoBERTa-Large 355M#17Accuracy: 72.1
natural-language-inference-on-rteRoBERTa#17Accuracy: 88.2%
natural-language-inference-on-rteRoBERTa (ensemble)#18Accuracy: 88.2%
task-1-grouping-on-ocwRoBERTa (LARGE)#22# Correct Groups: 29 ± 3Fowlkes Mallows Score (FMS): 26.7 ± .2…
document-image-classification-on-rvl-cdipRoberta base#27Accuracy: 90.06Parameters: 125M
paraphrase-identification-on-quora-question-pairsRoBERTa#30Accuracy: 90.2
sentence-completion-on-hellaswagRoBERTa-Large Ensemble#35Accuracy: 85.5
sentence-completion-on-hellaswagRoBERTa-Large 355M#62Accuracy: 81.7
question-answering-on-squad11-devRoBERTa#47F1: 94.6
question-answering-on-piqaRoBERTa-Large 355M#67Accuracy: 79.4