Larger-Scale Transformers for Multilingual Masked Language Modeling

Benchmark Model Rank Results
natural-language-inference-on-multinli-devXLM-R XXL#4Matched: 90.9
natural-language-inference-on-qnli-glue-devXLM-R XXL#4Accuracy: 95.0
cross-lingual-question-answering-on-xquadXLM-R XXL#5Average F1: 81.1
paraphrase-identification-on-mrpc-glue-devXLM-R XXL#6F1: 90.7
sentiment-analysis-on-sst-2-binary-classificationXLM-R XXL#91Dev Accuracy: 96.7