ALBERT: A Lite BERT for Self-supervised Learning of Language Representations

Benchmark Model Rank Results
common-sense-reasoning-on-commonsenseqaAlbert Lan et al. (2020) (ensemble)#11Accuracy: 76.5
linguistic-acceptability-on-colaALBERT#9Accuracy: 69.1%
multimodal-intent-recognition-on-photochatALBERT-base#6F1: 52.2Precision: 44.8Recall: 62.7
natural-language-inference-on-multinliALBERT#4Matched: 91.3
natural-language-inference-on-qnliALBERT#1Accuracy: 99.2%
natural-language-inference-on-rteALBERT#14Accuracy: 89.2%
natural-language-inference-on-wnliALBERT#4Accuracy: 91.8
question-answering-on-multitqALBERT#6Hits@1: 10.8Hits@10: 45.9
question-answering-on-quora-question-pairsALBERT#3Accuracy: 90.5%
question-answering-on-squad20ALBERT (ensemble model)#3EM: 89.731F1: 92.215
question-answering-on-squad20ALBERT (single model)#7EM: 88.107F1: 90.902
question-answering-on-squad20-devALBERT xxlarge#4F1: 88.1EM: 85.1
question-answering-on-squad20-devALBERT xlarge#7F1: 85.9EM: 83.1
question-answering-on-squad20-devALBERT large#9F1: 82.1EM: 79.0
question-answering-on-squad20-devALBERT base#10F1: 79.1EM: 76.1
semantic-textual-similarity-on-mrpcALBERT#2Accuracy: 93.4%
semantic-textual-similarity-on-sts-benchmarkALBERT#3Pearson Correlation: 0.925
sentiment-analysis-on-sst-2-binaryALBERT#5Accuracy: 97.1