How to Train BERT with an Academic Budget

Benchmark Model Rank Results
linguistic-acceptability-on-cola24hBERT#25Accuracy: 57.1
natural-language-inference-on-multinli24hBERT#27Matched: 84.4Mismatched: 83.8
natural-language-inference-on-qnli24hBERT#27Accuracy: 90.6
natural-language-inference-on-rte24hBERT#70Accuracy: 57.7%
question-answering-on-quora-question-pairs24hBERT#18Accuracy: 70.7
semantic-textual-similarity-on-mrpc24hBERT#20Accuracy: 87.5%
semantic-textual-similarity-on-sts-benchmark24hBERT#21Pearson Correlation: 0.820
sentiment-analysis-on-sst-2-binary24hBERT#41Accuracy: 93.0