How to Train BERT with an Academic Budget

Benchmark Model Rank Results
question-answering-on-quora-question-pairs24hBERT#18Accuracy: 70.7
semantic-textual-similarity-on-mrpc24hBERT#20Accuracy: 87.5%
semantic-textual-similarity-on-sts-benchmark24hBERT#21Pearson Correlation: 0.820
linguistic-acceptability-on-cola24hBERT#28Accuracy: 57.1
natural-language-inference-on-multinli24hBERT#28Matched: 84.4Mismatched: 83.8
natural-language-inference-on-qnli24hBERT#32Accuracy: 90.6
sentiment-analysis-on-sst-2-binary-classification24hBERT#43Accuracy: 93.0
natural-language-inference-on-rte24hBERT#74Accuracy: 57.7%