Adversarial Self-Attention for Language Understanding

Benchmark Model Rank Results
machine-reading-comprehension-on-dreamASA + RoBERTa#1Accuracy: 69.2
machine-reading-comprehension-on-dreamASA + BERT-base#3Accuracy: 64.3
named-entity-recognition-on-wnut-2017ASA + RoBERTa#8F1: 57.3
named-entity-recognition-on-wnut-2017ASA + BERT-base#15F1: 49.8
natural-language-inference-on-multinliASA + RoBERTa#14Matched: 88
natural-language-inference-on-multinliASA + BERT-base#25Matched: 85
natural-language-inference-on-qnliASA + RoBERTa#17Accuracy: 93.6%
natural-language-inference-on-qnliASA + BERT-base#23Accuracy: 91.4%
paraphrase-identification-on-quora-questionASA + RoBERTa#7F1: 73.7
paraphrase-identification-on-quora-questionASA + BERT-base#10F1: 72.3
semantic-textual-similarity-on-sts-benchmarkASA + RoBERTa#25Spearman Correlation: 0.892
semantic-textual-similarity-on-sts-benchmarkASA + BERT-base#38Spearman Correlation: 0.865
sentiment-analysis-on-sst-2-binaryASA + RoBERTa#17Accuracy: 96.3
sentiment-analysis-on-sst-2-binaryASA + BERT-base#32Accuracy: 94.1