| document-summarization-on-cnn-daily-mail | BigBird-Pegasus | #8 | ROUGE-1: 43.84ROUGE-2: 21.11ROUGE-L: 40.74 |
| linguistic-acceptability-on-cola | BigBird | #24 | Accuracy: 58.5% |
| natural-language-inference-on-multinli | BigBird | #17 | Matched: 87.5 |
| natural-language-inference-on-qnli | BigBird | #21 | Accuracy: 92.2% |
| natural-language-inference-on-rte | BigBird | #38 | Accuracy: 75.0% |
| question-answering-on-hotpotqa | BigBird-etc | #2 | JOINT-F1: 0.736ANS-F1: 0.755SUP-F1: 0.891 |
| question-answering-on-quora-question-pairs | BigBird | #14 | Accuracy: 88.6% |
| question-answering-on-triviaqa | BigBird-etc | #30 | F1: 80.9 |
| question-answering-on-wikihop | BigBird-etc | #1 | Test: 82.3 |
| semantic-textual-similarity-on-mrpc | BigBird | #31 | F1: 91.5 |
| semantic-textual-similarity-on-sts-benchmark | BigBird | #33 | Spearman Correlation: .878 |
| sentiment-analysis-on-sst-2-binary | BigBird | #31 | Accuracy: 94.6 |
| text-classification-on-yelp-5 | BigBird | #3 | Accuracy: 72.16% |
| text-summarization-on-pubmed-1 | BigBird-Pegasus | #11 | ROUGE-1: 46.32ROUGE-2: 20.65ROUGE-L: 42.33 |