Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing

Benchmark Model Rank Results
natural-language-inference-on-wnliFunnel-Transformer Large#2Accuracy: 94.5
natural-language-understanding-on-glue-testFunnel-Transformer Large#2GLUE (test): 89.7
sentiment-analysis-on-sst-2-binary-classificationFunnel-Transformer Large#3Accuracy: 97.5
question-answering-on-squad20-devFunnel-Transformer Large#4F1: 90.4
reading-comprehension-on-raceB10-10-10#8Accuracy: 85.7Accuracy (Middle): 88.8Accuracy (High): 84.4
natural-language-inference-on-qnliFunnel-Transformer Large#9Accuracy: 95.8%
linguistic-acceptability-on-colaFunnel-Transformer Large#10Accuracy: 70.5%
natural-language-inference-on-rteFunnel-Transformer Large#14Accuracy: 90.0%
paraphrase-identification-on-quora-question-pairsFunnel-Transformer Large#33Accuracy: 90.7
semantic-textual-similarity-on-mrpcFunnel-Transformer Large#35F1: 93.4
question-answering-on-squad11-devFunnel-Transformer Large#51F1: 94.7