Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention

Benchmark Model Rank Results
natural-language-inference-on-qnliNyströmformer#32Accuracy: 88.7%
semantic-textual-similarity-on-mrpcNyströmformer#34F1: 88.1%
sentiment-analysis-on-imdbNyströmformer#24Accuracy: 93.2
sentiment-analysis-on-sst-2-binaryNyströmformer#49Accuracy: 91.4