Nyströmformer: A Nyström-Based Algorithm for Approximating Self-Attention

Benchmark Model Rank Results
sentiment-analysis-on-imdbNyströmformer#24Accuracy: 93.2
semantic-textual-similarity-on-mrpcNyströmformer#34F1: 88.1%
natural-language-inference-on-qnliNyströmformer#37Accuracy: 88.7%
sentiment-analysis-on-sst-2-binary-classificationNyströmformer#52Accuracy: 91.4