Long Range Arena: A Benchmark for Efficient Transformers

Benchmark Model Rank Results
long-range-modeling-on-lraTransformer#4Avg: 54.39Image: 42.44ListOps: 36.37Pathfinder: 71.4Text: 64.27
long-range-modeling-on-lraPerformer#5Avg: 51.41Image: 42.77ListOps: 18.01Pathfinder: 77.05Text: 65.4
long-range-modeling-on-lraSparse Trans.#6Avg: 51.24Image: 44.24ListOps: 17.07Pathfinder: 71.71
long-range-modeling-on-lraLinear Trans.#7Avg: 50.55Image: 42.34ListOps: 16.13Pathfinder: 75.3Text: 65.9