Reformer: The Efficient Transformer

Benchmark Model Rank Results
open-domain-question-answering-on-searchqaLocality-Sensitive Hashing#1EM: 66.0
question-answering-on-quasart-tLocality-Sensitive Hashing#1EM: 53.2
question-answering-on-natural-questions-longLocality-Sensitive Hashing#2F1: 75.5
d4rl-on-d4rlReformer#7Average Reward: 63.9
image-generation-on-imagenet-64x64Reformer (12 layers)#47Bits per dim: 3.710
image-generation-on-imagenet-64x64Reformer (6 layers)#49Bits per dim: 3.740
language-modelling-on-wikitext-103Reformer 125M#64Test perplexity: 26.0