Reformer: The Efficient Transformer

Benchmark Model Rank Results
d4rl-on-d4rlReformer#7Average Reward: 63.9
image-generation-on-imagenet-64x64Reformer (12 layers)#44Bits per dim: 3.710
image-generation-on-imagenet-64x64Reformer (6 layers)#46Bits per dim: 3.740
language-modelling-on-wikitext-103Reformer 125M#60Test perplexity: 26.0
open-domain-question-answering-on-searchqaLocality-Sensitive Hashing#1EM: 66.0
question-answering-on-natural-questions-longLocality-Sensitive Hashing#2F1: 75.5
question-answering-on-quasart-tLocality-Sensitive Hashing#1EM: 53.2