Learning Longer-term Dependencies in RNNs with Auxiliary Losses

Benchmark Model Rank Results
sequential-image-classification-on-sequential-cifar-10Transformer (self-attention) (Trinh et al., 2018)#13Unpermuted Accuracy: 62.2%