A Simple Way to Initialize Recurrent Networks of Rectified Linear Units

Benchmark Model Rank Results
sequential-image-classification-on-sequentialiRNN#27Permuted Accuracy: 82%Unpermuted Accuracy: 97%