Seq-U-Net: A One-Dimensional Causal U-Net for Efficient Sequence Modelling

Benchmark Model Rank Results
language-modelling-on-penn-treebank-characterSeq-U-Net#15Bit per Character (BPC): 1.3Number of params: 5.9M
language-modelling-on-penn-treebank-characterTCN#18Bit per Character (BPC): 1.31Number of params: 5.9M
language-modelling-on-penn-treebank-wordSeq-U-Net#41Test perplexity: 107.95Params: 14.9M
language-modelling-on-penn-treebank-wordTCN#42Test perplexity: 108.47Params: 14.7M
music-modeling-on-jsb-choralesTCN#8NLL: 8.154Parameters: 534K
music-modeling-on-jsb-choralesSeq-U-Net#9NLL: 8.173Parameters: 522K