Seq-U-Net: A One-Dimensional Causal U-Net for Efficient Sequence Modelling

Benchmark Model Rank Results
music-modeling-on-jsb-choralesTCN#8NLL: 8.154Parameters: 534K
music-modeling-on-jsb-choralesSeq-U-Net#9NLL: 8.173Parameters: 522K
language-modelling-on-penn-treebank-character-levelSeq-U-Net#15Bit per Character (BPC): 1.3Number of params: 5.9M
language-modelling-on-penn-treebank-character-levelTCN#18Bit per Character (BPC): 1.31Number of params: 5.9M
language-modelling-on-penn-treebank-word-levelSeq-U-Net#41Test perplexity: 107.95Params: 14.9M
language-modelling-on-penn-treebank-word-levelTCN#42Test perplexity: 108.47Params: 14.7M