Skip-gram Language Modeling Using Sparse Non-negative Matrix Probability Estimation
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-one-billion-word
Sparse Non-Negative
–
PPL: 52.9
Number of params: 33B
Rank counts only results with a code link.