You can't pick your neighbors, or can you? When and how to rely on retrieval in the $k$NN-LM

Benchmark Model Rank Results
language-modelling-on-wikitext-103kNN-LM w/ Adaptive Coefficient#9Test perplexity: 15.5Validation perplexity: 15.72