Test-Time Training on Nearest Neighbors for Large Language Models
Open paper
Benchmark
Model
Rank
Results
language-modelling-on-the-pile
GPT-2 Large 774M (test-time training on nearest neighbors)
#20
Bits per byte: 0.85
Rank counts only results with a code link.