Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models

Benchmark Model Rank Results
language-modelling-on-lambadaB frozen table, float–Accuracy: 23.2
multiple-choice-question-answering-mcqa-on-arc-eA learned table, float–Accuracy: 45.9
question-answering-on-piqaB frozen table, float–Accuracy: 61.5