Initialisation Determines the Basin: Efficient Codebook Optimisation for Extreme LLM Quantization

Benchmark Model Rank Results
language-modelling-on-lambadaOA-EM (Llama 3.2 3B)#28Accuracy: 68.5Perplexity: 4.64
question-answering-on-piqaOA-EM (Llama 3.2 3B)#104Accuracy: 76.2
sentence-completion-on-hellaswagOA-EM (Llama 3.2 3B)#108Accuracy: 70.4