WhiteMatter: All-to-All Cross-Layer Connections via KV Source Mixing

Benchmark Model Rank Results
multiple-choice-question-answering-mcqa-on-arc-eWhiteMatter k=16#23Accuracy: 46.21
multiple-choice-question-answering-mcqa-on-arc-cWhiteMatter k=16#30Accuracy: 25.43
language-modelling-on-lambadaWhiteMatter k=16#80Perplexity: 60.73
question-answering-on-boolqWhiteMatter k=16#94Accuracy: 61.04
common-sense-reasoning-on-winograndeWhiteMatter k=16#164Accuracy: 51.38
question-answering-on-piqaWhiteMatter k=16#164Accuracy: 63.55
sentence-completion-on-hellaswagWhiteMatter k=16#212Accuracy: 33.8