MeKi: Memory-based Expert Knowledge Injection for Efficient LLM Scaling

Benchmark Model Rank Results
zero-shot-question-answering-on-sciqMeKi (4B)#7Accuracy: 87.2
language-modelling-on-lambadaMeKi (4B)#46Accuracy: 50.1
question-answering-on-boolqMeKi (4B)#79Accuracy: 64.4
common-sense-reasoning-on-arc-easyMeKi (4B)#91Accuracy: 42.2
common-sense-reasoning-on-winograndeMeKi (4B)#107Accuracy: 61.6
question-answering-on-piqaMeKi (4B)#111Accuracy: 75.4
sentence-completion-on-hellaswagMeKi (4B)#140Accuracy: 62.3