NGM: A Plug-and-Play Training-Free Memory Module for LLMs

Benchmark Model Rank Results
instruction-following-on-ifevalQwen3-14B + NGM#13Prompt-level strict-accuracy: 83.92
code-generation-on-livecodebench-v5Qwen3-14B + NGM#19Pass@1: 29.94
vision-language-understanding-on-mmbench-v1-1Qwen3-VL-2B + NGM#23Accuracy: 76.63
code-generation-on-humanevalQwen3-14B + NGM#34Pass@1: 88.41
optical-character-recognition-ocr-on-ocrbenchQwen3-VL-2B + NGM#43Score: 829
arithmetic-reasoning-on-gsm8kQwen3-14B + NGM#57Accuracy: 91.74
mathematical-reasoning-on-math-500Qwen3-14B + NGM#64Accuracy: 87.0
vision-language-understanding-on-mmstarQwen3-VL-2B + NGM#87Accuracy: 56.2
multiple-choice-question-answering-mcqa-on-gpqa-diamondQwen3-14B + NGM#111Accuracy: 52.02