Value-Aware Stochastic KV Cache Eviction for Reasoning Models

Benchmark Model Rank Results
math-word-problem-solving-on-mathVaSE-DKV (Qwen3-14B)#6Accuracy: 86.47
math-word-problem-solving-on-mathVaSE-DKV (Qwen3-4B)#9Accuracy: 84.72
mathematical-reasoning-on-hmmt-feb-2025VaSE-AttnV (Qwen3-14B)#13Accuracy: 50.0
mathematical-reasoning-on-hmmt-feb-2025VaSE-AttnV (Qwen3-4B)#17Accuracy: 44.38
mathematical-reasoning-on-aime-2026VaSE-AttnV (Qwen3-14B)#38Accuracy: 72.29
multiple-choice-question-answering-mcqa-on-gpqa-diamondVaSE-AttnV (Qwen3-14B)#101Accuracy: 57.39