KV4-RL: Unlocking Faster Asynchronous Rollouts for RLVR with INT4 KV Cache Quantization

Benchmark Model Rank Results
mathematical-reasoning-on-aime-2025KV4-RL (Qwen3-8B-Base)–Accuracy: 22.1
mathematical-reasoning-on-aime24KV4-RL (Qwen3-8B-Base)–Acc: 29.7
mathematical-reasoning-on-amc23KV4-RL (Qwen3-8B-Base)–Acc: 68.9
mathematical-reasoning-on-math-500KV4-RL (Qwen3-8B-Base)–Accuracy: 87.7
mathematical-reasoning-on-minerva-mathKV4-RL (Qwen3-8B-Base)–Accuracy: 51.8
mathematical-reasoning-on-olympiadbenchKV4-RL (Qwen3-8B-Base)–Accuracy: 56.8