River-LLM: Large Language Model Seamless Exit Based on KV Share

Benchmark Model Rank Results
arithmetic-reasoning-on-gsm8kRiver-LLM (Llama3.1 8B, τ=0.7)–Accuracy: 75.6
common-sense-reasoning-on-arc-easyRiver-LLM (Llama3.1 8B, τ=0.5)–Accuracy: 82.0
math-word-problem-solving-on-mathRiver-LLM (Llama3.1 8B, τ=0.5)–Accuracy: 26.6
question-answering-on-boolqRiver-LLM (Llama3.1 8B, τ=0.5)–Accuracy: 83.4
sentence-completion-on-hellaswagRiver-LLM (Llama3.1 8B, τ=0.7)–Accuracy: 58.6