POP: Prefill-Only Pruning for Efficient Large Model Inference
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
POP (Llama-3.1-8B-Instruct)
–
Accuracy: 77.26
Rank counts only results with a code link.