How Lossless Is Lossless Speculative Decoding? The Role of Numerical Precision in Orthrus
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
Orthrus-1.7B-final
–
Accuracy: 41.47
Rank counts only results with a code link.