Pion: A Spectrum-Preserving Optimizer via Orthogonal Equivalence Transformation
Open paper
Benchmark
Model
Rank
Results
code-generation-on-humaneval
Pion (Qwen2.5-1.5B finetuning)
#99
Pass@1: 53.05
arithmetic-reasoning-on-gsm8k
Pion (Qwen2.5-1.5B finetuning)
#207
Accuracy: 65.76
Rank counts only results with a code link.