A Zeroth-Order Paradigm for LLM Preference Alignment
Open paper
Benchmark
Model
Rank
Results
instruction-following-on-mtbench
Gemma-2-9B-it SimPO + ComPO
–
Score (1-10): 8.79
Rank counts only results with a code link.