Deeper is Not Always Better: Mitigating the Alignment Tax via Confident Layer Decoding

Benchmark Model Rank Results
mathematical-reasoning-on-omni-mathConfident Decoding (Qwen3.5-122B-A10B)#1Accuracy: 78.5
question-answering-on-humanity-s-last-exam-hleConfident Decoding (Qwen3.5-27B)#34Accuracy: 16.8
multiple-choice-question-answering-mcqa-on-gpqa-diamondQwen3.5-35B-A3B + Confident Decoding#48Accuracy: 82.8