Normalized Low-Rank Adaptation

Benchmark Model Rank Results
mathematical-reasoning-on-minerva-mathDS-R1-Distill-Qwen1.5B NoRA#34Accuracy: 32
mathematical-reasoning-on-math-500DS-R1-Distill-Qwen1.5B NoRA#75Accuracy: 84.5
mathematical-reasoning-on-aime24DS-R1-Distill-Qwen1.5B NoRA#105Acc: 26.7
code-generation-on-humanevalLlama3.2-3B NoRA#106Pass@1: 42.1
mathematical-reasoning-on-aime-2025DS-R1-Distill-Qwen1.5B NoRA#119Accuracy: 23.5
common-sense-reasoning-on-winograndeMLA342M NoRA-init#158Accuracy: 52.72
question-answering-on-piqaMLA342M NoRA-init#163Accuracy: 63.76
sentence-completion-on-hellaswagMLA342M NoRA-init#209Accuracy: 36.11