Recover-LoRA: Data-Free Accuracy Recovery of Degraded Language Models via Low-Rank Adaptation

Benchmark Model Rank Results
question-answering-on-boolqAMD OLMo SFT 1B + Recover-LoRA#88Accuracy: 62.17
question-answering-on-piqaDeepSeek-R1-Distill-Qwen-1.5B + Recover-LoRA#177Accuracy: 54.79
sentence-completion-on-hellaswagDeepSeek-R1-Distill-Qwen-1.5B + Recover-LoRA#220Accuracy: 26.52