GIFT-SW: Gaussian noise Injected Fine-Tuning of Salient Weights for LLMs

Benchmark Model Rank Results
parameter-efficient-fine-tuning-on-boolqLLaMA2-7b#2Accuracy (% ): 82.63
parameter-efficient-fine-tuning-on-hellaswagLLaMA2-7b#1Accuracy (% ): 76.68
parameter-efficient-fine-tuning-on-winograndeLLaMA2-7b#1Accuracy (% ): 70.80