Paper | Code | Accuracy (% ) | ModelName | ReleaseDate |
---|---|---|---|---|
QLoRA: Efficient Finetuning of Quantized LLMs | ✓ Link | 82.63 | LLaMA2-7b | 2023-05-23 |
GIFT-SW: Gaussian noise Injected Fine-Tuning of Salient Weights for LLMs | ✓ Link | 82.63 | LLaMA2-7b | 2024-08-27 |
DoRA: Weight-Decomposed Low-Rank Adaptation | ✓ Link | 81.93 | LLaMA2-7b | 2024-02-14 |
LoRA: Low-Rank Adaptation of Large Language Models | ✓ Link | 80.28 | LLaMA2-7b | 2021-06-17 |