AdaPreLoRA: Adafactor Preconditioned Low-Rank Adaptation
Open paper
Benchmark
Model
Rank
Results
arithmetic-reasoning-on-gsm8k
Qwen2-7B + AdaPreLoRA AdamW
–
Accuracy: 76.4
Rank counts only results with a code link.