Swift-SVD: Theoretical Optimality Meets Practical Efficiency in Low-Rank LLM Compression

Benchmark Model Rank Results
common-sense-reasoning-on-arc-easyLLaMA-7B with Swift-SVD* (dynamic)#75Accuracy: 65.0
question-answering-on-piqaLLaMA-7B with Swift-SVD* (dynamic)#131Accuracy: 73.0
sentence-completion-on-hellaswagLLaMA-7B with Swift-SVD* (dynamic)#187Accuracy: 48.0