GeoPair: Geometry-Preserving Cross-Layer Factorization for Training-Free Transformer Compression

Benchmark Model Rank Results
question-answering-on-piqaGeoPair (Llama3 8B, CR=0.2)–Accuracy: 78.73
reading-comprehension-on-raceGeoPair (Llama3 8B, CR=0.2)–Accuracy: 40.77
sentence-completion-on-hellaswagGeoPair (Llama3 8B, CR=0.2)–Accuracy: 75.38