ReFTA: Breaking the Weight Reconstruction Bottleneck in Tensorized Parameter-Efficient Fine-Tuning

Benchmark Model Rank Results
natural-language-inference-on-rte-glue-devReFTA (RoBERTa-Large)#4Accuracy: 87.1
linguistic-acceptability-on-cola-glue-devReFTA (RoBERTa-Large)#6Matthews Correlation: 68.6
natural-language-inference-on-qnli-glue-devReFTA (RoBERTa-Large)#6Accuracy: 94.8
image-classification-on-cifar-100ReFTA (ViT-Large)#13Percentage correct: 93.26