Resource-Efficient Transformer Pruning for Finetuning of Large Models

Benchmark Model Rank Results
linguistic-acceptability-on-cola-glue-devRECAP (BERT-base, 50% pruning)#10Matthews Correlation: 57.67
natural-language-inference-on-rte-glue-devRECAP (BERT-base, 50% pruning)#12Accuracy: 65.98
paraphrase-identification-on-mrpc-glue-devRECAP (BERT-base, 50% pruning)#12F1: 86.55
natural-language-inference-on-qnli-glue-devRECAP (BERT-base, 50% pruning)#13Accuracy: 90.74