Sheared Backpropagation for Fine-tuning Foundation Models

Benchmark Model Rank Results
image-classification-on-cifar-10PREBR++JS@70%–Percentage correct: 98.8
image-classification-on-cifar-100PREBR++JS@70%–Percentage correct: 92.4
natural-language-inference-on-rte-glue-devPREBR@80% (batch size 8)–Accuracy: 72.92