Distilling Task-Specific Knowledge from BERT into Simple Neural Networks
Open paper
Benchmark
Model
Rank
Results
sentiment-analysis-on-sst-2-binary-classification
Single layer bilstm distilled from BERT
#54
Accuracy: 90.7
Rank counts only results with a code link.