Q8BERT: Quantized 8Bit BERT

Benchmark Model Rank Results
linguistic-acceptability-on-colaQ8BERT (Zafrir et al., 2019)#17Accuracy: 65.0
natural-language-inference-on-multinliQ8BERT (Zafrir et al., 2019)#24Matched: 85.6
natural-language-inference-on-qnliQ8BERT (Zafrir et al., 2019)#18Accuracy: 93.0
natural-language-inference-on-rteQ8BERT (Zafrir et al., 2019)#23Accuracy: 84.8
semantic-textual-similarity-on-mrpcQ8BERT (Zafrir et al., 2019)#13Accuracy: 89.7
semantic-textual-similarity-on-sts-benchmarkQ8BERT (Zafrir et al., 2019)#10Pearson Correlation: 0.911
sentiment-analysis-on-sst-2-binaryQ8BERT (Zafrir et al., 2019)#30Accuracy: 94.7