Q-BERT: Hessian Based Ultra Low Precision Quantization of BERT

Benchmark Model Rank Results
linguistic-acceptability-on-colaQ-BERT (Shen et al., 2020)Accuracy: 65.1
natural-language-inference-on-multinliQ-BERT (Shen et al., 2020)Matched: 87.8
natural-language-inference-on-qnliQ-BERT (Shen et al., 2020)Accuracy: 93.0
natural-language-inference-on-rteQ-BERT (Shen et al., 2020)Accuracy: 84.7
semantic-textual-similarity-on-mrpcQ-BERT (Shen et al., 2020)Accuracy: 88.2
semantic-textual-similarity-on-sts-benchmarkQ-BERT (Shen et al., 2020)Pearson Correlation: 0.911
sentiment-analysis-on-sst-2-binaryQ-BERT (Shen et al., 2020)Accuracy: 94.8