OpenCodePapers

question-answering-on-quora-question-pairs

Question Answering
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeAccuracyModelNameReleaseDate
XLNet: Generalized Autoregressive Pretraining for Language Understanding✓ Link92.3%XLNet (single model)2019-06-19
DeBERTa: Decoding-enhanced BERT with Disentangled Attention✓ Link92.3%DeBERTa (large)2020-06-05
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations✓ Link90.5%ALBERT2019-09-26
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link90.4%T5-11B2019-10-23
CLEAR: Contrastive Learning for Sentence Representation90.3%MLM+ subs+ del-span2020-12-31
RoBERTa: A Robustly Optimized BERT Pretraining Approach✓ Link90.2%RoBERTa (ensemble)2019-07-26
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding✓ Link90.1%ERNIE 2.0 Large2019-07-29
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators✓ Link90.1%ELECTRA2020-03-23
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link89.9%T5-Large 770M2019-10-23
ERNIE 2.0: A Continual Pre-training Framework for Language Understanding✓ Link89.8%ERNIE 2.0 Base2019-07-29
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link89.7%T5-3B2019-10-23
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link89.4%T5-Base2019-10-23
Simple and Effective Text Matching with Richer Alignment Features✓ Link89.2 %RE22019-08-01
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter✓ Link89.2%DistilBERT 66M2019-10-02
Big Bird: Transformers for Longer Sequences✓ Link88.6%BigBird2020-07-28
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link88.0%T5-Small2019-10-23
Baseline Needs More Love: On Simple Word-Embedding-Based Models and Associated Pooling Mechanisms✓ Link83.03%SWEM-concat2018-05-24
SqueezeBERT: What can computer vision teach NLP about efficient neural networks?✓ Link80.3%SqueezeBERT2020-06-19
How to Train BERT with an Academic Budget✓ Link70.724hBERT2021-04-15
Check out how to contribute new results.