OpenCodePapers

paraphrase-identification-on-quora-question-pairs

Semantic Textual SimilarityParaphrase Identification
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeF1AccuracyDirect Intrinsic DimensionStructure Aware Intrinsic DimensionDev AccuracyAccuarcyDev F1ModelNameReleaseDate
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization✓ Link90.7ALICE2019-11-08
Entailment as Few-Shot Learner✓ Link89.2RoBERTa-large 355M + Entailment as Few-shot Learner2021-04-29
Charformer: Fast Character Transformers via Gradient-based Subword Tokenization✓ Link88.591.4Charformer-Tall2021-06-23
RealFormer: Transformer Likes Residual Attention✓ Link88.2891.34RealFormer2020-12-21
FNet: Mixing Tokens with Fourier Transforms✓ Link85FNet-Large2021-05-09
Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer✓ Link75.1T5-11B2019-10-23
StructBERT: Incorporating Language Structures into Pre-training for Deep Language Understanding74.490.7StructBERTRoBERTa ensemble2019-08-13
XLNet: Generalized Autoregressive Pretraining for Language Understanding✓ Link74.290.3XLNet-Large (ensemble)2019-06-19
Adversarial Self-Attention for Language Understanding✓ Link73.7ASA + RoBERTa2022-06-25
Training Complex Models with Multi-Task Weak Supervision✓ Link73.189.9Snorkel MeTaL(ensemble)2018-10-05
Multi-Task Deep Neural Networks for Natural Language Understanding✓ Link72.489.6MT-DNN2019-01-31
Adversarial Self-Attention for Language Understanding✓ Link72.3ASA + BERT-base2022-06-25
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding✓ Link72.1BERT-LARGE2018-10-11
SpanBERT: Improving Pre-training by Representing and Predicting Spans✓ Link71.989.5SpanBERT2019-07-24
TinyBERT: Distilling BERT for Natural Language Understanding✓ Link71.3TinyBERT2019-09-23
ERNIE: Enhanced Language Representation with Informative Entities✓ Link71.2ERNIE2019-05-17
data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Language✓ Link92.4data2vec2022-02-07
What Do Questions Exactly Ask? MFAE: Duplicate Question Identification with Multi-Fusion Asking Emphasis✓ Link90.54MFAE2020-05-07
Simple and Effective Text Matching with Richer Alignment Features✓ Link89.2RE22019-08-01
Multiway Attention Networks for Modeling Sentence Pairs✓ Link89.12MwAN 2018-07-01
Natural Language Inference over Interaction Space✓ Link89.06DIIN2017-09-13
Multi-task Sentence Encoding Model for Semantic Retrieval in Question Answering Systems88.86MSEM2019-11-18
Cell-aware Stacked LSTMs for Modeling Sentences88.6Bi-CAS-LSTM2018-09-07
Neural Paraphrase Identification of Questions with Noisy Pretraining88.40pt-DecAtt2017-04-15
TRANS-BLSTM: Transformer with Bidirectional LSTM for Language Understanding88.28TRANS-BLSTM2020-03-16
Bilateral Multi-Perspective Matching for Natural Language Sentences✓ Link88.17BiMPM2017-02-13
Learning General Purpose Distributed Sentence Representations via Large Scale Multi-task Learning✓ Link87.01GenSen2018-03-30
Self-Explaining Structures Improve NLP Models✓ Link801-3[0.8pt/2pt] Random2020-12-03
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization✓ Link74.892.6FreeLB2019-11-08
Intrinsic Dimensionality Explains the Effectiveness of Language Model Fine-Tuning✓ Link92958030BERT-Base2020-12-22
SMART: Robust and Efficient Fine-Tuning for Pre-trained Natural Language Models through Principled Regularized Optimization✓ Link91.588.5SMART-BERT2019-11-08
SplitEE: Early Exit in Deep Neural Networks with Split Computing✓ Link71.1SplitEE-S2023-09-17
MobileBERT: a Compact Task-Agnostic BERT for Resource-Limited Devices✓ Link70.5MobileBERT w/o OPT2020-04-06
Improving Language Understanding by Generative Pre-Training✓ Link70.3GPT-12018-06-11
RoBERTa: A Robustly Optimized BERT Pretraining Approach✓ Link90.2RoBERTa2019-07-26
ALBERT: A Lite BERT for Self-supervised Learning of Language Representations✓ Link90.5ALBERT2019-09-26
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators✓ Link90.8ELECTRA-1.75M2020-03-23
Funnel-Transformer: Filtering out Sequential Redundancy for Efficient Language Processing✓ Link90.7Funnel-Transformer Large2020-06-05
MPNet: Masked and Permuted Pre-training for Language Understanding✓ Link89.9MPNet Base2020-04-20