OpenCodePapers

paraphrase-identification-on-mrpc-glue-dev

Semantic Textual SimilarityParaphrase Identification
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeF1ModelNameReleaseDate
GLU Variants Improve Transformer✓ Link92.68FFN GEGLU2020-02-12
MVP: Multi-task Supervised Pre-training for Natural Language Generation✓ Link92.07MVP2022-06-24
MPNet: Masked and Permuted Pre-training for Language Understanding✓ Link91.4MPNet Large2020-04-20
RoBERTa: A Robustly Optimized BERT Pretraining Approach✓ Link90.9RoBERTa2019-07-26
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators✓ Link90.8ELECTRA-1.75M2020-03-23
Larger-Scale Transformers for Multilingual Masked Language Modeling✓ Link90.7XLM-R XXL2021-05-02
Unsupervised Cross-lingual Representation Learning at Scale✓ Link89.5XLM-R2019-11-05
RoFormer: Enhanced Transformer with Rotary Position Embedding✓ Link89.5RoFormer2021-04-20
You Only Sample (Almost) Once: Linear Cost Self-Attention Via Bernoulli Sampling✓ Link88.1YOSO-E2021-11-18
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter✓ Link87.5DistilBERT2019-10-02
FLAVA: A Foundational Language And Vision Alignment Model✓ Link86.9FLAVA2021-12-08
Resource-Efficient Transformer Pruning for Finetuning of Large Models✓ Link86.55RECAP (BERT-base, 50% pruning)2024-06-17