OpenCodePapers
linguistic-acceptability-on-cola-glue-dev
Natural Language Understanding
Linguistic Acceptability
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Show papers without code
Paper
Code
Matthews Correlation
↕
ModelName
ReleaseDate
↕
DeBERTa: Decoding-enhanced BERT with Disentangled Attention
✓ Link
70.5
DeBERTa Large
2020-06-05
ELECTRA: Pre-training Text Encoders as Discriminators Rather Than Generators
✓ Link
69.1
ELECTRA-1.75M
2020-03-23
MPNet: Masked and Permuted Pre-training for Language Understanding
✓ Link
69.1
MPNet Large
2020-04-20
I-BERT: Integer-only BERT Quantization
✓ Link
69.0
I-BERT RoBERTa-Large
2021-01-05
ERNIE-Gram: Pre-Training with Explicitly N-Gram Masked Language Modeling for Natural Language Understanding
✓ Link
68.6
ERNIE-Gram
2020-10-23
ReFTA: Breaking the Weight Reconstruction Bottleneck in Tensorized Parameter-Efficient Fine-Tuning
✓ Link
68.6
ReFTA (RoBERTa-Large)
2026-06-03
RoBERTa: A Robustly Optimized BERT Pretraining Approach
✓ Link
68.0
RoBERTa
2019-07-26
Model soups: averaging weights of multiple fine-tuned models improves accuracy without increasing inference time
✓ Link
63.1
BERT-large (Greedy soup)
2022-03-10
MVP: Multi-task Supervised Pre-training for Natural Language Generation
✓ Link
59.87
MVP
2022-06-24
Resource-Efficient Transformer Pruning for Finetuning of Large Models
✓ Link
57.67
RECAP (BERT-base, 50% pruning)
2024-06-17
GLU Variants Improve Transformer
✓ Link
56.16
FFN ReGLU
2020-02-12
DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lighter
✓ Link
51.3
DistilBERT
2019-10-02
FLAVA: A Foundational Language And Vision Alignment Model
✓ Link
50.7
FLAVA
2021-12-08
×