OpenCodePapers

reading-comprehension-on-reclor

Reading Comprehension
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeTestModelNameReleaseDate
IDOL: Indicator-oriented Logic Pre-training for Logical Reasoning✓ Link80.6Rational Reasoner / IDOL2023-06-27
80.0AMR-LE-Ensemble
MERIt: Meta-Path Guided Contrastive Learning for Logical Reasoning✓ Link79.3MERIt(MERIt-deberta-v2-xxlarge )2022-03-01
79.3MERIt-deberta-v2-xxlarge deberta.v2.xxlarge.path.override_True.norm_1.1.0.w2.A100.cp200.s42
79.2Knowledge model
77.2DeBERTa-v2-xxlarge-AMR-LE-Contraposition
Logic-Driven Context Extension and Data Augmentation for Logical Reasoning of Text✓ Link76.1LReasoner ensemble2021-05-08
Answer Uncertainty and Unanswerability in Multiple-Choice Machine Reading Comprehension71.0ELECTRA and ALBERT
69.7WWZ
69.3xlnet-large-uncased [extended data]
68.6albert_4gpus_bs2_DACE
66.7Tournament2
65.6MERIt + Structure Decouple (roberta-large)
Logiformer: A Two-Branch Graph Transformer Network for Interpretable Logical Reasoning✓ Link63.5RoBERTa-single2022-05-02
63.2MERIT w/ reasoning aware
62.6ALBERT-XXLarge-V2
61.7VDGN(RoBERTa single model)
61.7ro_DA_CE_v100_224
60.3qmcurtis
60.2AdaLoGN
60.2Zhangjie666
59.2alsace
Fact-driven Logical Reasoning for Machine Reading Comprehension✓ Link58.9RoBERTa-single2021-05-21
DAGN: Discourse-Aware Graph Network for Logical Reasoning✓ Link58.2NAACL 20212021-03-26
57.7Roberta Large GCN(dev: 0.63)
57.7xlnet_l
57.3elBERto
56.95BitClan
56.0SimChea
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning✓ Link56.0XLNet-large2020-02-11
55.6RoBERTa-large
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning✓ Link50.4XLNet-base2020-02-11
50.3BERT-large+MNLI
49.8BERT-large
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning✓ Link48.5RoBERTa-base2020-02-11
ReClor: A Reading Comprehension Dataset Requiring Logical Reasoning✓ Link47.3BERT-base2020-02-11
40.5Gariscat
26.0BachTE
25.3TwistedFate