OpenCodePapers

table-claim-verification-on-scitab

Table-based Fact Verification
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeMacro-F1 (3-class)ModelNameReleaseDate
A Multi-Agent Approach for Claim Verification from Tabular Data Documents0.7300Qwen-235B + CoT (baseline)2026-04-19
A Multi-Agent Approach for Claim Verification from Tabular Data Documents0.7100MACE (Qwen-235B, Pm + Em + Vm)2026-04-19
A Multi-Agent Approach for Claim Verification from Tabular Data Documents0.6700MACE (Qwen-72B, Pm + Em + Vm)2026-04-19
A Multi-Agent Approach for Claim Verification from Tabular Data Documents0.6500MACE (LLaMA-8B, Pm + Em + Vm)2026-04-19
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.6480GPT-4 (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.6321GPT-4 (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.6277GPT-4 + CoT (3-shot in-context)2023-05-22
A Multi-Agent Approach for Claim Verification from Tabular Data Documents0.5800MACE (Mistral-7B, Pm + Em + Vm)2026-04-19
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.4520TabV4FC (Qwen 2.5 - 72B)2026-03-19
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link0.4500ProTrix2024-03-04
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.4260InstructGPT + CoT (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.4158InstructGPT (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.4141InstructGPT (zero-shot)2023-05-22
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link0.4120ProTrix-Coder2024-03-04
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3805Flan-T5-XL (zero-shot)2023-05-22
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.3743TabV4FC (Qwen 2.5 - 14B)2026-03-19
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3718LLaMA-13B (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3516Vicuna-13B (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3491Flan-T5-XXL (zero-shot)2023-05-22
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.3449TabV4FC (LLaMA 3.3 - 70B)2026-03-19
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3430TAPEX-Zero-XL (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3426Vicuna-7B (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3404Flan-T5-XXL (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3266LLaMA-13B (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3255Flan-T5-large (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3247Vicuna-7B (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.3226LLaMA-7B (zero-shot)2023-05-22
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.3223TabV4FC (DeepSeekR1-Qwen 32B)2026-03-19
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2972TAPEX-Zero-large (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2963Vicuna-13B (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2921Flan-T5-XL (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2895Alpaca-7B (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2759Alpaca-7B (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2730Flan-T5-large (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2717LLaMA-7B (3-shot in-context)2023-05-22
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.2698TabV4FC (DeepSeekR1-LLaMA 70B)2026-03-19
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2656Flan-T5-base (zero-shot)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2562TAPEX-Zero-XL (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2409Flan-T5-base (3-shot in-context)2023-05-22
SCITAB: A Challenging Benchmark for Compositional Reasoning and Claim Verification on Scientific Tables0.2347TAPEX-Zero-large (3-shot in-context)2023-05-22
GLEAN: Grounded Lightweight Evaluation Anchors for Contamination-Aware Tabular Reasoning0.1970DeBERTa-v3 (GLEAN protocol)2026-01-22
Boosting large-language models for fact-checking: leveraging verbalized tabular data as evidence✓ Link0.1739TabV4FC (Qwen 2.5 - 32B)2026-03-19