OpenCodePapers

semantic-parsing-on-wikitablequestions

Semantic Parsing
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeAccuracy (Test)Accuracy (Dev)AccuracyTest AccuracyModelNameReleaseDate
ARTEMIS-DA: An Advanced Reasoning and Transformation Engine for Multi-Step Insight Synthesis in Data Analytics80.8ARTEMIS-DA2024-12-18
Accurate and Regret-aware Numerical Problem Solver for Tabular Question Answering✓ Link76.6/TabLaP2024-10-10
SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQA✓ Link74.465.2SynTQA (GPT)2024-09-25
Rethinking Tabular Data Understanding with Large Language Models✓ Link73.6/Mix SC2023-12-27
SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQA✓ Link71.6/SynTQA (RF)2024-09-25
CABINET: Content Relevance based Noise Reduction for Table Question Answering✓ Link69.1/CABINET2024-02-02
NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization✓ Link68.63NormTab+TabSQLify2024-06-25
Chain-of-Table: Evolving Tables in the Reasoning Chain for Table Understanding✓ Link67.31/Chain-of-Table2024-01-09
Efficient Prompting for LLM-based Generative Internet of Things66.78/Tab-PoT2024-06-14
Large Language Models are Versatile Decomposers: Decompose Evidence and Questions for Table-based Reasoning✓ Link65.964.8Dater2023-01-31
LEVER: Learning to Verify Language-to-Code Generation with Execution✓ Link65.864.6LEVER2023-02-16
TabSQLify: Enhancing Reasoning Capabilities of LLMs Through Table Decomposition✓ Link64.7TabSQLify (col+row)2024-04-15
Binding Language Models in Symbolic Languages✓ Link64.665.0Binder2022-10-06
OmniTab: Pretraining with Natural and Synthetic Data for Few-shot Table-based Question Answering✓ Link63.362.5OmniTab-Large2022-07-08
NormTab: Improving Symbolic Reasoning in LLMs Through Tabular Data Normalization✓ Link61.20NormTab (Targeted) + SQL2024-06-25
ReasTAP: Injecting Table Reasoning Skills During Pre-training via Synthetic Reasoning Examples✓ Link58.759.7ReasTAP-Large2022-10-22
TAPEX: Table Pre-training via Learning a Neural SQL Executor✓ Link57.557.0TAPEX-Large2021-07-16
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data✓ Link51.852.2MAPO + TABERTLarge (K = 3)2020-05-17
UnifiedSKG: Unifying and Multi-Tasking Structured Knowledge Grounding with Text-to-Text Language Models✓ Link49.2950.65T5-3b(UnifiedSKG)2022-01-16
TAPAS: Weakly Supervised Table Parsing via Pre-training✓ Link48.8/TAPAS-Large (pre-trained on SQA)2020-04-05
Learning Semantic Parsers from Denotations with Latent Structured Alignments and Abstract Programs✓ Link44.543.7Structured Attention2019-09-09
SynTQA: Synergistic Table-based Question Answering via Mixture of Text-to-SQL and E2E TQA✓ Link77.5SynTQA (Oracle)2024-09-25