OpenCodePapers

text-to-sql-on-spider

Text-To-SQL
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeExecution Accuracy (Test)Exact Match Accuracy (Test)Execution Accuracy (Dev)Exact Match Accuracy (Dev)ModelNameReleaseDate
A Preview of XiYan-SQL: A Multi-Generator Ensemble Framework for Text-to-SQL✓ Link89.65XiYan-SQL2024-11-13
PET-SQL: A Prompt-Enhanced Two-Round Refinement of Text-to-SQL with Cross-consistency✓ Link87.666.6PET-SQL2024-03-13
Text-to-SQL Empowered by Large Language Models: A Benchmark Evaluation✓ Link86.684.474.4DAIL-SQL + GPT-4 + Self-Consistency2023-08-29
DIN-SQL: Decomposed In-Context Learning of Text-to-SQL with Self-Correction✓ Link85.360DIN-SQL + GPT-42023-04-21
MSc-SQL: Multi-Sample Critiquing Small Language Models For Text-To-SQL Translation✓ Link84.7MSc-SQL2024-10-16
Learning Metadata-Agnostic Representations for Text-to-SQL In-Context Example Selection84.083.6MARLO + Claude 2.12024-10-17
C3: Zero-shot Text-to-SQL with ChatGPT✓ Link82.381.8C3 + ChatGPT + Zero-Shot2023-07-14
RESDSQL: Decoupling Schema Linking and Skeleton Parsing for Text-to-SQL✓ Link79.972.084.180.5RESDSQL-3B + NatSQL2023-02-12
Improving Generalization in Language Model-Based Text-to-SQL Semantic Parsing: Two Simple Semantic Boundary-Based Techniques✓ Link7873.769.4T5-3B+NatSQL+Token Preprocessing2023-05-27
Graphix-T5: Mixing Pre-Trained Transformers with Graph-Aware Layers for Text-to-SQL Parsing✓ Link77.681.077.1Graphix-3B+PICARD2023-01-18
T5-SR: A Unified Seq-to-Seq Decoding Strategy for Semantic Parsing✓ Link75.272.477.2T5-SR2023-06-14
PICARD: Parsing Incrementally for Constrained Auto-Regressive Decoding from Language Models✓ Link75.171.9 75.5T5-3B + PICARD2021-09-10
SADGA: Structure-Aware Dual Graph Aggregation Network for Text-to-SQL✓ Link70.173.1SADGA + GAP2021-11-01
RYANSQL: Recursively Applying Sketch-based Slot Fillings for Complex Text-to-SQL in Cross-Domain Databases✓ Link58.266.6RYANSQL (BERT)2020-04-07
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL87.281.6datagpt-sql-7B + InvalidSQL-Feedback2024-09-24
DataGpt-SQL-7B: An Open-Source Language Model for Text-to-SQL84.880.3datagpt-sql-7B2024-09-24
LEVER: Learning to Verify Language-to-Code Generation with Execution✓ Link81.9code-davinci-002 175B (LEVER)2023-02-16
Knowledge-to-SQL: Enhancing SQL Generation with Data Expert LLM✓ Link71.68DELLM + GPT-42024-02-18
Learning Contextual Representations for Semantic Parsing with Generation-Augmented Pre-Training✓ Link71.8RATSQL + GAP2020-12-18
TaBERT: Pretraining for Joint Understanding of Textual and Tabular Data✓ Link64.5MAPO + TABERTLarge (K = 3)2020-05-17