OpenCodePapers

code-generation-on-wikisql

Code Generation
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
PaperCodeExecution AccuracyExact Match AccuracyModelNameReleaseDate
Content Enhanced BERT-based Text-to-SQL Generation✓ Link89.283.7NL2SQL-RULE2019-10-16
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation✓ Link82.6TypeSQL+TC (Yu et al., 2018)+2018-04-25
TRANX: A Transition-based Neural Abstract Syntax Parser for Semantic Parsing and Code Generation✓ Link78.668.6Tranx2018-10-05
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link75.8GPT-42024-03-04
Semantic Parsing with Syntax- and Table-Aware SQL Generation74.661.0STAMP+RL (Sun et al., 2018)+2018-04-23
Semantic Parsing with Syntax- and Table-Aware SQL Generation74.460.7STAMP (Sun et al., 2018)+2018-04-23
TypeSQL: Knowledge-based Type-Aware Neural Text-to-SQL Generation✓ Link73.5TypeSQL (Yu et al., 2018)2018-04-25
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link72.3ProTrix-Coder2024-03-04
Natural Language to Structured Query Generation via Meta-Learning✓ Link68.062.8PT-MAML (Huang et al., 2018)2018-03-02
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link67.4ProTrix2024-03-04
Bidirectional Attention for SQL Generation✓ Link62.569Bidirectional Attention for SQL Generation2017-12-30
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning✓ Link59.448.3Seq2SQL (Zhong et al., 2017)2017-08-31
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link55.0GPT-3.5-turbo2024-03-04
Seq2SQL: Generating Structured Queries from Natural Language using Reinforcement Learning✓ Link35.923.4Seq2Seq (Zhong et al., 2017)2017-08-31
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link17.4Llama-2-7B2024-03-04
ProTrix: Building Models for Planning and Reasoning over Tables with Sentence Context✓ Link17.3CodeLlama-7B2024-03-04