OpenCodePapers

text-to-sql-on-spider-2-0

Text-To-SQL
Dataset Link
Results over time
Click legend items to toggle metrics. Hover points for model names.
Leaderboard
Click a sortable column header to sort.
PaperCodeSuccess RateModelNameReleaseDate
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows17.03Spider-Agent + o1-preview2024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows10.13Spider-Agent + GPT-4o2024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows9.02Spider-Agent + Claude-3.5-Sonnect2024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows8.86Spider-Agent + GPT-42024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows6.17Spider-Agent + Qwen2.5-72B2024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows5.22Spider-Agent + DeepSeek-V2.52024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows2.53Spider-Agent + Gemini-Pro-1.52024-11-12
Spider 2.0: Evaluating Language Models on Real-World Enterprise Text-to-SQL Workflows2.21Spider-Agent + Llama-3.1-405B2024-11-12
Check out how to contribute new results.