Text-to-SQL Evaluation

Ask about this topic

Latest papers

CardsList

23 papers3 papers in the last four weeks, down 40% on the four weeks before. 0.0% of all new papers.

  1. PremiseSQL: Evaluating Premise Critique and Abstention in Text-to-SQL Systems

    Oct 15, 2026Shuo Lin, Jinzhe Li, Chenlu Guo +3Text-to-SQLText-to-SQL Evaluation

    School of Artificial Intelligence, Jilin University · International Center of Future Science, Jilin University · Bilibili Inc. +2

  2. VeriPIE: Checkable Query Plans and Evidence-Guided Selection for Text-to-SQL

    Oct 12, 2026Piyush Jha, Cruise Song, Zhengyu Li +1Execution-Guided Text-to-SQLText-to-SQL

    Georgia Tech

  3. Closing the Cross-Dialect Gap: Query Plans as a Portable Interface in Text-to-SQL

    Sep 27, 2026Corentin Royer, Robin Oester, Yotam Perlitz +3Text-to-SQLRelational Databases

    IBM Research, Zurich, Switzerland · ETH Zurich, Zurich, Switzerland

  4. An Iterative LangGraph Agent for Text-to-SQL: Natural Language Access to the Chicago Crime Database

    Sep 19, 2026Vigneshwar Ravi Rao, Rupesh Swarnakar, Fayeq Jeelani Syed†Text-to-SQLTool-Using Language Agents

    Luddy School of Informatics, Computing and Engineering, Indiana University, Indianapolis, Indiana, USA

  5. The Stochastic Shift: A New Evaluation Paradigm for Text-to-SQL with AI Operators

    Sep 17, 2026Tarfah Alrashed, Fatma Ozcan, Per Jacobsson +2Text-to-SQL EvaluationText-to-SQL

    Google

  6. SQLMorph: Query Mutation and Fine-Grained Metrics for Text-to-SQL Evaluation

    Sep 8, 2026Mohammadhossein Malekpour, Mohamed Riahi, Maxime Lamothe +1Mutation TestingText-to-SQL

    Polytechnique Montréal

  7. BudgetSchemaBench: A Budget-Swept Diagnostic for Schema Context in Text-to-SQL

    Sep 8, 2026Chen ShenText-to-SQLText-to-SQL Evaluation

    Megagon Labs

  8. BIRD-History: A Benchmark for History-Driven Text-to-SQL with Fine-Grained Knowledge Annotations

    Aug 29, 2026Yunfan Zhou, Qiming Shi, Yizhou Yang +2Text-to-SQLText-to-SQL Evaluation

    State Key Lab of CAD&CG, Zhejiang University · School of Software Technology, Zhejiang University

  9. SAFAARI: Schema-Aware Framework for Accelerated Advertiser Response Intelligence

    Jul 27, 2026Bhanu Teja Rangaraju, Chandan KumarMulti-Agent LLM SystemsCustomer Support Automation

    Amazon, Seattle, USA.

  10. What Predicts Correctness in Text-to-SQL? A Selective-Prediction Study

    Jul 7, 2026Robert RichardsonLLM Answer VerificationSelective Prediction

    Affiliation

  11. Spider 2.0-AIFunc: Extending Real-World Text-to-SQL to AI-Native SQL Workflows

    Jul 7, 2026Tianyang Liu, Canwen Xu, Fangyu Lei +6Text-to-SQLRelational Databases

    1UC San Diego · *Work done during Tianyang Liu’s internship at Snowflake. · 2Snowflake AI Research +1

  12. Querying an astronomical database using large language models: the ALeRCE text-to-SQL system

    Jun 16, 2026P. A. Estevez, J. Espejo-Moreira, S. Sanfeliu-Alvarez +10LLM PromptingAI-Assisted Scientific Research

    Department of Electrical Engineering, University of Chile, Av. Tupper 2007, Santiago, Chile · Millennium Institute of Astrophysics (MAS), Nuncio Monseñor Sótero Sanz 100, Providencia, Santiago, Chile · Departamento de Astronomía, Universidad de Chile, Casilla 36D, Santiago, Chile +11

  13. UniQL: Towards Dialect-Universal Benchmarking for Text-to-SQL

    Jun 6, 2026Jianling Gao, Chongyang Tao, Jiayuan Bai +7LLM EvaluationText-to-SQL

    1SKLCCSE, Beihang University · 2The University of Hong Kong

  14. EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge

    Jun 2, 2026Chengxi Liao, Tao Xu, Zulong Chen +7LLM GroundingText-to-SQL

    1HKUST (GZ) · 2Alibaba Group · 4Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) +1

  15. BADGER: Bridging Agentic and Deterministic Evaluation for Generative Enterprise Reasoning

    Jun 1, 2026Shannon Serrao, Soumitra Chatterjee, Dorina Strori +2LLM Agent EvaluationAI Agent Evaluation

    Merkle Analytics

  16. PolySQL: Scaling Text-to-SQL Evaluation Across SQL Dialects via Automated Backend Isomorphism

    May 8, 2026Yotam Perlitz, Elad Venezian, Corentin Royer +2Benchmark DesignText-to-SQL

    1IBM Research AI · 2ETH Zürich

  17. Anatomy of a Query: W5H Dimensions and FAR Patterns for Text-to-SQL Evaluation

    May 7, 2026Vicki Stover Hertzberg, Eduardo Valverde, Joyce C. HoText-to-SQLSemantic Parsing

    Emory University · Georgia Institute of Technology, Atlanta, USA

  18. Agent-Agnostic Evaluation of SQL Accuracy in Production Text-to-SQL Systems

    Apr 30, 2026Taslim Jamal Arif, Kuldeep SinghText-to-SQLAutomated Evaluation

  19. R3^3-SQL: Ranking Reward and Resampling for Text-to-SQL

    Apr 28, 2026Hojae Han, Yeonseok Jeong, Seung-won Hwang +2Learning to RankText-to-SQL

    ETRI · 2Seoul National University · 3Snowflake AI Research

  20. A Demonstration of SQLyzr: A Platform for Fine-Grained Text-to-SQL Evaluation and Analysis

    Apr 23, 2026Sepideh Abedini, M. Tamer ÖzsuLLM EvaluationText-to-SQL

    University of Waterloo

  21. SQL Query Engine: A Self-Healing LLM Pipeline for Natural Language to PostgreSQL Translation

    Apr 15, 2026Muhammad Adeel IjazExecution-Guided Text-to-SQLText-to-SQL

  22. SQLStructEval: Structural Evaluation of LLM Text-to-SQL Generation

    Apr 8, 2026Yixi Zhou, Fan Zhang, Zhiqiao Guo +4Text-to-SQL EvaluationText-to-SQL

    Hong Kong Baptist University · ShanghaiTech University · The University of Tokyo +2

  23. SpotIt+: Verification-based Text-to-SQL Evaluation with Database Constraints

    Mar 4, 2026Andrew Tremante, Yang He, Rocky Klopfenstein +3Text-to-SQL EvaluationText-to-SQL

    ∗Amherst College · †Simon Fraser University · ‡VMware Research by Broadcom