cs.DBAug 10, 2026

SafeQL: Search-based Refinement for Safe and Efficient LLM-based Text-to-SQL

Authors: Geonho LeeMin-Soo Kim

Organizations: Korea Advanced Institute of Science and Technology Republic of Korea

Abstract

Large language models (LLMs) have advanced Text-to-SQL by enabling natural language interfaces to databases without task-specific fine-tuning. However, existing LLM-based systems remain unreliable, often generating SQL queries that are invalid under the database schema, referencing non-existent tables, attributes, functions, or values. Such errors persist because interactions with the database management system (DBMS) are typically limited to error messages, leaving it in a largely passive role during query refinement. This paper proposes SafeQL, \textit{a search-based refinement paradigm that redefines the role of the DBMS as an active guide in the refinement process}. Instead of regenerating entire queries after execution failure, SafeQL interprets DBMS feedback to incrementally repair only the erroneous components. Each refinement step is formulated as a guided search within a \textit{safe query space}, where candidate queries are progressively validated through DBMS execution, thereby converging to an executable query and preventing repeated regeneration of errors. Experiments on the Bird and Spider benchmarks show that SafeQL significantly improves execution accuracy and efficiency compared to regeneration-based methods.

Explore similar work

CardsList
  1. ErrorLLM: Modeling SQL Errors for Text-to-SQL Refinement

    Mar 4, 2026Zijin Hong, Hao Chen, Zheng Yuan +6Text-To-SqlSql