cs.CLJun 2, 2026

EntSQL: A Benchmark for Grounding Text-to-SQL in Long-Context Enterprise Knowledge

Authors: Chengxi LiaoTao XuZulong ChenChuanfei XuYiyan WangXinyun WangYanlong ZhangXiaojun Chen+2 more

Organizations: 1HKUST (GZ) · 2Alibaba Group · 4Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ) · 3Qwen Team

Abstract

Text-to-SQL enables natural language access to databases, and recent LLMs have substantially advanced its capabilities. Existing benchmarks such as Spider, BIRD, and Spider~2.0 evaluate schema generalization, large-scale databases, and realistic workflows, but largely overlook enterprise scenarios where SQL generation depends on private business knowledge, such as internal metrics, reporting conventions, and organizational rules. We introduce EntSQL, an enterprise-oriented Text-to-SQL benchmark for evaluating long-context grounding over proprietary business documents. EntSQL contains 1,066 aligned Chinese-English semantic examples across five business domains, with most examples requiring domain knowledge beyond the question and schema and involving complex SQL structures. On English inputs, the best evaluated system reaches only 15.9% when long-form documents are provided, highlighting the difficulty of grounding SQL generation in enterprise knowledge.

Explore similar work

CardsList
  1. PExA: Parallel Exploration Agent for Complex Text-to-SQL

    Apr 24, 2026Tanmay Parekh, Ella Hofmann-Coyle, Shuyi Wang +3Text-To-SqlSql