Organizations: The Hong Kong University of Science and Technology (Guangzhou), China · Shanghai Jiao Tong University, Shanghai, China · Renmin University of China, Beijing, China · Beijing Institute of Technology, Beijing, China · Huawei · Southeast University, Nanjing, China · Tsinghua University, Beijing, China · DeepWisdom
The rapid advancement of large language models (LLMs) has spurred the emergence of data agents, autonomous systems designed to orchestrate Data + AI ecosystems for tackling complex data-related tasks. However, the term "data agent" currently suffers from terminological ambiguity and inconsistent adoption, conflating simple query responders with sophisticated autonomous architectures. This terminological ambiguity fosters mismatched user expectations, accountability challenges, and barriers to industry growth. Inspired by the SAE J3016 standard for driving automation, this survey introduces the first systematic hierarchical taxonomy for data agents, comprising six levels that delineate and trace progressive shifts in autonomy, from manual operations (L0) to a vision of generative, fully autonomous data agents (L5), thereby clarifying capability boundaries and responsibility allocation. Through this lens, we offer a structured review of existing research arranged by increasing autonomy, encompassing specialized data agents for data management, preparation, and analysis, alongside emerging efforts toward versatile, comprehensive systems with enhanced autonomy. We further analyze critical evolutionary leaps and technical gaps for advancing data agents, especially the ongoing L2-to-L3 transition, where data agents evolve from procedural execution to autonomous orchestration. Finally, we conclude with a forward-looking roadmap, envisioning proactive, generative data agents. A curated companion repository is available at https://github.com/HKUSTDial/awesome-data-agents.
Figures & tables
Aspect
General-purpose LLM Agents
Data Agents
Core Goal
Broad User Tasks: Assist with writing, search, planning, dialogue, and content generation.
Data-centric Tasks: Support data management, preparation, analysis, operation, and governance.
Operating Environment
Open-ended Digital Environments: Interact with task-dependent contexts, tools, webpages, or APIs.
Data Infrastructure: Operate over DBMSs, data lakes, BI systems, ETL tools, and runtimes.
Grounding and Interaction
Prompt- and Tool-grounded: Reason over prompts, retrieved content, and tool observations when available.
Data-grounded and Execution-aware: Ground reasoning in schemas, values, metadata, constraints, provenance, and execution feedback.
Tool and Execution
General-purpose Tool Use: Invoke tools such as search engines, calculators, OCR, code, or web APIs.
Specialized Data Tool Use: Invoke SQL engines, DB loaders, profilers, optimizers, validators, visualization libraries, or code/runtime engines.
Outputs and Evidence
User-facing Artifacts: Generate text, plans, content, answers, or tool-mediated actions.
Verifiable Data Artifacts: Produce SQL, configurations, cleaned/integrated data, charts, reports, workflows, or execution traces.
Reliability and Evaluation
Direct Task Reliability: Emphasize response correctness, task success, and tool-use robustness.
Downstream Workflow Reliability: Require data grounding, workflow robustness, auditability, and control of cascading errors.
Table 1: Comparison between General-purpose LLM Agents and Data Agents
Figure 2: Representative Data Agents Across Different Levels.
Figure 3: Evolutionary Leaps Between Data Agent Levels.
Figure 4: L1 Data Agents (Assistance).
Task
Data Agent
In-Context Learning
RAG
SFT
RL
Data Complexity
Multis.
Hete.
Multim.
Data Management
Configuration Tuning
LLMTune [ 44 ]
zero-shot
-
✓
-
-
✓
-
GPTuner [ 45 ]
zero-shot
-
-
-
✓
✓
-
λ -Tune [ 46 ]
zero-shot
✓
-
-
-
-
-
E2ETune [ 47 ]
few-shot
-
✓
-
-
-
-
Query Optimization
DB-GPT [ 48 ]
few-shot
✓
✓
-
✓
✓
-
Table 2: Comparison of Representative L1 Data Agents. RAG: Retrieval-Augmented Generation; SFT: Supervised Fine-Tuning; RL: Reinforcement Learning. Data complexity: Multi-source (Multis.), Heterogeneous (Hete.), and Multimodal (Multim.).
Table 4: Comparison of Representative Proto-L3 Data Agents from Academia Research and Industry Products. Compares Open-source: availability; Undef Ops.: capabilities in utilizing unpredefined operators; data-related task coverage across data management, preparation, analysis; data complexity dimensions: Multi-source (Multis.), Heterogeneous (Hete.), and Multimodal (Multim.). † indicates industry system.
Department of Computer Science, Tsinghua University, Beijing, China · Shanghai Jiao Tong University, Shanghai, China · The Hong Kong University of Science and Technology (Guangzhou), China +1