cs.AIOct 21, 2026

Charts as Epistemic Actions for Experience-Driven Agentic Data Analysis

Authors: Xinzhe Wang, Xudong Weng, Zang Li, Shaolei Zhang

Organizations: Tencent · Renmin University of China

Abstract

Data agents built on ReAct-style loops now execute complex analytical workflows over structured data, yet their intermediate reasoning still runs almost entirely through text. Human analysts instead move between numbers, tables, and charts, reading visual evidence to expose trends and anomalies that text summaries drop. We ask whether charts can serve as internal epistemic actions inside a data agent's reasoning loop, and how to teach an agent to use them. We first build \probe{}, a suite of 200 controlled tasks under four matched interface conditions, and find a persistent gap between what agents can read and what they choose to use. Agents score as well from self-generated charts as from numeric output, yet plotting access alone does not translate into consistent use. Task slices show that charts lead on temporal, pattern, and anomaly reasoning, while text leads on precise reading and conditional verification. We then propose \method{}, which distils two families of experience from conditioned trajectory rollouts. One family records how to select and verify analytical operations, and the other records when to invoke text, charts, or both. A trajectory judge scores outcomes and labels intermediate steps, and a validation gate admits only experience that improves held-out performance. On three held-out benchmarks with four LLM backbones, \method{} raises analytical accuracy and visual evidence quality over matched baselines, and backbones that never drew charts begin using them, all without touching model parameters.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Monitorable Chart Reasoning Agents via Verifiable Process Rewards

    Sep 21, 2026Sanchit Sinha, Oana Frunza, Kashif Rasul +1AI Agent MonitoringReinforcement Learning with Verifiable Rewards

  2. Hierarchical Visual Agent: Managing Contexts in Joint Image-Text Space for Advanced Chart Reasoning

    May 5, 2026Qihua Dong, Ruozhen He, Junwen Chen +4Data VisualizationChart QA

  3. When Charts Deceive Web Agents: A Paired Benchmark for Misleading Visualization-Grounded Tasks

    Oct 9, 2026Yisheng Li, Dongming Han, Hongkun Pan +5Web AgentsAI Agent Reliability