cs.CVNov 11, 2026

ChartGalaxy++: A Richly Annotated Dataset for Chart Understanding and Generation

Authors: Duan Li, Zheng Wang, Jiangning Zhu, Yuhui Yuan, Shixia Liu

Organizations: Tsinghua University · Canva

Abstract

Infographic charts communicate data through cohesive compositions of visual elements such as charts, text, and images. Existing infographic chart datasets primarily annotate individual elements with bounding boxes and category labels. Such element-level annotations do not capture hierarchical and spatial relationships, limiting their use for understanding how elements are organized and related within an infographic and for generating well-organized designs. To address this limitation, we introduce ChartGalaxy++, a richly annotated dataset of 217,195 infographic charts. At the core of this dataset is a scene graph representation, in which nodes represent visual elements and semantic groups, and edges encode their hierarchical and spatial relationships. For real infographics, we construct scene graphs by detecting and progressively grouping visual elements; for synthetic ones, we derive them directly from the generation process. We demonstrate the utility of ChartGalaxy++ through three applications: 1) image-to-scene-graph prediction, 2) scene-graph-augmented infographic question answering, and 3) evaluation of scene graph preservation in image generation. Together, these applications highlight the value of ChartGalaxy++ for advancing chart understanding and generation.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. ChartNet: A Million-Scale, High-Quality Multimodal Dataset for Robust Chart Understanding

    Mar 28, 2026Jovana Kondic, Pengyuan Li, Dhiraj Joshi +24Chart UnderstandingData Visualization

  2. DEEPCHART: How Far are LLMs from Faithful Data-Science Chart Generation?

    Aug 27, 2026Jiahui tang, Kuicai Dong, Dexun Li +7Data VisualizationLLM Reliability

  3. ChartAnno: Benchmarking Multimodal Large Language Models for Chart Annotation Generation

    Aug 4, 2026Zhenghan Chen, Zekai Shao, Lidan Tan +10Data VisualizationMultimodal Large Language Models