cs.LGAug 24, 2026

Mapping the Concept Landscape: Structural Perception of Global Distributions for Transparent Data Pruning

Authors: Dongyue Wu, Tao Ma

Organizations: State Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China · Ant Group · Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China

Abstract

Existing data pruning methods predominantly rely on high-dimensional feature embeddings to measure sample importance. However, these compressed vectors often obscure fine-grained semantic interactions, leading to suboptimal coverage of rare semantic concepts in the pruned subsets. In this paper, we propose Mapping the Concept Landscape (MCL), a novel structural perception framework for transparent data pruning. Instead of abstract embeddings, we represent each image-caption pair as an explicit sample-level graph comprising entities, events, and attributes. By integrating these individual graphs into a comprehensive dataset-level graph, we characterize the global distribution of semantic concepts and quantify their rarity across the entire corpus. Based on this structured perception, we develop a greedy concept-coverage maximization algorithm that iteratively selects samples to maximize the marginal gain of high-value, under-represented concepts. Experimental results on various benchmarks demonstrate that our method not only achieves superior pruning efficiency compared to state-of-the-art methods but also provides a transparent and interpretable audit trail for the selection process.

Figures & tables

Explore similar work

CardsList
  1. Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration

    Jun 11, 2026Dongyue Wu, Zilin Guo, Xiaoyu Li +4Dataset PruningTraining Data Selection

  2. Dataset Pruning from First Principles: A Label-Free Linear Programming Approach

    Oct 7, 2026Rodrigo Schuller, Francisco GanacimDataset PruningTraining Data Selection

  3. Mind the Tail: Data Selection Through Sparse Concepts

    Oct 14, 2026Ziheng Zhang, Neha Hulkund, Colin Lee +7Training Data SelectionData Selection