Overview

Data selection studies which examples, sources, labels, or interactions a model should learn from, aiming to improve performance while reducing training or annotation costs. Common approaches include coreset and diversity methods, uncertainty or active learning, gradient and influence scoring, distribution matching, and adaptive sampling policies. These methods are used in settings such as image classification, LLM instruction and preference tuning, multimodal training, and clinical labeling. Selected subsets can match or outperform full-data training, but usefulness depends on the model, target task, and budget; a key challenge is balancing short-term gains with coverage of rare cases, robustness, and long-term learning.

Latest papers

CardsList

91 papers8 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. STORMGUIDE-FL: Stochastic Remote Guidance for Efficient Mining of Federated Streaming Data

    Nov 16, 2026Manuel Röder, Frank-Michael SchleifFederated LearningOnline Federated Learning

  2. Safety-Preserving Medical LLM Fine-Tuning via Bilevel Data Selection

    Nov 16, 2026Ruoxuan Shi, Sheng Yang, Zhengxing Su +2Safety-Preserving Fine-Tuning of Language ModelsData Selection for Language Model Fine-Tuning

  3. Rethinking Data Selection: The Importance of Coverage over Difficulty in LLM Fine-Tuning

    Nov 5, 2026Lalchand Pandia, Kanishka Misra, Allyson EttingerData SelectionData Selection for Language Model Fine-Tuning

  4. Query-based Submodular Data Selection for Efficient Instruction Tuning

    Nov 2, 2026Zhenghao Zhao, Yasutomo Kawanishi, Huihuo Zheng +2Data SelectionInstruction-Tuning Data Selection

  5. Balancing Representations by Identifying and Generating Under-represented Data

    Nov 2, 2026Filipe Laitenberger, Hirokatsu Kataoka, Yuki Asano +2Self-Supervised Visual Representation LearningLong-Tail Learning

  6. Selective Tie Learning: Mitigating Spurious Correlations in Preference Optimization

    Oct 26, 2026Christian Moya, Purav Matlia, Elliott Thornley +1Preference OptimizationSpurious Correlation Robustness

  7. When Does Data Value Reduce to Class Balance? A Coverage View of Per-Point Data Valuation

    Oct 26, 2026Yingjie Bai, Weiming ZhiData SelectionTraining Data Selection

  8. Perturbation-Based Data Selection for Medical Question Answering

    Oct 24, 2026Yuexin Wu, Dayou Yu, Vasile RusData SelectionData Selection for Language Model Fine-Tuning

  9. ICLHerd: Herding-Based Data Selection for LLMs with In-Context Learning as a Proxy

    Oct 19, 2026Yuqiao Wen, Lili MouTraining Data SelectionData Selection

  10. Diversity Without Labels: Task-Agnostic Coreset Selection Across Perception and Action

    Oct 16, 2026Julia Hindel, Benjamin Ramtoula, Kyuhwan Yeon +4Data SelectionCoreset Selection

  11. Mind the Tail: Data Selection Through Sparse Concepts

    Oct 14, 2026Ziheng Zhang, Neha Hulkund, Colin Lee +7Training Data SelectionData Selection

  12. Diminishing Returns of Data in Sparse Autoencoders: Functional Behavior does not Guarantee Feature Reproducibility

    Oct 14, 2026Sambit Ghosh, Madelyn Mathai, R. Venkatesh Babu +1Sparse AutoencodersData-Efficient Learning

  13. CLIVO: Differentiable Cluster-Based Instruction Mixing with Learned Validation Objectives

    Oct 12, 2026Yuhan Wang, Rui Hu, Batian Di +5Semantic ClusteringInstruction-Tuning Data Selection

  14. Probabilistic Multi-Source Data Selection via Learnable Categorical Priors: Variance Reduction and Guaranteed Derandomization

    Oct 10, 2026Shizhan Cai, Qixin Zhang, Siyuan Ma +3Data SelectionBilevel Optimization

  15. Learning to Curate What You Generate for Generalizable Few-Shot Class-Incremental Learning

    Oct 4, 2026Junhui Yin, Yuchen Yang, Yilin Yin +6Class-Incremental LearningData Selection

  16. Training-Aware Target Coverage for Synthetic Data Selection

    Sep 30, 2026Yang Ba, Michelle V. Mancenido, Rong PanLLM Fine-TuningData Selection

  17. Pick the Mixture, Not the Samples: Combinatorial Data Selection for LLMs

    Sep 30, 2026Luyang Zhang, Jialu Wang, Bebei LiData SelectionData Selection for Language Model Fine-Tuning

  18. DivOPD: Spread Wide, Look Close for Asynchronous On-Policy Distillation of Multi-turn Agents

    Sep 28, 2026Hanyang Wang, Zeyuan Liu, Zhengyu Chen +7Data SelectionOn-Policy Distillation

  19. GERIS: A Game-Theoretic Framework for Filtering Instance-Dependent Label Noise in License Plate Data Augmentation

    Sep 22, 2026Seyedeh Sara Jalili Shani, Rouhollah Ahmadian, Amin Rahmani +2Game-Theoretic RLData Selection

  20. QUALS: Corpus Equilibrium for Universal Forecasting via Pattern Quantization and Learnability Synchronization

    Sep 17, 2026Yujie Li, Zezhi Shao, Chengqing Yu +7Zero-Shot Time Series ForecastingData Selection

  21. An Empirical Study of Development-Tuned Representation Sensitivity for Medical QA Data Selection

    Sep 9, 2026Yuexin Wu, Dayou Yu, Vasile RusData SelectionMedical QA

  22. Weighted Data Selection: Sharp Upper-Half and Five-Dimensional Laws

    Sep 8, 2026Zhongxuan Liu, Hongzhi WangData SelectionTraining Data Selection

  23. BAFF: Bid-Aware Filter Family for Mitigating Training Data Interference in RTB A/B Tests

    Sep 8, 2026Jeonglyul Oh, Ikkyu Choi, Inseop Youn +1Data SelectionA/b Testing

  24. AlignDiff: Exploiting Model-Intrinsic Information for Better Preference Data Selection

    Sep 5, 2026Peng Lai, He Zhu, Zhiwen Ruan +6Data SelectionPreference Alignment

  25. A budget-dependent crossover between coverage- and response-based training-set selection for machine-learned interatomic potentials

    Sep 5, 2026Jia Bi, Alin-Marin ElenaTraining Data SelectionData Selection

  26. Preference Data Selection for Mitigating the Alignment Tax in Large Language Models

    Aug 25, 2026Minsu Kim, Jianxun Lian, Xing Xie +1LLM AlignmentPreference Alignment