Training Data Selection

Ask about this topic

Momentum

16 papers in the last four weeks, up 220% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 126

All topics
CardsList

  1. CoTrace: Data Recipes for Training Terminal Agents with Harness-Model Co-Evolution

    Oct 7, 2026Jixuan Chen, Jiaxin Zhang, Qinyuan Ye +11Terminal AgentsLLM Agent Harnesses

    University of California, San Diego · Salesforce AI Research · University of Washington

  2. Dataset Pruning from First Principles: A Label-Free Linear Programming Approach

    Oct 7, 2026Rodrigo Schuller, Francisco GanacimDataset PruningTraining Data Selection

    Instituto de Matem´atica Pura e Aplicada (IMPA) Rio de Janeiro, Brazil

  3. A Fine-Grained Analysis of the LoRA Fine-Tuning Landscape with Implications for Data Selection

    Oct 5, 2026Bowen Zhang, Changrui Fang, Xinsong Ma +2Low-Rank AdaptationTraining Data Selection

    City University of Hong Kong · Shanghai University of Finance and Economics

  4. Scalable, Transferable Meta-network for Data Selection Requires a Different Loss (and Why the Obvious Choice is Problematic)

    Oct 1, 2026Zilin Du, Bowen Yang, Boyang Albert LiTraining Data Selection

    College of Computing and Data Science Nanyang Technological University Singapore

  5. Client and Training Data Selection for Computationally Efficient Synchronized Federated Learning

    Sep 30, 2026Muzaffer Citir, Hiroki Nishikawa, Sangyoung ParkClient Selection in Federated LearningNon-IID Federated Learning

    Smart Mobility Systems, Technical University of Berlin, Germany · Graduate School of Information Science and Technology, The University of Osaka, Japan

  6. The Unequal Influence of Bad Advice: Using Training Data Attribution to Modulate Emergent Misalignment

    Sep 29, 2026Gonçalo Paulo, Louis Jaburi, Nora Belrose +2LLM AlignmentLLM Fine-Tuning

    EleutherAI

  7. Beyond Prompt Count: How Data Shapes Transfer in On-Policy Distillation

    Sep 29, 2026Jiaxuan Wang, Jiafei Lyu, Yuchen Cai +8Training Data SelectionLanguage Model Distillation

    State Key Laboratory of Novel Software Technology, Nanjing University · School of Intelligence Science and Technology, Nanjing University · LLM Department, Tencent +1

  8. Loss-Guided Pretraining Data Selection for Time-Series Foundation Models

    Sep 29, 2026Yike Li, Shaoxu Song, Jianmin WangTime Series ForecastingTraining Data Selection

    Tsinghua University

  9. From internal representations to model improvement through prediction errors

    Sep 28, 2026Yushi Nakaya, Kenichi Higuchi, Shuichi IshidaActive LearningTraining Data Selection

    Adansons Corp., 214 Homer Ave, Palo Alto, 94301, CA, USA. · Tohoku University, 6-6-11-803 Aza-Aoba Aramaki, Aoba-ku, Sendai, 980-8579, Miyagi, Japan.

  10. When Less Data Favors Smaller Teachers: Rethinking Teacher Capacity and Data Selection for Knowledge Distillation

    Sep 28, 2026Minjae Park, Taesun Yeom, Jaeho LeeSelective Knowledge DistillationTraining Data Selection

    Pohang University of Science and Technology (POSTECH)

  11. How code helps different tasks? A decompositional lens on LLM post-training

    Sep 27, 2026Zheng Yu, Yiwei Li, Yishen Chen +4LLM Fine-TuningInstruction-Tuning Data Selection

    Sun Yat-sen University · Shenzhen Loop Area Institute · The Chinese University of Hong Kong, Shenzhen +1

  12. Selecting Diverse SFT Traces Improves Post-RL Generalization

    Sep 27, 2026Dylan Zhang, Mingyuan Wu, Jinning LiReasoning DiversityRL for Language Model Reasoning

    University of Illinois Urbana-Champaign, work done at Google · Google

  13. Frame-to-Panorama Localization and Context-Aware Sampling for Scene-Specific Ship Detection in a Smart Marina Testbed

    Sep 24, 2026Ignat Romanov, Andreas Hadjipieris, Neofytos DimitriouTraining Data SelectionVideo Frame Selection

    Department of Computer Science University of Nicosia Nicosia, Cyprus · Maritime Digitalization Centre Cyprus Marine and Maritime Institute Larnaca, Cyprus

  14. Benchmarking Active Spot Selection for Cost-Efficient Spatial Transcriptomics

    Sep 23, 2026Zheyu Zhu, Junchao Zhu, Fengbei Liu +7Spatial TranscriptomicsActive Learning

    University of Pennsylvania, Philadelphia, PA 19104, USA · Vanderbilt University, Nashville, TN, USA · Cornell Tech, New York, NY 10044, USA +4

  15. CRISP: Scalable Importance-Stratified Coresets for Imbalanced Tabular Learning

    Sep 22, 2026Hardhik Mohanty, Indrayana Rustandi, Mohamadreza SheibaniClass-Imbalanced LearningTraining Data Selection

    University of Southern California Los Angeles, California, USA · Coinbase San Francisco, California, USA

  16. Marginal Log-Likelihood Increments under Dirichlet-Smoothed Markov Estimation

    Sep 22, 2026Levin David SchwabMarkov ModelsProcess Mining

  17. Are Coreset Selection Methods Worth Their Cost?

    Sep 19, 2026Yangze Liu, Zhongyi HanBenchmark DesignTraining Data Selection

    Shandong University

  18. AutoData: Agentic Search for Pre-training Data Selection

    Sep 17, 2026Yan Meng, Dhruv Srikanth, Bingchen Zhao +2Language Model PretrainingAutomated Algorithm Discovery

    University of Amsterdam · Weco AI

  19. RoboDrop: Curating VLA Post-Training Data via Local Gradient Compatibility

    Sep 9, 2026Runze Xu, Yuanfan Xu, Cuijie Xu +4Robotic Data CollectionTraining Data Selection

    Tsinghua University · Striding AI

  20. Exact Recovery Thresholds for Weighted Data Selection in Vector-Valued Linear Regression

    Aug 31, 2026Guangjian ZhangData SelectionTraining Data Selection

  21. DICS: Exploring Data Intrinsic Consistency for Visual Instruction Selection

    Aug 31, 2026Yuyang Hong, Jinhui Guo, Jiaqi Gu +6Instruction-Tuning Data SelectionTraining Data Selection

    School of Artificial Intelligence, University of Chinese Academy of Sciences · 2MAIS, Institute of Automation, Chinese Academy of Sciences · 3Alibaba Token Hub, Alibaba Group

  22. Token Distribution versus Data Volume: Domain Balancing in Multi-Domain Meeting Summarisation

    Aug 16, 2026Ashima Sood, Bryan Gardiner, Joan CondellLLM Fine-TuningText Summarization

    School of Computing, Engineering and Intelligent Systems, Ulster University Londonderry, Northern Ireland, United Kingdom

  23. Agentic Instruction Data Selection: Let DataMaster Interpret Your Intent

    Aug 11, 2026Fanqi Zhou, Qiaosheng Chen, Zixian Huang +1Training Data CurationInstruction-Tuning Data Selection

    State Key Laboratory of Novel Software Technology, Nanjing University · Shanghai Artificial Intelligence Laboratory

  24. Diversity Matters: Distributional Feature Coverage Sample Selection for Data-Efficient Backdoor Attacks

    Aug 10, 2026Yi Yang, Xiaoke Chen, Jinyang Huang +6Backdoor AttacksData Selection

    School of Computer Science and Information Engineering, Hefei University of Technology, Hefei 230601, China · School of Information Science and Technology, University of Science and Technology of China, Hefei 230026, China · John Hopcroft Center for Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China +1

  25. TSDS-Toolbox: A Toolbox for Measuring Time-Series Dataset Similarity

    Aug 8, 2026Yen-Ku Liu, Hongjie Chen, Ryan A. Rossi +1Training Data Selection

    National Yang Ming Chiao Tung University Hsinchu, Taiwan · Dolby Laboratories Atlanta, Georgia, USA · Adobe Research San Jose, California, USA +1

  26. Perturbation Sensitivity at Convergence: A Simple Signal for Identifying Spuriously Correlated Samples

    Aug 5, 2026Nilesh KumarTraining Data SelectionClassification

  27. One Knob to Rule Them All: A Unified Optimal Transport View of Cold-Start Active Learning

    Aug 4, 2026Ning Zhu, Xiaochuan Ma, Juntao Xu +4Active LearningTraining Data Selection

    Glasgow College, University of Electronic Science and Technology of China · School of Mechanical and Electrical Engineering, University of Electronic Science and Technology of China · School of Mathematical Sciences, University of Electronic Science and Technology of China

  28. GLOBE: Trajectory-Aligned Gradient Matching with Structured SparseOptimization for Coreset Selection

    Aug 3, 2026Hetian Liu, Jin Cui, Mengcheng Shi +4Training Data SelectionCoreset Selection

    State Key Laboratory of Human-Machine Hybrid Augmented Intelligence, and Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University · School of Software Engineering, Xi’an Jiaotong University · School of Computer Science and Technology, Xi’an Jiaotong University

  29. RTLCurator: Label-Efficient Data Curation for RTL Generation

    Jul 31, 2026Siyang Cai, Cangyuan Li, Wenjing Chang +4Training Data CurationTraining Data Selection

    School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · CICS, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · Computer Network Information Center, Chinese Academy of Sciences, Beijing, China +1

  30. Understanding Context Sampling in TabPFN on Small Tabular Datasets

    Jul 29, 2026Mohammed AbdullahTabular Foundation ModelsTabular Classification

    Department of AI & Data Science Anna University

  31. Anti-Backdoor Coreset Selection via Cumulative Entropy

    Jul 28, 2026Qi Zhao, Christian WressneggerNeural Network RobustnessTraining Data Selection

    KASTEL Security Research Labs, Karlsruhe Institute of Technology (KIT)

  32. PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning

    Jul 20, 2026Hang Zhang, Warren J. GrossLLM Fine-TuningEfficient Language Model Training

    Department of Electrical and Computer Engineering, McGill University Montreal, QC, Canada

  33. How Jailbreak Attacks Inform Safety Alignment: A Defender-Centric, Shapley-Based Evaluation of Jailbreak Contributions

    Jul 19, 2026Yukai Zhou, Feiyang Lu, Xiaokai Mao +2LLM Safety AlignmentTraining Data Selection

    ShanghaiTech University · Zhejiang University

  34. A Coreset Selection Framework with Ensemble Aggregation for Image Classification

    Jul 10, 2026Pedro Rocha Dantas, Lucas Pascotti ValemTraining Data SelectionCoreset Selection

    Institute of Mathematics and Computer Science (ICMC) University of S˜ao Paulo (USP) S˜ao Carlos – SP – Brazil

  35. Online Data Selection Is Implicit Alignment

    Jul 8, 2026Aoxiong Zeng, Yuxin Yang, Xiangquan YangSupervised Fine-TuningLLM Alignment

    East China Normal University · Shanghai University

  36. Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation

    Jul 7, 2026Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor IonescuTraining Data SelectionCoreset Selection

    Department of Computer Science, University of Bucharest, 15G Iuliu Maniu, Bucharest 061075, Romania

  37. Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation

    Jul 2, 2026Zhuowei Chen, Xiang Lorraine LiOn-Policy Self-DistillationTraining Data Selection

    University of Pittsburgh, United States

  38. Post-Generation Curation of Synthetic Images via Homogeneous-Heterogeneous Splitting

    Jul 2, 2026Disheng Liu, Tuo Liang, Chaoda Song +1Synthetic Data AugmentationTraining Data Selection

    Department of Computer and Data Sciences Case Western Reserve University Cleveland, OH, USA

  39. Temporal Training Strategies for Left Atrium and Left Atrial Appendage Segmentation in Dynamic Contrast 4DCT

    Jun 30, 2026David Montalvo-García, Lauren Severance, Elliot R. McVeigh +1Training Data SelectionMedical Image Segmentation

    Biomedical Image Technologies, ETSI Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain · Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Instituto de Salud Carlos III, Madrid, Spain · Department of Bioengineering, University of California San Diego, La Jolla, CA, USA +2

  40. Improving Large-Scale Weakly Supervised ASR by Filtering and Selection

    Jun 27, 2026Kohei Matsuura, Masato MimuraDomain AdaptationTraining Data Selection

    Human Informatics Laboratories, NTT Corporation, Japan

  41. Reasoning Quality Emerges Early: Data Curation for Reasoning Models

    Jun 25, 2026Hongyi Henry Jin, Wenhan Yang, Meysam Ghaffari +2LLM Fine-TuningTraining Data Selection

    Department of Computer Science, University of California Los Angeles (UCLA), California, USA · Optum AI, UnitedHealth Group, Minneapolis, Minnesota, USA

  42. Less is More: Quality-Aware Training Data Selection for Scientific Summarization

    Jun 23, 2026Maria Nefeli Paraskevopoulou, Tatiana Passali, Grigorios TsoumakasText SummarizationTraining Data Selection

    School of Informatics Aristotle University of Thessaloniki Greece

  43. Data Selection Through Iterative Self-Filtering for Vision-Language Settings

    Jun 22, 2026Andrei Liviu Nicolicioiu, Sarvjeet Singh Ghotra, Morgane M. Moss +1Vision-Language ModelsTraining Data Curation

    Mila, Université de Montréal

  44. One-Shot Data Selection for Medical Image Classification via Graph Coverage

    Jun 20, 2026Zahiriddin Rustamov, Nadia Badawi, Rafat Damseh +1Training Data SelectionMedical Image Classification

    Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates

  45. Data Pruning: Redundant, Problematic, and Interdependent Samples

    Jun 20, 2026Leon Freese, Marthinus W. TheunissenDataset PruningTraining Data Selection

    Faculty of Engineering, North-West University, South Africa · Centre for Artificial Intelligence Research (CAIR), South Africa · National Institute for Theoretical and Computational Sciences (NITheCS), South Africa

  46. Spectral DPPs via NEPv: A Scalable Continuous Relaxation of Determinantal MAP for Diversity-Aware Data Selection

    Jun 17, 2026Richard Yi Da XuDeterminantal Point ProcessTraining Data Selection

    Hong Kong Baptist University · TadReamk Limited

  47. RegMix-D: Dynamic Data Mixing via Proxy Training Trajectories

    Jun 17, 2026Kaiyan Zhao, Zhongtao Miao, Akiko Aizawa +1Language Model PretrainingTraining Data Selection

    The University of Tokyo · National Institute of Informatics

  48. BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training

    Jun 17, 2026Jiaxing Wang, Deping Xiang, Jin Xu +9Training Data SelectionBilevel Optimization

  49. Rethinking Dataset Distillation for Classification: Do Distilled Sets Outperform Coresets?

    Jun 16, 2026Trisha Mittal, Akshay Mehra, Joshua KimballTraining Data SelectionDataset Distillation

    1Dolby Laboratory

  50. Active Learning with Low-Rank Structure for Data Selection

    Jun 14, 2026Vincent Cohen-Addad, Sasidhar Kunapuli, Vahab Mirrokni +3Active LearningData Selection

    Google Research. · University of California, Berkeley. · Institute of Science and Technology Austria (ISTA). +2

  51. Spokes: Optimizing for Diverse Pretraining Data Selection

    Jun 13, 2026Clarence Lee, Yejin Choi, Luke Zettlemoyer +2Language Model PretrainingTraining Data Selection

    DSO National Laboratories · Stanford University · University of Washington

  52. When Sample Selection Bias Precipitates Model Collapse

    Jun 11, 2026Xinbao Qiao, Xianglong Du, Wei Liu +4Synthetic Data PretrainingModel Collapse

    National University of Singapore (Chongqing) Research Institute · Chongqing Key Laboratory of Trusted Perception and Interaction Technology for Intelligent and Connected Vehicles, Chongqing, China · The Chinese University of Hong Kong +4

  53. Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration

    Jun 11, 2026Dongyue Wu, Zilin Guo, Xiaoyu Li +4Dataset PruningTraining Data Selection

    State Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China · Ant Group, Hangzhou, China

  54. Using Explainability as a Training-Time Reliability Signal for Efficient ECG Classification

    Jun 10, 2026Veerendhra Kumar Dangeti, Xiao Gu, Ying Weng +1Time Series ClassificationTraining Data Selection

    School of Computer Science, University of Nottingham, Jubilee Campus, Wollaton Road, Nottingham, NG8 1BB, United Kingdom · Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, OX3 7DQ, United Kingdom · School of Computer Science, University of Nottingham Ningbo China, Ningbo, 315100, China

  55. RCAP: Robust, Class-Aware, Probabilistic Dynamic Dataset Pruning

    Jun 10, 2026Atif Hassan, Swanand Khare, Jiaul H. PaikDataset PruningTraining Data Selection

    Department of Artificial Intelligence, IIT Kharagpur, Kharagpur, West Bengal, India · Department of Mathematics, IIT Kharagpur, Kharagpur, West Bengal, India

  56. A Systematic Approach for Selecting Trajectories for Data Augmentation

    Jun 9, 2026Adam NordlingSynthetic Data AugmentationData Augmentation

  57. SSAFE: Simple and Strong AI-Generated Image Detection via Frozen Vision Encoders

    Jun 7, 2026Seunghyun Lee, Byoungkwon Kim, Jaehyun Nam +2Domain GeneralizationTraining Data Selection

    1KAIST · † Work done at KAIST. · 2Google Cloud AI

  58. Temporal Coverage over Density: Parsimonious Training-Set Design for ML Climate Downscaling

    Jun 5, 2026Karandeep Singh, Stefan Rahimi, Chad W. Thackeray +2Surrogate ModelingClimate Science

    Atmospheric and Oceanic Sciences, University of California, Los Angeles, CA, USA · Department of Atmospheric Science, University of Wyoming, WY, USA

  59. LIMMT: Less is More for Motion Tracking

    Jun 5, 2026Yu Guan, Zekun Qi, Chenghuai Lin +7Training Data SelectionHumanoid Motion Tracking

    1Tsinghua University · 2GalBot · 3Shanghai Jiao Tong University +2

  60. HARP: Efficient Data Selection for Finetuning Large Language Models

    Jun 5, 2026Ning Wang, Zhengxin Zhang, Maosen Tang +3LLM Fine-TuningActive Learning

    Cornell University · The Hong Kong University of Science and Technology