Training Data Selection

Follow this topic Ask about this topic

Momentum

16 papers in the last four weeks, up 220% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 128

All topics

Anti-Backdoor Coreset Selection via Cumulative Entropy
Jul 28, 2026Qi Zhao, Christian WressneggerNeural Network Robustness Training Data Selection
KASTEL Security Research Labs, Karlsruhe Institute of Technology (KIT)
PPL-Factory: Task-Aware and Budget-Aware Data Selection from Language Modeling to Reasoning
Jul 20, 2026Hang Zhang, Warren J. GrossLLM Fine-Tuning Efficient Language Model Training
Department of Electrical and Computer Engineering, McGill University Montreal, QC, Canada
How Jailbreak Attacks Inform Safety Alignment: A Defender-Centric, Shapley-Based Evaluation of Jailbreak Contributions
Jul 19, 2026Yukai Zhou, Feiyang Lu, Xiaokai Mao +2LLM Safety Alignment Training Data Selection
ShanghaiTech University · Zhejiang University
A Coreset Selection Framework with Ensemble Aggregation for Image Classification
Jul 10, 2026Pedro Rocha Dantas, Lucas Pascotti ValemTraining Data Selection Coreset Selection
Institute of Mathematics and Computer Science (ICMC) University of S˜ao Paulo (USP) S˜ao Carlos – SP – Brazil
Online Data Selection Is Implicit Alignment
Jul 8, 2026Aoxiong Zeng, Yuxin Yang, Xiangquan YangSupervised Fine-Tuning LLM Alignment
East China Normal University · Shanghai University
Few-Medoids: An Embarrassingly Simple Coreset Selection Method for Few-Shot Knowledge Distillation
Jul 7, 2026Cemil-Andrei Dilmac, Florinel-Alin Croitoru, Radu Tudor IonescuTraining Data Selection Coreset Selection
Department of Computer Science, University of Bucharest, 15G Iuliu Maniu, Bucharest 061075, Romania
Neuron-Aware Data Selection for Annotation-Free LLM Self-Distillation
Jul 2, 2026Zhuowei Chen, Xiang Lorraine LiOn-Policy Self-Distillation Training Data Selection
University of Pittsburgh, United States
Post-Generation Curation of Synthetic Images via Homogeneous-Heterogeneous Splitting
Jul 2, 2026Disheng Liu, Tuo Liang, Chaoda Song +1Synthetic Data Augmentation Training Data Selection
Department of Computer and Data Sciences Case Western Reserve University Cleveland, OH, USA
Temporal Training Strategies for Left Atrium and Left Atrial Appendage Segmentation in Dynamic Contrast 4DCT
Jun 30, 2026David Montalvo-García, Lauren Severance, Elliot R. McVeigh +1Training Data Selection Medical Image Segmentation
Biomedical Image Technologies, ETSI Telecomunicación, Universidad Politécnica de Madrid, Madrid, Spain · Centro de Investigación Biomédica en Red de Bioingeniería, Biomateriales y Nanomedicina (CIBER-BBN), Instituto de Salud Carlos III, Madrid, Spain · Department of Bioengineering, University of California San Diego, La Jolla, CA, USA +2
Improving Large-Scale Weakly Supervised ASR by Filtering and Selection
Jun 27, 2026Kohei Matsuura, Masato MimuraDomain Adaptation Training Data Selection
Human Informatics Laboratories, NTT Corporation, Japan
Reasoning Quality Emerges Early: Data Curation for Reasoning Models
Jun 25, 2026Hongyi Henry Jin, Wenhan Yang, Meysam Ghaffari +2LLM Fine-Tuning Training Data Selection
Department of Computer Science, University of California Los Angeles (UCLA), California, USA · Optum AI, UnitedHealth Group, Minneapolis, Minnesota, USA
Less is More: Quality-Aware Training Data Selection for Scientific Summarization
Jun 23, 2026Maria Nefeli Paraskevopoulou, Tatiana Passali, Grigorios TsoumakasText Summarization Training Data Selection
School of Informatics Aristotle University of Thessaloniki Greece
Data Selection Through Iterative Self-Filtering for Vision-Language Settings
Jun 22, 2026Andrei Liviu Nicolicioiu, Sarvjeet Singh Ghotra, Morgane M. Moss +1Vision-Language Models Training Data Curation
Mila, Université de Montréal
One-Shot Data Selection for Medical Image Classification via Graph Coverage
Jun 20, 2026Zahiriddin Rustamov, Nadia Badawi, Rafat Damseh +1Training Data Selection Medical Image Classification
Department of Computer Science and Software Engineering, United Arab Emirates University, Al Ain, United Arab Emirates
Data Pruning: Redundant, Problematic, and Interdependent Samples
Jun 20, 2026Leon Freese, Marthinus W. TheunissenDataset Pruning Training Data Selection
Faculty of Engineering, North-West University, South Africa · Centre for Artificial Intelligence Research (CAIR), South Africa · National Institute for Theoretical and Computational Sciences (NITheCS), South Africa
Spectral DPPs via NEPv: A Scalable Continuous Relaxation of Determinantal MAP for Diversity-Aware Data Selection
Jun 17, 2026Richard Yi Da XuDeterminantal Point Process Training Data Selection
Hong Kong Baptist University · TadReamk Limited
RegMix-D: Dynamic Data Mixing via Proxy Training Trajectories
Jun 17, 2026Kaiyan Zhao, Zhongtao Miao, Akiko Aizawa +1Language Model Pretraining Training Data Selection
The University of Tokyo · National Institute of Informatics
BLADE: Scalable Bi-level Adaptive Data Selection for LLM Training
Jun 17, 2026Jiaxing Wang, Deping Xiang, Jin Xu +9Training Data Selection Bilevel Optimization
Rethinking Dataset Distillation for Classification: Do Distilled Sets Outperform Coresets?
Jun 16, 2026Trisha Mittal, Akshay Mehra, Joshua KimballTraining Data Selection Dataset Distillation
1Dolby Laboratory
Active Learning with Low-Rank Structure for Data Selection
Jun 14, 2026Vincent Cohen-Addad, Sasidhar Kunapuli, Vahab Mirrokni +3Active Learning Data Selection
Google Research. · University of California, Berkeley. · Institute of Science and Technology Austria (ISTA). +2
Spokes: Optimizing for Diverse Pretraining Data Selection
Jun 13, 2026Clarence Lee, Yejin Choi, Luke Zettlemoyer +2Language Model Pretraining Training Data Selection
DSO National Laboratories · Stanford University · University of Washington
When Sample Selection Bias Precipitates Model Collapse
Jun 11, 2026Xinbao Qiao, Xianglong Du, Wei Liu +4Synthetic Data Pretraining Model Collapse
National University of Singapore (Chongqing) Research Institute · Chongqing Key Laboratory of Trusted Perception and Interaction Technology for Intelligent and Connected Vehicles, Chongqing, China · The Chinese University of Hong Kong +4
Selecting Samples on Graphs: A Unified Dataset Pruning Framework for Lossless Training Acceleration
Jun 11, 2026Dongyue Wu, Zilin Guo, Xiaoyu Li +4Dataset Pruning Training Data Selection
State Key Laboratory of Multispectral Information Intelligent Processing Technology, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan, China · Ant Group, Hangzhou, China
Using Explainability as a Training-Time Reliability Signal for Efficient ECG Classification
Jun 10, 2026Veerendhra Kumar Dangeti, Xiao Gu, Ying Weng +1Time Series Classification Training Data Selection
School of Computer Science, University of Nottingham, Jubilee Campus, Wollaton Road, Nottingham, NG8 1BB, United Kingdom · Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford, OX3 7DQ, United Kingdom · School of Computer Science, University of Nottingham Ningbo China, Ningbo, 315100, China
RCAP: Robust, Class-Aware, Probabilistic Dynamic Dataset Pruning
Jun 10, 2026Atif Hassan, Swanand Khare, Jiaul H. PaikDataset Pruning Training Data Selection
Department of Artificial Intelligence, IIT Kharagpur, Kharagpur, West Bengal, India · Department of Mathematics, IIT Kharagpur, Kharagpur, West Bengal, India
A Systematic Approach for Selecting Trajectories for Data Augmentation
Jun 9, 2026Adam NordlingSynthetic Data Augmentation Data Augmentation
SSAFE: Simple and Strong AI-Generated Image Detection via Frozen Vision Encoders
Jun 7, 2026Seunghyun Lee, Byoungkwon Kim, Jaehyun Nam +2Domain Generalization Training Data Selection
1KAIST · † Work done at KAIST. · 2Google Cloud AI
Temporal Coverage over Density: Parsimonious Training-Set Design for ML Climate Downscaling
Jun 5, 2026Karandeep Singh, Stefan Rahimi, Chad W. Thackeray +2Surrogate Modeling Climate Science
Atmospheric and Oceanic Sciences, University of California, Los Angeles, CA, USA · Department of Atmospheric Science, University of Wyoming, WY, USA
LIMMT: Less is More for Motion Tracking
Jun 5, 2026Yu Guan, Zekun Qi, Chenghuai Lin +7Training Data Selection Humanoid Motion Tracking
1Tsinghua University · 2GalBot · 3Shanghai Jiao Tong University +2
HARP: Efficient Data Selection for Finetuning Large Language Models
Jun 5, 2026Ning Wang, Zhengxin Zhang, Maosen Tang +3LLM Fine-Tuning Active Learning
Cornell University · The Hong Kong University of Science and Technology

Jul 28, 2026, cs.LGJ/K move · Enter open · S save

Anti-Backdoor Coreset Selection via Cumulative Entropy

Qi Zhao, Christian Wressnegger

KASTEL Security Research Labs, Karlsruhe Institute of Technology (KIT)

Neural Network Robustness Training Data Selection Backdoor Defense Coreset Selection

Open paper AskPDF arXiv

Recent training-time defenses against neural backdoors isolate a benign subset from poisoned training data, to learn a backdoor-free model from it. In this paper, we formulate this defense strategy as a coreset selection problem, giving rise to so-called "Anti-Backdoor Coreset Selection." Since poisonous samples have (a) lower prediction uncertainty and are (b) less frequent than benign samples, coreset selection naturally focuses more on samples associated with benign functionality than the backdoor functionality. We use the Cumulative Entropy as selection criterion to further facilitate this effect. The metric tracks the learning dynamics of training samples and allowing us to select benign samples with high informativeness for the coreset. Additionally, we unlearn the chosen samples in each epoch to facilitate the separability between benign and poisonous samples. Together, this yields an exceptionally effective training-time defense that constructs a benign coreset to train a backdoor-free model. Unlike prior defenses that compromise natural accuracy and fail against certain attacks, our method mitigates backdooring attacks consistently with a negligible impact on natural performance.

Momentum

Related topics

Latest papers 128