Training Data Curation

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, up 80% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 104

All topics

Exploring the Scale and Diversity of Speech Anti-spoofing Datasets: Experiments and Analysis
Jun 6, 2026Zhuolin Yi, Jun Xue, Yanzhen Ren +5Training Data Curation ASVspoof
School of Cyber Science and Engineering, Wuhan University, China
Unlocking Latent Value: Taxonomy-Guided Recovery of High-Performing Data from Low-Tier Web Corpora
Jun 5, 2026Neeraj Varshney, Sanket Lokegaonkar, Nasser Zalmout +3Language Model Pretraining Training Data Curation
Amazon
DataEvolver: Automatic Data Preparation for Large Language Models through Multi-Level Self-Evolving
Jun 5, 2026Chao Deng, Shaolei Zhang, Ju Fan +1Training Data Curation LLM Training
Renmin University of China, Beijing, China
MyGardenBird: A Machine-Learning-Ready Bird Sound Dataset for Twelve Common Malaysian Birds
Jun 5, 2026Muhammad Mun'im Ahmad Zabidi, Mohd Yamani Idna Idris, Norisma IdrisTraining Data Curation Bioacoustics
Faculty of Computer Science and Information Technology, Universiti Malaya, 50603 Kuala Lumpur, Malaysia · Faculty of Electrical Engineering, Universiti Teknologi Malaysia, 81310 Johor Bahru, Johor, Malaysia
"Chi nas dal soch el sent de legn" -- Auditing Text Corpora for Lombard
Jun 4, 2026Edoardo Signoroni, Pavel RychlýTraining Data Curation Low-Resource Language Processing
NLP Centre, Faculty of Informatics
Epistemic Injustice in Language Models: An Audit of Pretraining Filters and Guardrails
Jun 4, 2026Marco Antonio Stranisci, A Pranav, Rossana Damiano +2LLM Guardrails Training Data Curation
University of Turin, Italy · Trustworthy AI Lab, University of Hamburg, Germany · IT University of Copenhagen, Denmark
Can Generalist Agents Automate Data Curation?
Jun 2, 2026Feiyang Kang, Hanze Li, Adam Nguyen +5AI Coding Agents Training Data Curation
1Virginia Tech · University of Illinois Urbana-Champaign · University of Wisconsin-Madison +1
JAVEDIT: Joint Audio-Visual Instruction-Guided Video Editing with Agentic Data Curation
Jun 2, 2026Yinan Chen, Chuming Lin, Zhennan Chen +12Video Editing Benchmarks Training Data Curation
1Zhejiang University · 2Tencent Youtu Lab · 3Nanjing University +3
Demystifying Data Organization for Enhanced LLM Training
May 28, 2026Yalun Dai, Yangyu Huang, Tongshen Yang +8Language Model Pretraining Training Data Curation
Nanyang Technological University · Microsoft Research · The Hong Kong University of Science and Technology
Methodology for Creating a Clinically Verified Dermoscopic Image Dataset
May 24, 2026Kozachok Elena SergeevnaTraining Data Curation Medical Image Benchmarks
Ivannikov Institute for System Programming of RAS, Moscow, Russia
Is a Document Educational or Just Wikipedia-Style? -- Pitfalls of Classifier-Based Quality Filtering
May 21, 2026Mateusz Klimaszewski, Piotr AndruszkiewiczLanguage Model Pretraining Training Data Curation
Warsaw University of Technology · 2IDEAS Research Institute
MONET: A Massive, Open, Non-redundant and Enriched Text-to-image dataset
May 20, 2026Benjamin Aubin, Gonzalo Iñaki Quintana, Onur Tasar +4Training Data Curation T2I Generation
Jasper Research
SEABAD: A Tropical Bird Activity Detection Dataset for Passive Acoustic Monitoring
May 20, 2026Muhammad Mun'im Ahmad Zabidi, Mohd Yamani Idna Idris, Norisma IdrisTraining Data Curation Sound Event Detection
Faculty of Computer Science and Information Technology, Universiti Malaya, Kuala Lumpur, Malaysia
OpenSeisML: Open Large-Scale Real Seismic and well-log Dataset for Generative AI
May 19, 2026Ipsita Bhar, Huseyin Tuna Erdinc, Thales Souza +2Synthetic Data Generation Training Data Curation
Georgia Institute of Technology, Atlanta, USA · Osokey Ltd, Henley-on-Thames, UK
A Bitter Lesson for Data Filtering
May 19, 2026Christopher Mohri, John Duchi, Tatsunori HashimotoLanguage Model Pretraining Training Data Curation
Department of Computer Science Stanford University · Departments of Statistics and Electrical Engineering Stanford University
Be Kind, Rewrite: Benign Projections via Rewriting Defend Against LLM Data Poisoning Attacks
May 18, 2026John T. Halloran, Noopur S. BhattLLM Backdoor Attacks Training Data Curation
Leidos · University of Pennsylvania
SomaliWeb v1: A Quality-Filtered Somali Web Corpus with a Matched Tokenizer and a Public Language-Identification Benchmark
May 18, 2026Khalid Yusuf DahirLanguage Identification Training Data Curation
Independent researcher
A Multi-Dimensional Clustering Approach for Identifying Inborn Errors of Immunity
May 16, 2026Nishad Kulkarni, Alexandra K. Martinson, Nicholas L. Rider +2Rare Disease Diagnosis Training Data Curation
Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital, Washington, DC 20010 · Childrens National Hospital, Washington, DC · School of Medicine and Health Sciences, George Washington University, Washington, DC 20052 +2
SEED: Targeted Data Selection by Weighted Independent Set
May 15, 2026Yuan Zhang, Lifeng Guo, Junwen Pan +5Training Data Curation Instruction-Tuning Data Selection
School of Computer Science, Peking University · Beijing University of Posts and Telecommunications · Tianjin University +2
FSD50K-Solo: Automated Curation of Single-Source Sound Events
May 13, 2026Ningyuan Yang, Sile Yin, Li-Chia Yang +4Training Data Curation Audio Understanding
Electrical & Computer Engineering Stony Brook University Stony Brook, NY, USA · Research Bose Corporation Framingham, MA, USA
From Instance Selection to Fixed-Pool Data Recipe Search for Supervised Fine-Tuning
May 13, 2026Haodong Wu, Jiahao Zhang, Lijie Hu +1Supervised Fine-Tuning Training Data Curation
The Hong Kong University of Science and Technology (Guangzhou) · Mohamed bin Zayed University of Artificial Intelligence
CIDR: A Large-Scale Industrial Source Code Dataset for Software Engineering Research
May 12, 2026Vladislav SavenkovSoftware Engineering Training Data Curation
Fermatix AI
20/20 Vision Language Models: A Prescription for Better VLMs through Data Curation Alone
May 12, 2026DatologyAI, :, Siddharth Joshi +32Training Data Curation Large Vision-Language Models
DatologyAI Team1
Beyond Manual Curation: Augmenting Targeted Protein Degradation Databases via Agentic Literature Extraction Workflows
May 11, 2026Yaochen Rao, Farzaneh Jalalypour, N. M. Anoop Krishnan +1Training Data Curation Document Information Extraction
Department of Computer Science and Engineering, Chalmers University of Technology and University of Gothenburg, Gothenburg, SE · Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi, New Delhi, IN
Bridging Generation and Training: A Systematic Review of Quality Issues in LLMs for Code
May 6, 2026Kaifeng He, Xiaojun Zhang, Peiliang Cai +7Training Data Curation Code Generation Evaluation
Sun Yat-sen University, China · Nanyang Technological University, Singapore, Singapore · Tongji University, Shanghai, China +1
Measuring the Sensitivity of Classification Models with the Error Sensitivity Profile
Apr 28, 2026Andrea MaurinoTraining Data Curation Tabular ML
Università degli studi di Milano Bicocca Dipartimento di Informatica, Sistemistica e Comunicazione Viale Sarca 336,20126 Milano, Italy
Wiki Dumps to Training Corpora: South Slavic Case
Apr 28, 2026Mihailo Škorić, Cosimo PalmaTraining Data Curation
University of Belgrade, Faculty of Mining and Geology · University of Pisa, Department of Computer Sciences
Learning from Medical Entity Trees: An Entity-Centric Medical Data Engineering Framework for MLLMs
Apr 28, 2026Jianghang Lin, Haihua Yang, Deli Yu +6Training Data Curation Multimodal QA
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, China · ByteDance · Northeastern University
Programming with Data: Test-Driven Data Engineering for Self-Improving LLMs from Raw Corpora
Apr 27, 2026Chenkai Pan, Xinglong Xu, Yuhang Xu +6LLM Evaluation Knowledge Augmentation for Language Models
Zhejiang University · University of Chinese Academy of Sciences · Shanghai Artificial Intelligence Laboratory
GEM: Geometric Entropy Mixing for Optimal LLM Data Curation
Apr 27, 2026Yue Min, Ziyun Qiao, Ruining Chen +1Language Model Pretraining Training Data Curation
Wizard Quant, Beijing, China · The Hong Kong University of Science and Technology, Hong Kong SAR, China · Peking University, Beijing, China +1

Jun 6, 2026, cs.SDJ/K move · Enter open · S save

Exploring the Scale and Diversity of Speech Anti-spoofing Datasets: Experiments and Analysis

Zhuolin Yi, Jun Xue, Yanzhen Ren, Yihuan Huang+4

School of Cyber Science and Engineering, Wuhan University, China

Training Data Curation ASVspoof Cross-Dataset Generalization

Open paper AskPDF arXiv

The scale of speech anti-spoofing datasets has grown exponentially over the past decade, driven by the assumption that larger data leads to better performance. However, it remains unclear whether indiscriminate scaling commensurately improves model generalization. This study challenges the "scale-first" paradigm by decoupling the impacts of training data scale versus diversity. Through experiments on representative datasets, we report two key findings: (1) Larger is not always better. Expanding data scale excessively under fixed generation methods yields negligible returns and may even degrade cross-domain generalization due to overfitting.(2) Diversity outweighs scale. A smaller composite training set featuring diverse attacks significantly outperforms larger-scale datasets with limited diversity in cross-dataset evaluations. We conclude that future dataset construction should prioritize the diversity of generation methods over scale to effectively enhance model generalization.

Momentum

Related topics

Latest papers 104