Dataset Discovery

Follow this topic Ask about this topic

Latest papers

9 papers1 paper in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

ML Engineering Agents - A Data Management Perspective
Oct 12, 2026Arnab Phani, Elias Strauss, Tim Schuster +1Dataset Discovery Automated Machine Learning
BIFOLD & TU Berlin, Germany
Beyond Context Windows: Persistent Discovery Context for Data-Centric Agents
Sep 2, 2026Jalal MahmudDataset Discovery Information Retrieval
Megagon Labs Mountain View, CA, USA
On the missing data layer and a potential solution
Aug 3, 2026Francis F Daniel, Mauro Ibañez, Francis Perelman +1Dataset Discovery
1SURUS · 2Independent
DODA: A Database of Datasets for Aesthetics Research
Jul 30, 2026Lisa Koßmann, Ralf Bartho, Christoph Redies +1Personalized Image Aesthetics Assessment Dataset Discovery
Laboratory of Experimental Psychology, Department of Brain and Cognition, University of Leuven (KU Leuven), Leuven, Belgium · Leuven AI Institute, University of Leuven (KU Leuven), Leuven, Belgium · Experimental Aesthetics Group, Institute for Anatomy I, University Hospital Jena, Germany
Bringing Agentic Search to Earth Observation Data Discovery
Jul 2, 2026Minghan Yu, Youran Sun, Chugang Yi +2Agentic Search Remote Sensing
University of Maryland, College Park · University of Florida
Beyond Catalogue Counts: the Dataset Visibility Asymmetry in Low-Resource Multilingual NLP
May 17, 2026Zhiyin Tan, Changxu DuanDataset Discovery Low-Resource Language Processing
L3S Research Center, Leibniz University Hannover, Appelstraße 9A, 30167 Hannover, Germany · Technische Universität Darmstadt, Residenzschloss 1, 64283 Darmstadt, Germany
Croissant Baker: Metadata Generation for Discoverable, Governable, and Reusable ML Datasets
May 14, 2026Rafi Al Attrach, Rajna Fani, Sebastian Lobentanzer +17Dataset Discovery ML Reproducibility
Technical University of Munich · Massachusetts Institute of Technology · Helmholtz Munich +15
A Framework and Prototype for a Navigable Map of Datasets in Engineering Design and Systems Engineering
Mar 16, 2026H. Sinan Bank, Daniel R. HerberDataset Discovery Information Retrieval
Department of Systems Engineering, Colorado State University, Fort Collins, CO 80523
SeDa: A Unified System for Dataset Discovery and Multi-Entity Augmented Semantic Exploration
Mar 8, 2026Kan Ling, Zhen Qin, Yichi Zhu +3Dataset Discovery Information Retrieval
East China University of Science and Technology, Shanghai, China

Oct 12, 2026J/K move · Enter open · S save

ML Engineering Agents - A Data Management Perspective

Arnab Phani, Elias Strauss, Tim Schuster, Sebastian Schelter

BIFOLD & TU Berlin, Germany

Dataset Discovery Automated Machine Learning

Open paper AskPDF arXiv

Machine learning engineering (MLE) agents are emerging as a new paradigm for automating end-to-end ML pipeline development. Using large language models for code generation and predictive performance as a machine-gradable feedback signal, these agents iteratively synthesize, execute, and refine pipeline code. Yet current systems are largely evaluated on pre-built, single-table benchmarks that abstract away key data management challenges. This tutorial introduces the foundations of MLE agents and highlights research opportunities for the database community. We cover how agents combine program synthesis with iterative and evolutionary optimization, and discuss open challenges in efficient pipeline execution, data discovery and augmentation over heterogeneous sources, reliability and debugging, as well as fairness and compliance. We connect these challenges to existing data management techniques and conclude with a hands-on session using contemporary MLE agents.