cs.SENov 16, 2026

Operating an Agent-Driven Dataset Factory: Discovery, Construction, and Public Release

Authors: Eduardo Ariño de la Rubia, Szilard Pafka

Organizations: Central European University · Epoch

Abstract

Turning public data into prediction datasets requires connecting source discovery, task definition, construction, and distribution. We deployed Dataset Factory to perform these steps continuously under a standing release policy. Bounded language-model tasks interpret sources, write construction code, and review task meaning; deterministic software manages state, workers, retries, and publication. Over 81.53 hours, the factory published 14 datasets at an estimated recurring operating expenditure of about $2.74 per publication. The accounting includes failed attempts, inference, workers, and hosting. Separate agents completed prediction experiments on all twelve evaluated releases. Source review nevertheless identified a task whose construction filters contradicted its population declaration. The original reviewer accepted later-record exclusions without reconciling them with the published selection rule. This experience documents an operating source-to-release workflow and shows why successful execution and consumer use need separate checks of task meaning.

Figures & tables

Explore similar work

CardsList
  1. Agents Propose, Code Verifies, Humans Decide: Verified Agentic Ingestion of Heterogeneous Scientific Tables into Relational Databases

    Nov 8, 2026Bharatha Rankothge, Suzanne Hodgkins, Virginia Rich +1Data IntegrationLLM Agent Verification

  2. DataPraxis: Scaling Analytics Tasks via Verified Workspace Evolution

    Oct 17, 2026Nan Jia, Wenxuan Shi, Jingqing Ruan +11Data Analysis AgentsSynthetic Data Generation for LLM Agents

  3. From Intent to Improvement: Agentic Dataset Search for Better Model Training

    Oct 29, 2026Qiaosheng Chen, Kaijia Huang, Fanqi Zhou +1Agentic RetrievalInformation Retrieval