cs.CLJul 7, 2026

CurateEvo: Data-Curation Evolving for Agentic Post-Training

Authors: Dingzirui WangXuanliang ZhangKeyan XuQingfu ZhuWanxiang Che

Organizations: Harbin Institue of Technology

Abstract

Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and τ^2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.

Explore similar work

CardsList
  1. Can Generalist Agents Automate Data Curation?

    Jun 2, 2026Feiyang Kang, Hanze Li, Adam Nguyen +5Data-CurationAgentic Benchmarks

  2. OpenThoughts-Agent: Data Recipes for Agentic Models

    Jun 23, 2026Negin Raoof, Richard Zhuang, Marianna Nezhurina +47Data-CurationRecipe