cs.SEFeb 27, 2026

Steerable Instruction Following Coding Data Synthesis with Actor-Parametric Schema Co-Evolution

Authors: Tinglin Huang, Bo Chen, Xiao Zhang, Kai Shen, Rex Ying

Organizations: Yale University · ByteDance Seed

Abstract

Interpreting and following human instructions is a critical capability of large language models (LLMs) in automatic programming. However, synthesizing large-scale instruction-paired coding data remains largely unexplored and is particularly challenging when ensuring logical compatibility among multiple constraints. In this study, we propose IFCodeEvolve, an actor-schema co-evolution framework for instruction following coding data generation. By representing instructions as parametric function schema, we construct a library that covers the vast instruction space via dynamic constraint instantiation. Building upon this, Monte Carlo Tree Search (MCTS) sampler is applied to efficiently navigate this space, utilizing actor model feedback as a dynamic termination signal. Furthermore, to progressively explore challenging problems, we introduce a co-evolving paradigm that iteratively advances both the actor model and the schema library, via schema composition and mutation, based on sampler statistics. Empirical results demonstrate that IFCodeEvolve significantly boosts base model performance, with our 32B model achieving parity with proprietary SOTA models. Additionally, we contribute IFCodeBench, a comprehensive human-verified benchmark equipped with solutions and robust AST-based verification.

Explore similar work

CardsList
  1. FrontierSmith: Synthesizing Open-Ended Coding Problems at Scale

    May 14, 2026Runyuan He, Qiuyang Mang, Shang Zhou +14Synthetic Benchmark GenerationSynthetic Data Generation for Language Models

  2. SEIF: Self-Evolving Reinforcement Learning for Instruction Following

    May 8, 2026Qingyu Ren, Qianyu He, Jiajie Zhu +7RL for Language ModelsReinforcement Learning

  3. SEMAG: Self-Evolutionary Multi-Agent Code Generation

    Mar 16, 2026Yulin Peng, Haowen Hou, Xinxin Zhu +2Agentic Code GenerationLLM Code Generation