LLM Agent Trajectory Synthesis

LLM: Large Language Model

Overview

This field studies how to create useful sequences of agent actions, tool calls, observations, and decisions when real interaction data is scarce. Common approaches generate tasks and executable environments, collect teacher or simulated-agent rollouts, and verify them with state checks, constraints, or outcome rubrics; the resulting data is used for supervised fine-tuning or reinforcement learning. Researchers also reuse failed trajectories through relabeling, recovery examples, and skill extraction, especially for web, GUI, terminal, API, and long-horizon tasks. A central challenge is balancing scale and diversity with reliable, learner-relevant supervision that transfers to live or unseen environments rather than teaching brittle benchmark-specific behavior.

Latest papers

CardsList

72 papers8 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. SWE-Trail: History-Guided Trajectory Collection for Coding Agent Training

    Nov 1, 2026Ziming Li, Lu Yu, Jiatan Huang +3LLM Agent TrainingLLM Agent Trajectory Synthesis

  2. FlashScript: Compiling Recurring Agent Workflows into Reusable Neuro-Symbolic Programs

    Oct 24, 2026Sadra Sabouri, Hosein Hasanbeig, Adam Sage +6LLM Agent Workflow OptimizationLLM-Based Program Synthesis

  3. ReGE: Stronger Agents through Experience Synthesis

    Oct 24, 2026Jiarong Liang, Yubo Wang, Zijie Liu +3Experience Learning for LLM AgentsLLM Agent Self-Improvement

  4. Trajectory2Gym: Decision-Grounded Compositional Interaction Synthesis for Tool-Use Agents

    Oct 24, 2026Yihao Hu, Zhihao Wen, Yitong Lin +5Tool-Using AgentsLLM Agent Trajectory Synthesis

  5. DynaWeave: Learning to Adapt through Dynamic Scenario Synthesis

    Oct 21, 2026Xuan Yang, Chunxiao Liu, Hongsheng Xin +2LLM Agent TrainingSynthetic Data Generation for LLM Agents

  6. GRADUS: Discovering and Recovering Agent Lessons from the Environment's Latent Syllabus

    Oct 20, 2026Qing Ping, Wei Yang, Panpan Xu +4LLM Agent TrainingLLM Agent Trajectory Synthesis

  7. DataPraxis: Scaling Analytics Tasks via Verified Workspace Evolution

    Oct 17, 2026Nan Jia, Wenxuan Shi, Jingqing Ruan +11Data Analysis AgentsSynthetic Data Generation for LLM Agents

  8. SWE-Stream: Scaling Executable Training Data for SWE Agents via Progressive Construction and Elastic Streaming

    Oct 14, 2026Chengyang Liu, Wen Yang, Shifeng Chen +5Software Engineering AgentsLLM Agent Training

  9. Interlock: From Local Correctness to Task Completion in Long-Horizon Agents

    Oct 14, 2026Linji Hao, Yanji He, Zihan Wang +6Long-Horizon Agent TasksLLM Agent Trajectory Synthesis

  10. Encounter-Driven City-Scale Human Mobility Generation with Large Language Models

    Oct 13, 2026Chao Li, Renhe Jiang, Chuan Xiao +1Human Behavior SimulationLLM Agent Trajectory Synthesis

  11. WorkBorne: Discovering Agentic Tasks from Real-World Artifact Transitions

    Oct 10, 2026Junyi Zhou, Yufei Wang, Qiyuan Zhang +7LLM Agent Trajectory SynthesisLong-Horizon Agent Tasks

  12. ClawLoop: Self-Improving Agents via Harness-Native Training Loop

    Oct 9, 2026Hansi Yang, Linji Hao, Hongyan Hao +4LLM Agent TrainingSelf-Improving Agents

  13. Scaling Agentic Data for Long-Horizon Terminal Intelligence

    Oct 9, 2026Shun Zou, Ziyu Ma, Yi Zou +6Synthetic Data Generation for LLM AgentsLong-Horizon LLM Agents

  14. ToolRACER: A Robust Agentic Conversation Emulation Resource for Agent Training and Evaluation

    Oct 6, 2026Arkajyoti Chakraborty, Aryan Tayal, Ishika Agarwal +5Tool-Using AgentsAI Agent Benchmarks

  15. GAMEGO: Training Game-Dev Agents with Synthetic Trajectories Anchored in Real-World Assets

    Oct 2, 2026Haoyue Yang, Jingyao Li, Zhengfan Wu +3Agentic Code GenerationSynthetic Data Generation for Language Models

  16. Scaling Trajectories for Complex Tasks through Recursive Self-Rewrite

    Oct 2, 2026Zongxia Li, Yucheng Shi, Zhongzhi Li +7LLM Agent Trajectory SynthesisSelf-Training for Language Models

  17. SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation

    Sep 29, 2026Renxi Wang, Mingshan Hee, Fajri Koto +2Supervised Fine-TuningLLM Agent Skill Learning

  18. A Wrong Turn Does Not Ruin the Journey: Deviation-Guided Skill Self-Evolution for LLM Agents

    Sep 24, 2026Yichun Feng, Jiawei Wang, Haozhe SunLLM Agent Self-ImprovementLLM Agent Skill Learning

  19. MimicAgent: Quadruped Skills via Prompt-to-Trajectory Generation

    Sep 21, 2026Lucky Kant Nayak, Narayanan Palghat Parameswaran, Neehar Peri +1Reinforcement LearningTrajectory Generation

  20. Constructing and Evaluating Clinical Reasoning Trajectories for Medical Agent

    Sep 4, 2026Yunqi Zhu, Wen Tang, Jinghao Niu +2Trajectory-Based EvaluationReasoning Evaluation

  21. EnvCraft: Synthesizing Executable Environments in Agentic RL for Claw-like Agent

    Sep 4, 2026Yirong Zeng, Shen You, Jinhang Feng +8LLM Agent TrainingAgentic RL

  22. Terminal-Universe: Turning Agent Trajectories into Scalable Terminal Environments

    Sep 3, 2026Jie Wu, Zhenru Zhang, Beichen Zhang +11Software Engineering AgentsLLM Agent Trajectory Synthesis

  23. SimCRAFT: Distilling Remote Sensing Agents via Synthetic Trajectories and Contextual Retrieval-Augmented Fine-Tuning

    Aug 31, 2026Haoran Wang, Jing Yao, Xu Yang +4Fine-TuningRemote Sensing