LLM Agent Training

LLM: Large Language Model

Overview

LLM agent training studies how to make language models act reliably over multiple steps, using tools, software, websites, or simulated worlds to complete tasks. Common approaches combine supervised fine-tuning on interaction traces with reinforcement learning from execution-verified outcomes, alongside distillation, preference learning, and feedback on individual steps. Researchers build executable environments and benchmarks such as SWE-bench, WebArena, Terminal-Bench, and τ²-Bench to provide repeatable practice and test tool use, coding, search, and long-horizon workflows. A central challenge is transferring gains beyond training environments while balancing task success with efficiency, safety, and robustness to changing tools and users.

Latest papers

CardsList

623 papers49 papers in the last four weeks, down 64% on the four weeks before. 0.4% of all new papers.

  1. Duopra: From Full-Duplex Conversation to Full-Duplex Agency

    Nov 19, 2026Chiyu Chen, Pengzhou Cheng, Yuezhao Ma +12LLM Agent TrainingFull-Duplex Spoken Dialogue Systems

  2. How Complete Must an Environment Be to Train a Capable GUI Agent?

    Nov 18, 2026Jingxing Wang, Teng Wang, Xingyu Lou +5GUI AgentsMobile GUI Agents

  3. MobileWeave: Program-First Synthesis of Dependency-Linked Tasks for Training Mobile GUI Agents

    Nov 18, 2026Ziyi He, Xian Wu, Qiyuan Chen +7Mobile GUI AgentsLLM Agent Training

  4. JET: Just-Enough Exploration Tuning for Efficient Tool-Calling Agents in Repository-Level Question Answering

    Nov 17, 2026Yoonho Choi, Taehyeon Han, Seonghyeon LeeLLM Agent TrainingLLM Agent Efficiency

  5. From Repositories to Training Environments: Scaling Long-Horizon Coding Agents with Environment Evolution Loop

    Nov 16, 2026Yang Tian, Tianyu Zheng, Xiyuan Yang +5LLM Agent TrainingSoftware Engineering Agents

  6. SWE-OPD: On-Policy Distillation for Agentic Coding

    Nov 16, 2026Yuhang He, Yanyu Chen, Chuanzhe Guo +11LLM Agent TrainingOn-Policy Distillation

  7. Staged Semantic Distillation: Preserving Free-Form Semantics in a Low-Compute Non-LLM Surrogate of a Staged LLM Agent

    Nov 14, 2026Zhiyang Niu, Huayuan Shen, Chuanjie Li +2Language Model DistillationLLM Agent Training

  8. daVinci-Prover: Agent-Native Mid-Training for Formal Theorem Proving

    Nov 12, 2026Wenhong Zhu, Xuefeng Li, Jiashuo Zhang +4Mid-Training for Language ModelsLarge Language Model-Guided Theorem Proving

  9. SteerDistill: Quantizing LLM Agents via Closed-Loop Teacher Steering

    Nov 10, 2026Genming Cui, Xiangyu Li, Zixu Hao +3LLM QuantizationQuantization-Aware Distillation

  10. Let the Fixer Decide: Training a Code Localizer from the Fixer's Likelihood

    Nov 9, 2026Khalil Hennara, Muhammad Hreden, Zeina Aldallal +2AI Coding AgentsCode Localization

  11. CARE-PO: Controllable Tool-Call Efficiency for LLM Agents

    Nov 9, 2026Xiaoyang Ye, Xiao Yao, Hairui Zhu +6LLM Agent TrainingLLM Agent Efficiency

  12. From Procedures to Permissions: Learning Precise Subagent Authorization from Agent Skills

    Nov 6, 2026Wenkai Yu, Ning Ding, Wentao Zhang +1LLM Agent OrchestrationTool Access Control for LLM Agents

  13. Tools Need Not Speak in Text: Latent Context Compression for Agents

    Nov 4, 2026Yuetong Liu, Zhehao Zhou, Yitong Zhang +2Context Compaction for LLM AgentsLLM Context Compression

  14. Axion 1.0: Open Agent Foundation Models, Simplified

    Nov 2, 2026Yuqi Jia, Yunjie Tian, Jiayu Zheng +4LLM AgentsLLM Agent Training

  15. NorthCUA Technical Report: Turbocharging Computer-Use Agents through Experience at Scale

    Nov 1, 2026Chaoyun Zhang, Bingxuan Li, Pinxue Guo +27Computer-Use AgentsLLM Agent Training

  16. SWE-Trail: History-Guided Trajectory Collection for Coding Agent Training

    Nov 1, 2026Ziming Li, Lu Yu, Jiatan Huang +3LLM Agent TrainingLLM Agent Trajectory Synthesis

  17. NEIGHBOR: Aligning Service Behaviour and Evidence Use in an LLM Agent for Community Resident Services

    Nov 1, 2026Zongyou Yang, Yinghan Hou, Xiaokun YangLLM Agent TrainingTool-Augmented Language Model Agents

  18. LegoEnv: Self-Evolving Agentic Environments via Modular Recombination

    Nov 1, 2026Zhuosong Jiang, Chengxu Wu, Junqi Liu +11LLM Agent TrainingProcedural Content Generation

  19. StreamDuo: A Live Commentator and a Research Agent for Unseen Games

    Oct 31, 2026Zixian Gao, Penghao Luo, Xiangcheng Cao +5Streaming Video UnderstandingLLM Agent Training

  20. MEMENTO: Learning Context Management for Long Context Processing Agents

    Oct 30, 2026Yunfan Zhang, Taehoon Hwang, Kathleen McKeown +1LLM Context ManagementContext Compaction for LLM Agents

  21. EvoMCP: Co-evolving MCP agents and training data

    Oct 30, 2026Xuanang Gao, Kepeng Lin, Xinyan Shi +6LLM Agent TrainingTool-Using Agents

  22. TraceSpec: Understanding and Improving Speculative Decoding for LLM Agents

    Oct 30, 2026Jihao Zhao, Shuaishuai Zu, Pengfei Li +4Speculative DecodingLLM Inference Efficiency

  23. EpiAgent: Epistemic Self-Play for LLM Agents

    Oct 29, 2026Xuanfa Jin, Xinyu Cui, Zhijian Ma +4LLM AgentsLLM Agent Training