LLM Agent Training

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

54 papers in the last four weeks, up 145% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 354

All topics

Environmental Feedback Modeling Matters: Rethinking Feedback Treatment in Agentic Hindsight Self-Distillation
Oct 8, 2026Hangxi Guo, Fengyuan Liu, Yue Wang +4LLM Agent Training Self-Distillation
The Chinese University of Hong Kong, Shenzhen · Shanghai AI Laboratory · University of Science and Technology of China +2
StoreBench: A Live-Commerce Environment for Evaluating and Training Autonomous Operator Agents
Oct 7, 2026Daksh Raghuvanshi, Ved Vedere, Yifan WangAI Agent Benchmarks Long-Horizon LLM Agents
AfterQuery
SOTA: Stock Options Trading Agents Guided by Option-Implied Return Distributions
Oct 7, 2026Yizhen Xie, Mengyang LiuAlgorithmic Trading Quantitative Finance
Carnegie Mellon University · Amazon
Training Advisors for LLM Agents from Task Outcomes
Oct 7, 2026Sergei Polezhaev, Barys Liskavets, Ori Press +1LLM Agent Training RL for LLM Agents
Nebius AI
MIMESIS: Learning User Simulators as Training Environments for Interactive Agents
Oct 7, 2026Hoang Phan, Dat Huynh, Andrey Zhmoginov +7User Simulation LLM Agent Training
Meta Superintelligence Labs · New York University · University of Wisconsin - Madison
Verify Less, Evolve More: Training Idea-Level Critics for Verification-Efficient ML Evolving Agents
Oct 6, 2026Jiamu Bai, Lizhu Zhang, Xin Yu +9LLM Agent Training
Penn State University · Meta
GraphOPD: Graph-Augmented On-Policy Distillation for LLM Agents
Oct 6, 2026Bohan Lin, Liyi Chen, Zhuoning Guo +5LLM Agent Training On-Policy Distillation
University of Science and Technology of China · Xiaohongshu · The Hong Kong University of Science and Technology (HKUST-GZ)
AdvSim2Real : Training Web Agents Against Adaptive Prompt Injection in a Web World Model
Oct 6, 2026Sarim Hashmi, Mukul Ranjan, Kshitij Mishra +3Adversarial Training Sim-to-Real Transfer
Mohamed bin Zayed University of Artificial Intelligence · Amazon · Massachusetts Institute of Technology
RAISED: Self-Distillation for Robustness to Prompt Injection in LLM Agents
Oct 5, 2026Mohamed Dhouib, Clement Elliker, Alexi Canesse +5Prompt Injection Defense LLM Agents
LIX, École polytechnique, Institut Polytechnique de Paris, CNRS · AMIAD (Agence Ministérielle pour l’IA de Défense) · IRT SystemX +1
Imagine to Act: High-Fidelity Data Synthesis via Image Editing World Model for Scalable GUI Agent Training
Oct 5, 2026Yongxin Ning, Runliang Niu, Qianli Xing +4World Models Synthetic Data Generation
School of Artificial Intelligence, Jilin University · College of Computer Science, Jilin University · OPPO
Selecting Long-Horizon Trajectories for Reliable and Efficient Terminal-Agent Training
Oct 5, 2026Cuong Dang, Hoang Anh Just, Ruoxi JiaSupervised Fine-Tuning Trajectory Generation
Department of Electrical and Computer Engineering Virginia Tech Blacksburg, VA, USA
Sibyl: An Efficient Small-large Model Collaboration Framework for Long-horizon Tasks
Oct 4, 2026Zhewei Fang, Yuxin Zhang, Zhenwei Shao +8LLM Agent Training Long-Horizon LLM Agents
Hangzhou Dianzi University · Fudan University · The Hong Kong University of Science and Technology +3
ASCENT: Online Test-Time Training of Long-Horizon Agents via Self-Distillation of Verified Experience
Oct 4, 2026Haodong Lu, Dong GongContinual Learning for LLM Agents Test-Time Training
University of New South Wales (UNSW Sydney)
Harness Annealing: Learning to Act with Less External Control
Oct 1, 2026Yingxuan Yang, Huacan Chai, Ying WenLanguage Model-Based Control Agent Harness Optimization
Shanghai Jiao Tong University · University of California, Berkeley
Federated Agent Optimization
Oct 1, 2026Qiang Yang, Zhiqiang Kou, Xueyi Zhang +6LLM Agent Training Federated Learning
The Hong Kong Polytechnic University, Hong Kong SAR, China · National University of Singapore, Singapore · The University of Tokyo, Japan +2
It Takes Workflows to Evolve Better Workflows
Oct 1, 2026Xuehang Guo, Haoyu Wang, Haifeng Chen +3LLM Agent Workflow Optimization Multi-Agent Collaboration
William & Mary · NEC Corporation of America · University of Illinois Urbana-Champaign
PG-SFT: Balancing Capability Acquisition and Retention in Offline Agent Fine-Tuning
Oct 1, 2026Ronghua Li, Zi Liang, Zhishan Li +1Supervised Fine-Tuning LLM Agent Training
The University of Hong Kong · The Hong Kong Polytechnic University · Independent Researcher
PivotOPD: Learning to Recover from Pivotal Mistakes in Multi-Turn Agents
Sep 30, 2026Yinghui He, Yapei Chang, Khushi Bhardwaj +4Language Model Distillation LLM Agent Training
Princeton University · NVIDIA · University of Maryland
ComputerSD: Online Self-Distillation from Real-Time Feedback for Computer-Use Agents
Sep 30, 2026Yong Du, Tongbo Chen, Zhengxi Lu +5On-Policy Self-Distillation Computer-Use Agents
Zhejiang University · Ant Group
PhantomEnvironments: Training LLM Agents in Fictional Worlds
Sep 30, 2026Anmol Kabra, Swathi Saravana Selvam, Albert Gong +5Multi-Hop QA Reinforcement Learning
Cornell University · Stanford University
Agent Error Dataset: Scaling 50,000 Error--Diagnosis Pairs for Failure Analysis and Error-Aware Post-Training
Sep 30, 2026Kunlun Zhu, Xuyan Ye, Yibo Li +3Agent Failure Analysis LLM Agent Training
Apodex
Learning Reliable GUI Agents under Imperfect Priors
Sep 30, 2026Bo Han, Qianyi Wang, Shuai Liu +9GUI Agents LLM Agent Training
Xi’an Jiaotong University · MiLM Plus, Xiaomi Inc.
WorkGenesis: Building the Worlds That Teach Agents to Work
Sep 30, 2026Xinyu Zhu, Fenyi Liu, Yuzhu Cai +4LLM Agent Training Synthetic Data Generation for Language Models
Shanghai Jiao Tong University · Endless Frontier · Beihang University
GraphForge: Training Working Agents with Graph-Anchored Workspace Synthesis
Sep 30, 2026Qisheng Su, Hanchen Wang, Guanru Zhu +10AI Agent Benchmarks LLM Agent Training
University of Science and Technology of China · Shanghai Innovation Institute · Fudan University +1
Explicit Trajectory Diversity for RL-Based Post-Training of LLM Agents
Sep 30, 2026Huaiyu Fu, Heng Cao, Hao Wang +2LLM Agent Training RL Post-Training
Microsoft
GraphCert: Bootstrap Agentic Graph Reasoning with Certified Evidence Rubrics
Sep 30, 2026Weiqi Jiang, Yuchen Ying, Rui Wang +5LLM Reasoning with Graphs RL for Language Model Reasoning
Zhejiang University, Hangzhou, China · Nanyang Technological University, Singapore · Hangzhou City University, Hangzhou, China
EVOKE: Eliciting World Knowledge in Agents for Transferable Decision-Making
Sep 29, 2026Yuhan Guo, Jinming Liu, Liang Xu +8LLM Agent Training Generalization in RL
Shanghai Jiaotong University · Eastern Institute of Technology, Ningbo · Zhongguancun Academy, Beijing, China +1
Character Training for Risk-Averse Agents
Sep 29, 2026Arav Dhoot, Punya Syon Pandey, Jamie Johnson +3Risk-Sensitive RL AI Agent Safety
UK AI Security Institute · Resolution
HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents
Sep 29, 2026Tongbo Chen, Junbo Niu, Zhengxi Lu +8Computer-Use Agents GUI Agents
Zhejiang University · Peking University · Tsinghua University
AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks
Sep 29, 2026Hongjin Qian, Chaofan Li, Kun Luo +11LLM Self-Refinement LLM Agent Training
Beijing Academy of Artificial Intelligence (BAAI)
AnthroDial: Benchmarking LLM Anthropomorphism in Autonomous Social Interaction
Sep 29, 2026Wentao Liu, Xi Chen, Siyu Song +13LLM Agent Evaluation LLM Agent Training
Shanghai Institute of Innovation · University of Science and Technology of China · East China Normal University +9
SkillGym: Training Skill-Use Agents with Automatic Verifiable Environment Generation
Sep 29, 2026Renxi Wang, Mingshan Hee, Fajri Koto +2Supervised Fine-Tuning LLM Agent Skill Learning
Mohamed bin Zayed University of Artificial Intelligence
MLToolBench: Learning Tool-Augmented Agents for Machine Learning Development
Sep 29, 2026Xin Yu, Lizhu Zhang, Jiamu Bai +7LLM Agent Skill Learning AI Agent Benchmarks
Towards Communication-Efficient Social Intelligence in Language Agents
Sep 28, 2026Linxiao Gong, Yijie Xu, Tianfu Wang +7LLM Agents LLM Agent Training
The Hong Kong University of Science and Technology (Guangzhou) · University of Science and Technology of China · The Hong Kong University of Science and Technology
EvoIn: Bridging Evolution and Internalization for Agent Fine-Tuning
Sep 28, 2026Shihan Dou, Shaofan Liu, Zhonghang Lu +8LLM Agent Training Self-Improving Agents
Fudan University · Renmin University of China
Action-Space Shaping for LLM Agents: Measuring and Mitigating Tool-Schema Bias
Sep 28, 2026Yinhong Liu, Zhili Tan, Zilin Wang +1LLM Agent Evaluation LLM Tool Use
University of Cambridge · Yinwang · Huawei +2
Just-In-Time Agent Memory with Runtime Agentic Research
Sep 28, 2026Bingyu Yan, Chaofan Li, Hongjin Qian +3Agent Memory Agentic RAG
Beijing Academy of Artificial Intelligence · Peking University · Hong Kong Polytechnic University
When Successful Strategies Fail: Adaptation to Environmental Novelty in Terminal Agents
Sep 27, 2026Janvijay Singh, Vaishnavi Shrivastava, Dilek Hakkani-Tur +2Long-Horizon Agent Evaluation AI Agent Benchmarks
University of Illinois Urbana-Champaign · Microsoft Research AI Frontiers
Skill2Env: Capability-Oriented Environment Synthesis from Skills for General Agents
Sep 27, 2026Weiyi Xu, Xiaowen Yang, Wen Da +7Tool-Using Agents LLM Agent Trajectory Synthesis
AllSpark Team
CompoWorld: Compositional Environment Scaling for General Agents
Sep 27, 2026Xiao-Wen Yang, Weiyi Xu, Wen Da +9Tool-Augmented Language Model Agents Tool-Using Agents
AllSpark Team
ParaAgent: Reinforcing Parallel Acting in Open-World Tool Environments
Sep 27, 2026Shengbin Yue, Hongru Wang, Siyuan Wang +3LLM Agent Training Tool Use
Fudan University · University of Edinburgh · Chinese University of Hong Kong +3
SCLATE: a Substrate for Continual-Learning Agent Training and Evaluation
Sep 26, 2026Youngmok Jung, Sirajul Salekin, Henry Tran +3Continual Learning for LLM Agents Long-Horizon Agent Evaluation
Apple
PUBG Ally: A Conversational Embodied Agent as an AI Teammate
Sep 24, 2026Beomsoo Kim, Byeongju Kim, Dohyun Kim +21Game-Playing Agents AI Agent Evaluation
Breaking the Environment Wall: A Unified Framework for Preparing and Evolving Agent-Native Environments
Sep 24, 2026Yukai Wu, Yuanjing Yang, Le Zhou +8LLM Agent Self-Improvement LLM Agent Training
Shanghai Jiao Tong University · Theseus Labs · Tencent Hunyuan
From Self-Distillation to Self-Practice: Privileged Information for Multi-Turn Agents
Sep 24, 2026Xingyu Su, Abhishek Kumar, Qing Ping +5On-Policy Self-Distillation LLM Agent Training
Texas A&M University · AWS AI, Amazon
Forecast-Dojo: Replayable Environments for Benchmarking and Training LLM Forecasting Agents
Sep 24, 2026Liqin Ye, Haorui Wang, Fardin Ahmed +8LLM Agent Evaluation Forecasting Benchmarks
Georgia Institute of Technology · Amazon · University of Florida
The Fellowship of the Query: Learning Retrieval Actions
Sep 23, 2026Mohammed Al-Maamari, Saber Zerhoudi, Michael Granitzer +1LLM Fine-Tuning Agentic RAG
University of Passau Passau, Germany
Agent-Editing World Model: Rethinking World Modeling for LLM Agents
Sep 23, 2026Shuang Sun, Guoxin Chen, Fanzhe Meng +6LLM World Models World Models
Gaoling School of Artificial Intelligence, Renmin University of China
SkillGym: Internalizing Human Skills into LLMs for Real-World Problem Solving
Sep 23, 2026Zhilong Ge, Yuting Shao, Yutao Yang +6Tool-Augmented Language Model Agents LLM Agent Skill Learning
School of Computer Science and Technology, East China Normal University, Shanghai · Shanghai AI Laboratory
Verifiable Hidden Dynamics Play: Generating Agentic RL Environments from Solved Mechanisms
Sep 23, 2026Xinjie Shen, Wei Fan, Xudong Guo +5Agentic RL Reinforcement Learning
Georgia Institute of Technology · Alibaba Token Foundry, Alibaba Group
Grow the Harness, Not the Context: From Strategy-Free Scaffolds to Reusable Specialist Agents
Sep 22, 2026Laizhen Li, Jiarui Li, Juanjuan Zhao +4Agent Harness Optimization LLM Agent Workflow Optimization
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Shenzhen University of Advanced Technology +1
The Tasteful Agent: Measuring and Improving Taste in Long-Horizon Tasks
Sep 22, 2026Wenbo Pan, Zhichao Liu, Shujie Liu +6Software Engineering Benchmarks Long-Horizon Agent Evaluation
City University of Hong Kong · Microsoft · Independent Researcher
Harness-Zero: Harness Distillation via Agent-as-Harness
Sep 21, 2026Haoran Ye, Yuxing Lu, Haonan Dong +2LLM Agent Training Knowledge Distillation
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · College of Future Technology, Peking University · Google +1
Dependency-Aware Trajectory Refinement for Efficient Multi-Turn Agent Fine-Tuning
Sep 16, 2026Zhuo Chen, Zhen Zhang, Xinyu Wang +1LLM Inference Efficiency LLM Agent Workflow Optimization
Shanghai Engineering Research Center of Intelligent Vision and Imaging
SFT or RL for Tool-Calling Agents? A Controlled Study Across Data, Method, and Scale
Sep 15, 2026Md Tahmid Rahman Laskar, Xue-Yong Fu, Shashi Bhushan TNSupervised Fine-Tuning LLM Tool Use
Dialpad Inc.
Atria Dawn: The Dawn of Agentic Superintelligence
Sep 14, 2026Honglin Guo, Tao Gui, Kun Cai +140AI Agents for Scientific Discovery AI Agent Benchmarks
Occamy-1.0: Open Pareto-frontier 35B Intelligence for Co-work
Sep 14, 2026Wenhui Chen, Shiwen Cheng, Hao Dong +40LLM Agent Training LLM Post-Training
AMDKernelVault: Large-Scale Datasets and Agentic Training for AMD GPU Kernel Optimization
Sep 14, 2026Ji Liu, Saptarshi Majumder, Yiqing Huang +14GPU Kernel Optimization Large Language Model-Guided Optimization
Advanced Micro Devices, Inc.
Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents
Sep 14, 2026Pengyang Zhou, Xiaobin Tu, Zhengxi Liu +7Low-Rank Adaptation LLM Agent Training
Alibaba Cloud
BlueLM-GUI Technical Report: A Real-Device-Centric Flywheel for Self-Improving Mobile GUI Agents
Sep 11, 2026Tong Ye, Kunyang Han, Guozhi Wang +40Mobile GUI Automation GUI Agents

Oct 8, 2026, cs.AIJ/K move · Enter open · S save

Environmental Feedback Modeling Matters: Rethinking Feedback Treatment in Agentic Hindsight Self-Distillation

Hangxi Guo, Fengyuan Liu, Yue Wang, Yuhua Qi+3

The Chinese University of Hong Kong, Shenzhen · Shanghai AI Laboratory · University of Science and Technology of China+2

LLM Agent Training Self-Distillation Self-Training for Language Models

Open paper AskPDF arXiv

Reinforcement learning is commonly used to train language agents in interactive environments, but cannot be directly applied when rewards are unavailable. Recent methods use environmental feedback as privileged context for hindsight self-distillation, but our analysis suggests that simply conditioning the teacher on feedback is insufficient, motivating us to rethink how environmental feedback is used in agentic self-distillation. Given that environmental feedback contains rich supervision for modeling how the environment responds to agent actions, we introduce \textit{agentic SElf-distilLation with environmental Feedback modeling} (SELF), a framework that jointly optimizes environmental feedback modeling and hindsight self-distillation. SELF learns to predict environmental responses while distilling guidance from a feedback-conditioned self-teacher into the policy. Our analysis reveals a mutually reinforcing mechanism: environmental feedback modeling strengthens hindsight supervision and policy learning, while self-distillation enhances the model's ability to model environmental feedback. With Qwen3-8B, SELF outperforms SDPO and GRPO by 6.4 and 4.1 percentage points in

τ

-bench success rate, and by 10.71 and 3.57 percentage points in AppWorld task goal completion, respectively. These results show that SELF uses environmental feedback more effectively within agentic self-distillation, improving agent capabilities.

Momentum

Related topics

Latest papers 354