LLM Agent Training

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

54 papers in the last four weeks, up 145% on the four weeks before. 0.5% of all new papers.

Jul 13Week of Sep 28

Latest papers 354

All topics

Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs
May 17, 2026Yuxuan Lu, Ziyi Wang, Yingzhou Lu +12Tool-Augmented Language Model Agents Synthetic Data Generation
Northeastern University · Independent Researcher
OProver: A Unified Framework for Agentic Formal Theorem Proving
May 17, 2026David Ma, Kaijing Ma, Shawn Guo +7Automated Theorem Proving Lean Theorem Proving
M-A-P
FORGE: Self-Evolving Agent Memory With No Weight Updates via Population Broadcast
May 15, 2026Igor Bogdanov, Chung-Horng Lung, Thomas Kunz +3LLM Agent Memory LLM Agent Self-Improvement
Carleton University Ottawa, Ontario, Canada · Defence R&D Canada Ottawa, Ontario, Canada · Cistel Technology Ottawa, Ontario, Canada
Look Before You Leap: Autonomous Exploration for LLM Agents
May 15, 2026Ziang Ye, Wentao Shi, Yuxin Liu +6RL Exploration LLM Agents
University of Science and Technology of China · Meituan
AstraFlow: Dataflow-Oriented Reinforcement Learning for Agentic LLMs
May 15, 2026Haizhong Zheng, Yizhuo Di, Jiahui Wang +7Agentic RL Reinforcement Learning
1Carnegie Mellon University · University of Michigan · 3UC Berkeley +1
Orchard: An Open-Source Agentic Modeling Framework
May 14, 2026Baolin Peng, Wenlin Yao, Qianhui Wu +11AI Coding Agents Computer-Use Agents
Microsoft Research · Columbia University · UIUC
Video2GUI: Synthesizing Large-Scale Interaction Trajectories for Generalized GUI Agent Pretraining
May 14, 2026Weimin Xiong, Shuhao Gu, Bowen Ye +5GUI Agents LLM Agent Training
National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University
Agentifying Patient Dynamics within LLMs through Interacting with Clinical World Model
May 14, 2026Minghao Wu, Yuting Yan, Zhenyang Cai +9Agentic RL Clinical Decision Support
The Chinese University of Hong Kong, Shenzhen · Beijing Hospital
Reinforcement Learning for Tool-Calling Agents in Fast Healthcare Interoperability Resources (FHIR)
May 13, 2026Marius S. Knorr, Robert Müller, Jan P. Bremer +1Healthcare RL for Language Model Reasoning
IDM gGmbH, University Medical Center Hamburg-Eppendorf, Hamburg, Germany · Aganthos
Speculative Interaction Agents: Building Real-Time Agents with Asynchronous I/O and Speculative Tool Calling
May 13, 2026Coleman Hooper, Minwoo Kang, Suhong Moon +7Tool-Using Agents LLM Agents
University of California, Berkeley · ICSI · LBNL
MAP: A Map-then-Act Paradigm for Long-Horizon Interactive Agent Reasoning
May 13, 2026Yuxin Liu, Ziang Ye, Yueqing Sun +6LLM Agent Training Long-Horizon LLM Agents
University of Science and Technology of China · Meituan · Institution of Automation, Chinese Academy of Sciences +1
Revisiting DAgger in the Era of LLM-Agents
May 13, 2026Changhao Li, Rushi Qiang, Jiawei Huang +4Software Engineering Agents Dataset Aggregation
1Georgia Institute of Technology · 2ETH Zurich
Beyond Cooperative Simulators: Generating Realistic User Personas for Robust Evaluation of LLM Agents
May 13, 2026Harshita Chopra, Kshitish Ghate, Aylin Caliskan +3Human Behavior Simulation LLM Agent Evaluation
University of Washington, Seattle, WA · Georgetown University, Washington, DC
Learning Agentic Policy from Action Guidance
May 12, 2026Yuxiang Ji, Zengbin Wang, Yong Wang +6Agentic RL Reinforcement Learning
1Xiamen University · 2AMAP, Alibaba Group · Work done during internship at AMAP, Alibaba Group +1
AutoLLMResearch: Training Research Agents for Automating LLM Experiment Configuration - Learning from Cheap, Optimizing Expensive
May 12, 2026Taicheng Guo, Nitesh V. Chawla, Olaf Wiest +1Multi-Fidelity Optimization Large Language Model-Guided Optimization
University of Notre Dame
Towards On-Policy Data Evolution for Visual-Native Multimodal Deep Search Agents
May 11, 2026Shijue Huang, Hangyu Guo, Guanting Dong +8Multimodal IR Tool-Using Vision-Language Agents
Hong Kong University of Science and Technology · Renmin University of China · The Chinese University of Hong Kong +3
Step Rejection Fine-Tuning: A Practical Distillation Recipe
May 11, 2026Igor Slinko, Ilia Zavidnyi, Egor Bogomolov +1Supervised Fine-Tuning LLM Agent Training
JetBrains Research
DeepRefine: Agent-Compiled Knowledge Refinement via Reinforcement Learning
May 11, 2026Haoyu Huang, Jiaxin Bai, Shujie Liu +6Knowledge Editing Knowledge Augmentation for Language Models
1HKUST · 2HKBU · 3Microsoft Research Asia
EGL-SCA: Structural Credit Assignment for Co-Evolving Instructions and Tools in Graph Reasoning Agents
May 11, 2026Zike Yuan, Yukun Cao, Han Zhang +7Program Synthesis LLM Agent Training
Harbin Institute of Technology, Shenzhen, China · School of Computer Science and Technology, Xidian University · Peng Cheng Laboratory, Shenzhen, China
AHD Agent: Agentic Reinforcement Learning for Automatic Heuristic Design
May 9, 2026Haoze Lv, Ning Lu, Ziang Zhou +1Agentic RL Automated Heuristic Design
Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology · Zhongguancun Academy · The Hong Kong University of Science and Technology
CoCoDA: Co-evolving Compositional DAG for Tool-Augmented Agents
May 8, 2026Ziyang Yu, Qiyue Li, Liang ZhaoLLM Tool Use LLM Agent Training
1Emory University · 2Beijing Normal-Hong Kong Baptist University
SOD: Step-wise On-policy Distillation for Small Language Model Agents
May 8, 2026Qiyong Zhong, Mao Zheng, Mingyang Song +5LLM Agent Training On-Policy Distillation
1Zhejiang University · 2Large Language Model Department, Tencent · University of Science and Technology of China +1
LiteGUI: Lightweight GUI Agents via Multi-Solution Guided Distillation and Dual-Level Reinforcement Learning
May 8, 2026Yubin Wu, Zicheng Cai, Liping Ning +4RL for GUI Agents GUI Agents
Moore Threads AI
MedAction: Towards Active Multi-turn Clinical Diagnostic LLMs
May 8, 2026Hsin-Ling Hsu, Zizheng Wang, Donghua Zhang +9Healthcare Medical Diagnosis
1National Chengchi University · 2Georgetown University · University of Michigan +3
MedExAgent: Training LLM Agents to Ask, Examine, and Diagnose in Noisy Clinical Environments
May 8, 2026Yicheng Gao, Xiaolin Zhou, Yahan Li +2Healthcare Medical Diagnosis
University of Southern California · Arizona State University
Dual-Agent Co-Training for Health Coaching via Implicit Adversarial Preference Optimization
May 7, 2026Da Long, Lingyi Fu, Diya Michelle Rao +3Adversarial Training Multi-Agent LLM Systems
Kahlert School of Computing University of Utah · Department of Health and Kinesiology University of Utah
Same Signal, Opposite Meaning: Direction-Informed Adaptive Learning for LLM Agents
May 7, 2026Ziming Li, Jiatan Huang, Xiaoguang Guo +2LLM Agent Training Inference-Time Compute Allocation
University of Connecticut · New Jersey Institute of Technology
Recursive Agent Optimization
May 7, 2026Apurva Gandhi, Satyaki Chakraborty, Xiangjun Wang +2Agentic RL Inference-Time Scaling
Carnegie Mellon University · Amazon AGI Labs
Weblica: Scalable and Reproducible Training Environments for Visual Web Agents
May 7, 2026Oğuzhan Fatih Kar, Roman Bachmann, Yuanzheng Gong +2LLM Agent Training RL for LLM Agents
Apple
Safactory: A Scalable Agentic Infrastructure for Training Trustworthy Autonomous Intelligence
May 7, 2026Xinquan Chen, Zhenyun Yin, Shan He +38Agentic RL AI Agent Safety

May 17, 2026, cs.SEJ/K move · Enter open · S save

Firefly: Illuminating Large-Scale Verified Tool-Call Data Generation from Real APIs

Yuxuan Lu, Ziyi Wang, Yingzhou Lu, Yisi Sang+11

Northeastern University · Independent Researcher

Tool-Augmented Language Model Agents Synthetic Data Generation LLM Tool Use LLM Agent Training Synthetic Data Generation for Language Models RL for Tool Use

Open paper AskPDF arXiv

Training tool-calling agents requires large-scale trajectory data with verifiable labels, yet existing approaches either synthesize environments that diverge from real API behavior or generate tasks without ground-truth outcomes for verification. We present FireFly, a pipeline for generating verified tool-call data from real-world MCP servers. Our key insight is to invert the standard synthesis pipeline: rather than generating tasks and hoping they are solvable, we first let a strong LLM explore real APIs along graph-guided DAG structures, then synthesize tasks backward from observed outcomes, guaranteeing label correctness by construction. To handle the scale of real-world tool spaces (

{\sim}

1,000 tools), we build a pairwise tool graph and sample sub-DAGs to focus exploration on semantically coherent workflows. To address environment drift in live APIs, we construct a retrieval-augmented simulator that caches all exploration results and replays them during training and evaluation, enabling fully offline and reproducible RL. Applying this pipeline yields 5,144 verified tasks spanning 240 servers and 993 tools. A 4B-parameter model trained with GRPO on FireFly matches Claude Sonnet 4.6 on our held-out test set and shows improvements on multiple tool-calling benchmarks including Tau2-Bench, MCPMark, and MCP-Atlas.

Momentum

Related topics

Latest papers 354