RL for Tool Use

RL: Reinforcement Learning

Overview

This field studies how language and multimodal agents can use tools such as search, code execution, databases, APIs, and graphical interfaces to solve multi-step tasks. Common approaches combine supervised demonstrations with policy optimization, often using executable environments and rewards for task success, valid calls, and efficient execution. A major focus is improving credit assignment across long interactions through turn-level rewards, process supervision, and experience or trajectory reuse. Open challenges include preventing tool overuse and training collapse while ensuring that skills learned in simulated or cached environments transfer reliably to changing real-world tools.

Latest papers

CardsList

198 papers11 papers in the last four weeks, down 63% on the four weeks before. 0.1% of all new papers.

  1. StateAlign: Internalizing State-Aware Decision-Making for Reliable Multi-Turn Tool Agents via Reinforcement Learning

    Nov 12, 2026Zhexi Lu, Subhajit Chaudhury, Tejaswini Pedapati +2LLM Agent ReliabilityRL for Tool Use

  2. Video-as-Experience: Learning Computer Use via Audio-Visual Understanding

    Nov 11, 2026Guangzhi Sun, Zhonghao Zhai, Yixuan Li +1Computer-Use AgentsLearning from Demonstration

  3. Reframe: Observation-Aligned Multi-Teacher On-Policy Distillation for Agentic Visual Reasoning

    Nov 9, 2026Haozhi Yuan, Handong Li, Yifan Zhang +1Multi-Teacher On-Policy DistillationRL Post-Training

  4. When Credit Turns Against Tools: Transition-Aware Credit Assignment in Agentic Reinforcement Learning

    Nov 8, 2026Xiangyu Lu, Zhanke Zhou, Jiazhe Ning +3Agentic RLCredit Assignment

  5. Training Small Language Models for Transferable Tool Selection

    Oct 22, 2026Zhaoyi Zhou, Akshayaa Magesh, Jeongyeol Kwon +4Tool Selection for Language Model AgentsSmall Language Models

  6. ToolOPD: Credit-Aware On-Policy Distillation for Tool-Use Agents

    Oct 19, 2026Chu Zhao, Lei Tang, Yanming Wang +5On-Policy DistillationStep-Level Credit Assignment in RL

  7. CoworkEnv: Synthesizing Training Environments for Long-Horizon Cowork Agents

    Oct 18, 2026Zhongwei Xie, Yiming Du, Jiaxin Bai +10LLM Agent TrainingRL for Tool Use

  8. KnowGPO: Knowledge-Grouped Policy Optimization for Search Agents

    Oct 15, 2026Siqi Chen, Zhengxi Lu, Yuchen Yan +10RL for LLM AgentsReinforcement Learning

  9. Lean4AgenticRL: Advancing Agentic RL with Verifiable Multi-level Process Rewards

    Oct 15, 2026Ruida Wang, Gerald Friedland, Tong Zhang +1Agentic RLRL for Tool Use

  10. DeciCAD: Harness-Grounded Learning of Action Policies for CAD Agents

    Oct 15, 2026Yufeng Peng, Yixin Zhang, Ziyi Liu +5LLM Agent HarnessesLanguage Model-Based Control

  11. Long-Horizon RL Needs Muon

    Oct 14, 2026Kai Ruan, Jinghao Lin, Tao Chen +3Long-Horizon RLLong-Horizon LLM Agents

  12. Where to Start, How to Move: Analyzing Curricula under GRPO for Long-Horizon LLM Agents

    Oct 14, 2026Minchan Kim, Sungho Bae, Youngjin Kim +1Long-Horizon LLM AgentsCurriculum RL

  13. Teacher-Guided Tool Learning for Small Language Models via Bidirectional KL Constraints

    Oct 13, 2026Haoxuan Gao, Qin-Wen Luo, Xiang Chen +5RL for Tool UseReinforcement Learning

  14. Agent-Reflex: Teaching Language Agents to Act Reflectively

    Oct 13, 2026Guanting Dong, Xinyu Yang, Jiajie Jin +9LLM Agent TrainingSelf-Reflection in Language Model Agents

  15. X-Ragent: Tool-Augmented Reinforcement Learning for Evidence-Grounded Chest X-Ray Reasoning

    Oct 12, 2026Yi Wang, Zhenlong Yuan, Yuchan Guo +9Medical VLMsMedical Imaging

  16. Of Errors and Echoes: Responsibility-Aware Credit Assignment for Tool-Use Agents

    Oct 12, 2026Xingjian Diao, Tianyu Yang, Wenjun Huang +8Credit AssignmentFine-Grained Credit Assignment

  17. ObsSpec: Accelerating Agentic Reinforcement Learning with Observation Speculation

    Oct 11, 2026Kyle Montgomery, Wang Zhang, Chenguang WangAgentic RLTool-Using Agents

  18. Self-Evolving Visual Agent via Margin Reward

    Oct 10, 2026Wenxi Yang, Yuzhong Zhao, Baochang Zhang +2Tool-Using Vision-Language AgentsRL for Tool Use

  19. MCPDisCo: Seesaw-Mitigated Tuning for MCP-Native Agents

    Oct 10, 2026Kounianhua Du, Jianxing Liu, Shuai Shao +3RL for LLM AgentsAgentic RL

  20. Self-Evolve With a Reference:Anchored Training of Tool-Integrated Agents

    Oct 7, 2026Wenjie Liao, Liangjie Zhao, Zehong CaoLLM Agent Self-ImprovementSelf-Evolving Agents

  21. CIPO: Counterfactual Imagination Policy Optimization for Adaptive Tool Granularity Selection

    Oct 4, 2026Yu Li, Yunlu Wan, Zijian Zhu +4LLM Agent Skill LearningRL for Tool Use

  22. HybridCUA: Learning to Orchestrate GUI and CLI for Computer-Use Agents

    Sep 29, 2026Tongbo Chen, Junbo Niu, Zhengxi Lu +8Computer-Use AgentsGUI Agents