Agentic Reinforcement Learning

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 120% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 145

All topics

Structuring MoE Expert Selection for Agentic Reinforcement Learning
Oct 5, 2026Bolian Li, Ting-Yao Hu, Cheng-Yu Hsieh +3Agentic Reinforcement Learning Mixture-Of-Agents
Apple · Purdue University
Dependency-Aware Reward Shaping for Agentic Reinforcement Learning
Oct 1, 2026Ziyi Chen, Yan Zhang, Jianhui Wei +2Agentic Reinforcement Learning Potential-Based Reward Shaping
University of Illinois Urbana-Champaign · National University of Singapore · Zhejiang University +1
My FAULT: Self-Diagnosis as Credit Assignment in Self-Evolving Agentic Reinforcement Learning
Oct 1, 2026Yihua Zhu, Qianying Liu, Weixu Qiao +10Credit Assignment Agentic Reinforcement Learning
Alibaba Group · Kyoto University · NII LLMC +6
SHARPO: Segment-Level Credit Assignment for Agentic Reinforcement Learning
Sep 30, 2026Xinchen Du, Zhengze Zhou, Wenhui Zhu +4Agentic Reinforcement Learning Credit Assignment
LinkedIn Corporation · Georgia Institute of Technology
From Given to Gathered Evidence: Agentic Learning for Longitudinal Medical Reasoning
Sep 30, 2026Minye Shao, Chaohui Yu, Yixuan Wu +3Clinical Reasoning Training Agentic Learning
Durham University · DAMO Academy, Alibaba Group · Hupan Laboratory +1
T2SPO: Trajectory-to-Step Policy Optimization for Agentic Reinforcement Learning
Sep 30, 2026Bo-Wen Zhang, Junwei He, Maoqi Liu +6Agentic Reinforcement Learning Process-Level Supervision
State Key Laboratory of Novel Software Technology, Nanjing University · School of Intelligence Science and Technology, Nanjing University · ByteDance
From Imitation to Reward Discovery: On-Policy Warmup for Agentic RL
Sep 30, 2026Yitong Qiao, Tiantian He, Lei Liu +4Reinforcement Learning With Verifiable Reward Agentic Reinforcement Learning
Zhejiang University · Ant Healthcare, Ant Group
BRIDGE: Bilevel Retrieval-Credit-Aware Agentic Reinforcement Learning
Sep 29, 2026Quan Xiao, Mingda Liu, Gaowen Liu +2Agentic Reinforcement Learning Large Language Model Policy Optimization
Department of Electrical and Computer Engineering, Cornell University · Institute of Integrated Research, Institute of Science Tokyo · Cisco Research
Reward-rate Policy Gradient for Efficient Machine Learning Engineering Agents
Sep 28, 2026Muhang Tian, Sherry YangReward-Only Policy Optimization Variants Agentic Reinforcement Learning
New York University
Targeting Pivotal Decisions for Credit Assignment in Agentic Reinforcement Learning
Sep 28, 2026Dongwon Jung, Hemanth Neelgund Ramesh, Yifan Wang +7Credit Assignment Agentic Reinforcement Learning
University of California, Davis · Microsoft · University of Washington
KV-streams for Efficient Compaction in Agentic Reinforcement Learning
Sep 28, 2026Emiliano Penaloza, Dane Malenfant, Dheeraj Vattikonda +15Compaction Agentic Reinforcement Learning
Mila · Microsoft · Université de Montréal +9
ARISE: Adapting to Evolving Capability Gaps in Agentic Reinforcement Learning
Sep 28, 2026Kun Feng, Yuchen Fang, Yiyang Tan +6Agentic Reinforcement Learning Long-Horizon Agents
ShanghaiTech University · Ant Group
ASCT: Attentive Search over Counterfactual Trees for Credit Assignment in Agentic Reinforcement Learning
Sep 28, 2026Yang Li, Jinhan Yang, hai liu +8Agentic Reinforcement Learning Credit Assignment
University of Hong Kong · The Chinese University of Hong Kong · Jiangxi Science and Technology Normal University +1
PEARL: Adaptive Prefill-Decode Execution with Elasticity for Agentic Reinforcement Learning
Sep 28, 2026Jiaan Zhu, Wei Gao, Youhui Bai +6Parallel Rollouts Agentic Reinforcement Learning
USTC China
TIDE: Teacher-Student Transition via Informative Distillation and Exploration for Agentic RL
Sep 28, 2026Yibin Huang, Xinming Xu, Conghui ZhuAgentic Reinforcement Learning Teacher
Faculty of Computing, Harbin Institute of Technology · Tsinghua University
SIPO: Selective-Inference Policy Optimization for Tree-Structured Agentic RL
Sep 28, 2026Zenghuang Fu, Ningqi Chen, Mingda Jia +10Frictive Policy Optimization Agentic Reinforcement Learning
University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences · The University of Hong Kong +4
Coding Agent Memory Post-training: Unlocking the Memory Potential of Pre-trained File Operations for Long-Horizon Tasks via Reinforcement Learning
Sep 28, 2026Lirui Luo, Kelong Mao, Heming Xia +10Agentic Reinforcement Learning Large Language Model Agents
Back to the Definition: Estimating Step-Level Advantages via Trajectory Graphs for Agentic Reinforcement Learning
Sep 24, 2026Xincheng Yao, Haobo Fu, Weiming Liu +1Group-Based Reinforcement Learning Agentic Reinforcement Learning
School of Information Science and Electronic Engineering, Shanghai Jiao Tong University. · Tencent AI Platform Department. · MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University.
ProCredit: From Outcome Rewards to Progress Credit in Agentic Reinforcement Learning
Sep 23, 2026Ming Ma, Yi Zhu, Yiran Zhong +7Agentic Reinforcement Learning Reward Signal
Institute of Neuroscience, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Tongyi Lab, Alibaba Group +2
RetireOPD: Self-Retiring On-Policy Distillation for Agentic Reinforcement Learning
Sep 17, 2026Yan Yu, Zhengxi Lu, Yizhou Liu +7Efficient On-Policy Distillation Agentic Reinforcement Learning
Zhejiang University · Alibaba Group
UnifiedPlayers: Enhance Tool-Integrated Reasoning in Agentic Reinforcement Learning
Sep 17, 2026Wenjie Liao, Liangjie Zhao, Zehong CaoAgentic Reinforcement Learning Reasoning Benchmark
Waseda University · Adelaide University
Reach or Solve? Attributing Agentic RL Gains with Checkpoint Handoffs
Sep 17, 2026Xuan Liu, Jingbin QianAgentic Reinforcement Learning
Shanghai Jiao Tong University · Rice University
Elastic Horizon: Discovering the Effective Interaction Frontier in Agentic Reinforcement Learning
Sep 7, 2026Gangyi Zhang, Junjie Meng, Letian Zhang +6Long-Horizon Agents Agentic Reinforcement Learning
Qwen Business Unit of Alibaba
Explore More, Drift Less: Outcome-Only Reinforcement Learning Can Suffice for Long-Horizon Interactive Agents
Sep 1, 2026Liming Pu, Xiaoxia Li, Yifu Liu +2Agentic Reinforcement Learning Long-Horizon Task Planning
Alibaba Research
Harness-RL: Black-Box Reinforcement Learning with Action-Args Decoupling for Central-Agent Multi-Agent Harnesses
Aug 30, 2026Xinke Jiang, Zhixin Zhang, Zhibang Yang +6Agentic Reinforcement Learning Agent Harness
National Engineering Research Center of Software Engineering, Peking University, Beijing, China · School of Computer Science, Peking University, Beijing, China · Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +3
AgenticRag-R1: Agentic Reinforcement Learning with Stack Memory for Multi-Step Reasoning, Retrieval and Memorizing
Aug 30, 2026Xinke Jiang, Yue Fang, Zhibang Yang +12Agentic Reinforcement Learning Agentic Benchmarks
National Engineering Research Center of Software Engineering, Peking University, Beijing, China · School of Computer Science, Peking University, Beijing, China · Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +3
Learning Generalizable Behaviors for Terminal Agents
Aug 23, 2026Yihang Yao, Bo Pang, Xuan Phi Nguyen +3Agentic Reinforcement Learning Agentic Benchmarks
Salesforce AI Research · Carnegie Mellon University
ToSCA: Leveraging Hierarchical Reinforcement Learning on Temporal and Strategic Abstractions of Conversational Agents
Aug 22, 2026Xiaoyu Wang, Qingqing Gu, Yue Zhao +5Hierarchical Reinforcement Learning Agentic Reinforcement Learning
1Geely AI Lab · 2Beijing Institute of Technology · 3Peking University
SAPO: Single-Rollout Autoregressive Policy Optimization for Agentic Reinforcement Learning
Aug 20, 2026Dayang Liang, Lang Feng, Bo An +1Agentic Reinforcement Learning Autoregressive Rollout
Xiamen University, China
RTPO: Reverse-Turn Policy Optimization for Stabilizing Agentic RL Training
Aug 19, 2026Yugu Li, Zehong Cao, Jianglin Qiao +1Agentic Reinforcement Learning Frictive Policy Optimization
School of CSIT · ACFR · School of EECMS
Intern-S2-Preview: Scientific Agentic Foundation Model
Aug 13, 2026Lei Bai, Jiaqi Cao, Chiyu Chen +122Multimodal Foundation Model Multimodal Agents
LoongReflect: Boosting Long-Horizon Reflection in Search Agents via Global Perspective Distillation
Aug 12, 2026Zhixin Zhang, Xinke Jiang, Zhibang Yang +5Long-Horizon Agents Agentic Reinforcement Learning
School of Computer Science, Peking University, Beijing, China · National Engineering Research Center for Software Engineering, Peking University, Beijing, China · Key Laboratory of High Confidence Software Technologies, Ministry of Education, Beijing, China +2
Bidirectional Context Self-Distillation for Reinforcement Learning of Skill-Based LLM Agents
Aug 10, 2026Tianjun Pan, Yuan Li, Hongda Wang +8Unsupervised On-Policy Self-Distillation Agentic Reinforcement Learning
Fudan University · Zhejiang University · Alibaba Group +1
Learning from Environmental Feedback: Credit Assignment across Multiple Timescales for Agentic Reinforcement Learning
Aug 8, 2026Yifu Huo, Shunjie Xing, Chenglong Wang +8Agentic Reinforcement Learning Credit Assignment
School of Computer Science and Engineering, Northeastern University, Shenyang, China · School of Computer Science · 2NiuTrans Research, Shenyang, China +1
Trajectory-Relative Hindsight Distillation for Agentic Reinforcement Learning
Aug 7, 2026Haoyu Zheng, Yun Zhu, Qing Wang +1Agentic Reinforcement Learning Hindsight
Zhejiang University · Tencent · Shanghai AI Laboratory
DiDPO: Diff-in-Diff Policy Optimization for Coding Agent Training
Aug 7, 2026Xucong Wang, Zhe Zhao, Liheng Yu +3Reinforcement Learning With Verifiable Reward Critic-Free Reinforcement Learning
University of Science and Technology of China (USTC) · Stanford University · Tongji University +1
EnvACE: Internalizing Environment Dynamics via World Rehearsal for Agentic Reinforcement Learning
Aug 6, 2026Zishan Xu, Zhiyuan Yao, Yuxin Chen +9Agentic Reinforcement Learning Large Language Model Agents
Shanghai Jiao Tong University · Zhejiang University · National University of Singapore +4
AgentOPSD: Recursive Self-Distillation for Agentic Reinforcement Learning
Aug 6, 2026Zi-Han Wang, Zhengxi Lu, Zhiyuan Yao +10Agentic Reinforcement Learning Unsupervised On-Policy Self-Distillation
Tsinghua University · Meituan · Zhejiang University
Enhancing Social Intelligence in LLMs with Hierarchical Reasoning and Utterance-Level Goal Rewarding
Aug 6, 2026Xiaofeng Wang, Kakam Chong, Shuai Xiao +9Agentic Reinforcement Learning Negotiation
Independent Researcher · Alibaba Group · Shanghai Jiao Tong University
Agentic Reinforcement Learning with Observation-Calibrated Self-Distillation
Aug 5, 2026Yi Yang, Cong Qin, Xiaodan Liu +8Unsupervised On-Policy Self-Distillation Self-Distillation Framework
Meituan LongCat Interaction · Nanjing University · Peking University +3
Agentic Reinforcement Learning with Self-Distilled Reward Shaping
Aug 4, 2026Ranxu Zhang, Guinan Chen, Chenshaodong +5Agentic Reinforcement Learning Potential-Based Reward Shaping
Alibaba Group · University of Science and Technology of China Hefei, China · Alibaba Group Hangzhou, China
Cross-Domain Hybrid OPD for Generalizable Search Agents
Aug 3, 2026Hongzhan Chen, Xiaoyu Liu, Dengming Zhang +11Search Agents Agentic Reinforcement Learning
Yuanbao Team, Tencent · Shanghai Innovation Institute
PCSD: Persistent Consistency for Self-Distillation in Agentic Reinforcement Learning
Aug 3, 2026Chunji Lv, Yangguang Wei, Junlin Liu +6Unsupervised On-Policy Self-Distillation Agentic Reinforcement Learning
Beijing Institute of Technology · Meituan · Institute of Automation, Chinese Academy of Sciences +1
Progressive Agent Skill Generation via Reinforcement Learning
Aug 3, 2026Junhao Shen, Zhanqiu Zhang, Yiwen Guo +1Agentic Reinforcement Learning Data Generation Pipelines
The Chinese University of Hong Kong · LIGHTSPEED · Independent Researcher
SERL-SQL: Selective Hindsight Distillation for Text-to-SQL Reinforcement Agentic Learning
Aug 1, 2026Tao Liu, Tao Feng, Xiangheng Li +9Text-To-Sql Sql
Zhejiang University, College of Artificial Intelligence · Zhengzhou University, School of Computer Science of Artificial Intelligence · Byte Dance
Group-Reflective Self-Distillation for Agentic Reinforcement Learning
Jul 30, 2026Binbin Zheng, Zijun Xie, Guanqun Zhao +4Agentic Reinforcement Learning Unsupervised On-Policy Self-Distillation
University of Science and Technology of China · 2Baidu Inc. · 3Peking University +3
SpatialCLI: Learning to Reason With Spatial Tools, Then Without Them
Jul 30, 2026Yang Zhou, Zixuan Huang, Sunzhu Li +10Recent Vision-Language Models Geospatial Reasoning
Zhejiang University · Zhuoyu Technology, Shenzhen, China · Beihang University +3
SkillRise: Agentic Reinforcement Learning for Cross-Task Skill Evolution
Jul 29, 2026Zhiyuan Yao, Yuxin Chen, Zhengxi Lu +13Self-Evolving Skill Libraries Skills
1Zhejiang University · 2National University of Singapore · 3Shanghai Jiao Tong University +1
Graph Is the Verifier: Agentic Reinforcement Learning for Interprocedural Vulnerability Detection
Jul 29, 2026Yikun Li, Ting Zhang, Jiakun Liu +9Vulnerable Code Agentic Reinforcement Learning
1Singapore Management University, Singapore · 2Harbin Institute of Technology, China · 3GovTech, Singapore
Kimi K3: Open Frontier Intelligence
Jul 27, 2026Kimi Team, Tongtong Bai, Yifan Bai +399Qwen3 Intelligence
Hybrid Advantage Estimation with Unified Critic for VLM Agentic Reinforcement Learning
Jul 26, 2026Wenxuan Zhang, Yuhui Wang, Donggang Jia +5Agentic Reinforcement Learning Critic Learning
KAUST
PATS: Policy-Aware Training Scaffolding for Agentic Reinforcement Learning
Jul 23, 2026Yipeng Shi, Zhipeng Ma, Yue Wang +4Agentic Reinforcement Learning Optical Coherence Tomography
School of Software & Microelectronics, Peking University · 2Tencent
Molt: A Scalable PyTorch-Native Training Framework for Agentic Reinforcement Learning
Jul 22, 2026Jian Hu, Huiying Li, Hao Zhang +8Agentic Reinforcement Learning Mixture-Of-Agents
NVIDIA
WAR: Workload-Aware Rollouts for Synchronous Agentic Reinforcement Learning
Jul 19, 2026Ryan Xu, Atlas Zhao, David Bao +1Agentic Reinforcement Learning Rollout
Reward-Driven LLM Agent Workflows: Synthesizing POMDP Routing and Self-Correction for Autonomous Decision-Making
Jul 19, 2026Amez Amanj Ali, Kuo-Kun TsengAgentic Reinforcement Learning Large Language Model Workflows
School of Computer Science and Technology Harbin Institute of Technology, Shenzhen
When Does Muon Help Agentic Reinforcement Learning?
Jul 17, 2026Kai Ruan, Jinghao Lin, Zihe Huang +4Muon Adam
Gaoling School of Artificial Intelligence, Renmin University of China · Independent Researcher · Institute of Computing Technology, Chinese Academy of Sciences +3
ToolVerse: Unlocking Massive Environments and Long-Horizon Tasks for Agentic Reinforcement Learning
Jul 17, 2026Shuaiyu Zhou, Fengpeng Yue, Zengjie Hu +5Agentic Reinforcement Learning Long-Horizon Task Planning
LongCat Interaction Team, Meituan, Beijing, China · Peking University, Beijing, China · Fudan University, Shanghai, China +1
SEED: Self-Evolving On-Policy Distillation for Agentic Reinforcement Learning
Jul 16, 2026Jinyang Wu, Shuo Yang, Zhengxi Lu +8Agentic Reinforcement Learning Unsupervised On-Policy Self-Distillation
1Tsinghua University · 2Zhejiang University · 3The Chinese University of Hong Kong +2
TRACE: Turn-level Reward Assignment via Credit Estimation for Long-Horizon Agents
Jul 15, 2026Leitian Tao, Baolin Peng, Wenlin Yao +5Credit Assignment Agentic Reinforcement Learning
University of Wisconsin–Madison · Microsoft Research
Learning Robust Execution in Robotic Manipulation with Agentic Reinforcement Learning
Jul 15, 2026Xiaopeng Zhang, Yueyang Weng, Qi Liu +2Robotic Manipulation Agentic Reinforcement Learning
School of Inteligence Science and Engineering, the Harbin Institute of Technology Shenzhen, 518055, China. · Faculty of Robot Science and Engineering, Northeastern University, Shenyang, 110819, China.

Oct 5, 2026, cs.LGJ/K move · Enter open · S save

Structuring MoE Expert Selection for Agentic Reinforcement Learning

Bolian Li, Ting-Yao Hu, Cheng-Yu Hsieh, Sanjoy Chowdhury+2

Apple · Purdue University

Agentic Reinforcement Learning Mixture-Of-Agents

Open paper AskPDF arXiv

Long-horizon LLM agents are frequently implemented using sparse mixture-of-experts (MoE) models, yet the co-design of agentic behavior and MoE structures remains underexplored. In this work, we comprehensively study the connections between agentic post-training and MoE expert selection. In off-the-shelf MoE models, we observe expert selection exhibits a specialized structure that naturally aligns with agentic trajectories. Specifically, expert routing overlaps more between turns where the agent performs semantically similar operations (e.g., READ, UPDATE) than between turns with differing operations. However, standard RL algorithms ignore this specialization, allowing the MoE routing to go uncontrolled during training, which empirically limit task performance and inference efficiency. To address this, we introduce a hierarchical routing control framework for agentic tasks. We explicitly encourage turn-level expert selections to align with agentic operations while regularizing token-level expert selections to maintain local consistency. To resolve stability issues that arise during post-training with the proposed methods, we further introduce an entropy-gated control mechanism. Overall, our routing control framework achieves over 10-point improvements in success rate on all evaluated benchmarks. These results demonstrate that agentic trajectory structure provides an effective signal for optimizing MoE capacity during RL post-training.

Momentum

Related topics

Latest papers 145