RL Stability

RL: Reinforcement Learning

Ask about this topic

Latest papers

CardsList

29 papers2 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. On the Convergence of Semi-Gradient TD: A Mean Field Perspective

    Oct 14, 2026Haruki Settai, Tadashi Kozuno, Shinji ItoTemporal-Difference LearningRL Stability

    The University of Tokyo · Sun Intelligence · The University of Tokyo & RIKEN

  2. Structure-Aware Numerical Stabilization for Half-Precision Proximal Policy Optimization

    Oct 9, 2026Linxuan Wu, Liang ChenRL StabilityReinforcement Learning

    Institute of Automation, Chinese Academy of Sciences School of Artificial Intelligence, University of Chinese Academy of Sciences Beijing, China

  3. Score Centering Stabilizes Off-policy Reinforcement Learning

    Sep 17, 2026Martin Marek, Max RyabininRL for Language ModelsOff-Policy RL

    Together AI

  4. SCQ: Stabilizing Conservative Q-Learning with Sigmoid-Bounded Entropy

    Sep 11, 2026Xiefeng Wu, Shu Zhang, Zhaojie Chu +1Offline RLConservative RL

    School of Computer Science, Wuhan University, Wuhan, China · School of Electronic Information, Wuhan University, Wuhan, China · School of Internet, Anhui University, Hefei, China

  5. A Bellman Optimality Equation for Plasticity

    Sep 9, 2026Jeremy Lucas, Doina PrecupStability-Plasticity DilemmaReinforcement Learning

    Mila – Quebec Artificial Intelligence Institute Montreal, Quebec, Canada

  6. Local and Global Stability in Performative Reinforcement Learning

    Sep 6, 2026Debmalya MandalReinforcement LearningRL Stability

    Department of Computer Science University of Warwick, UK

  7. Understanding and Stabilizing Deep Q-Learning via Controlled Bootstrapping and Regulated Value Dynamics

    Aug 17, 2026Bozhou Chen, Yongyi Wang, Hanyu Liu +2RL StabilityReinforcement Learning

    School of Computer Science, Peking University, Beijing, China

  8. Lyapunov Exponent as Physics-Informed Dense Reward: RL Discovery of Stabilization Beyond the Kapitza Pendulum

    Jul 15, 2026Slava AndrejevRL ControlReinforcement Learning

  9. ARMOR: Stabilizing On-Policy LLM RL with Off-Policy Anchor Samples

    Jul 11, 2026Kexin Huang, Junkang Wu, Jinda Lu +7Reinforcement LearningKL-Regularized RL

    University of Science and Technology of China · Peking University · Dartmouth College

  10. Trust Region Policy Distillation

    Jul 6, 2026Zhengpeng Xie, Li Lyna Zhang, Zeke Xie +1On-Policy DistillationPolicy Learning

  11. Scaling Laws for Collapse in Asynchronous GRPO

    Jul 1, 2026Jingwei Song, Haofeng Xu, Jie Xiao +7Asynchronous RLReinforcement Learning

    The University of Hong Kong · Shanghai Jiao Tong University · Gradient +2

  12. Stabilization Learning: A Paradigm Transition Bridging Control Theory and Machine Learning

    Jun 30, 2026Quan QuanRL StabilityAdaptive Control

    School of Automation Science and Electrical Engineering, Beihang University, Beijing 100191, China · Tianmushan Laboratory, Beihang University, Hangzhou 311115, China · Zhongguancun Academy, Beijing 100094, China

  13. Geometrically Averaged Hard Target Updates for Linear Q-Learning

    Jun 9, 2026Donghwan LeeReinforcement LearningRL Stability

    School of Electrical Engineering, KAIST · Daejeon, Republic of Korea

  14. Exact Unlearning in Reinforcement Learning

    Jun 2, 2026Thanh Nguyen-Tang, Raman AroraReinforcement LearningMachine Unlearning

    Department of Data Science, New Jersey Institute of Technology, Newark, NJ, USA · Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA

  15. Off-Policy Learning to Reason Works Because It Is More Pessimistic Than You Think

    May 27, 2026Otmane Sakhi, Aleksei Arzhantsev, Imad Aouali +1Reinforcement LearningRL for Language Model Reasoning

    Criteo AI Lab · Criteo AI Lab, CREST IP Paris

  16. Balancing Plasticity and Stability with Fast and Slow Successor Features

    May 25, 2026Raymond Chua, Doina Precup, Blake RichardsSequential Decision MakingNon-Stationary RL

    School of Computer Science, McGill University, Montr´eal, Canada · Mila - Quebec Artificial Intelligence Institute, Montr´eal, QC, Canada · CIFAR Learning in Machines and Brains +3

  17. Survive or Collapse: The Asymmetric Roles of Data Gating and Reward Grounding in Self-Play RL

    May 21, 2026Sophia Xiao Pu, Zhaotian Weng, Chengzhi Liu +4Reinforcement LearningSelf-Play RL

    University of California, Santa Barbara · Cisco Research

  18. Diagnosing Training Inference Mismatch in LLM Reinforcement Learning via a Zero-Mismatch Reference

    May 14, 2026Tianle Zhong, Neiwen Ling, Yifan Pi +5Reinforcement LearningLLM Inference

    ByteDance · The University of Virginia

  19. Learning When to Act: Communication-Efficient Reinforcement Learning via Run-Time Assurance

    May 11, 2026Adam Haroon, Erick J. Rodríguez-Seda, Cody Fleming +1Policy LearningLyapunov-Based Control

    Department of Mechanical Engineering, Iowa State University, Ames, IA, USA · Navy Center for Applied Research in Artificial Intelligence (NCARAI), U.S. Naval Research Laboratory, Washington, D.C., USA · Department of Weapons, Robotics, and Control Engineering, United States Naval Academy, Annapolis, MD, USA

  20. T2^2PO: Uncertainty-Guided Exploration Control for Stable Multi-Turn Agentic Reinforcement Learning

    May 4, 2026Haixin Wang, Hejie Cui, Chenwei Zhang +7RL for LLM AgentsReinforcement Learning

    University of California, Los Angeles · 2Amazon.com Inc.

  21. Stability of Control Lyapunov Function Guided Reinforcement Learning

    May 3, 2026Zachary Olkin, William D. Compton, Aaron D. AmesRL ControlLyapunov Stability

    The authors are with the Department of Control and Dynamical Systems at the California Institute of Technology.

  22. AdamO: A Collapse-Suppressed Optimizer for Offline RL

    May 3, 2026Nan Qiao, Sheng Yue, Shuning Wang +1Reinforcement LearningOrthogonal Optimization

    1Tsinghua University, China · 2Central South University, China · 3Sun Yat-sen University, China

  23. GIFT: Global stabilisation via Intrinsic Fine Tuning

    Apr 25, 2026Rory Young, Nicolas PugeaultRL ControlReinforcement Learning

    School of Computing Science University of Glasgow

  24. Target-Aligned Reinforcement Learning

    Mar 31, 2026Leonard S. Pleiss, James Harrison, Maximilian SchifferReinforcement LearningRL Control

    Google DeepMind

  25. Enhancing Reinforcement Learning Fine-Tuning with an Online Refiner

    Mar 18, 2026Hao Ma, Zhiqiang Pu, Yang Liu +1RL Fine-TuningRL for Language Models

    School of Artificial Intelligence, University of Chinese Academy of Sciences · Institute of Automation, Chinese Academy of Sciences

  26. GAC: Stabilizing Asynchronous RL Training for LLMs via Gradient Alignment Control

    Mar 2, 2026Haofeng Xu, Junwei Su, Yukun Tian +3RL StabilityAsynchronous Advantage Actor-Critic

    School of Computing and Data Science, The University of Hong Kong · Alibaba Group · Southeast University

  27. ARLArena: A Unified Framework for Stable Agentic Reinforcement Learning

    Feb 25, 2026Xiaoxuan Wang, Han Zhang, Haixin Wang +11Agentic RLReinforcement Learning

    Department of Computer Science, University of California, Los Angeles, California, USA · University of Wisconsin–Madison, Madison, Wisconsin, USA

  28. Stable Deep Reinforcement Learning via Isotropic Gaussian Representations

    Feb 22, 2026Ali Saheb Pasand, Johan Obando-Ceron, Aaron Courville +2RL StabilityRepresentation Learning for RL

    Mila – Quebec AI Institute · McGill · Université de Montréal +1

  29. QUATRO: Query-Adaptive Trust Region Policy Optimization for LLM Fine-tuning

    Feb 4, 2026Doyeon Lee, Eunyi Lyou, Hyunsoo Cho +3Trust-Region OptimizationPolicy Learning

    Seoul National University · Department of Artificial Intelligence / Institute for Multiscale Matter and Systems, Ewha Woman University · Geogia Institute of Technology