Continual RL

RL: Reinforcement Learning

Overview

Continual reinforcement learning asks how an agent can keep learning as tasks or environmental dynamics change without losing earlier capabilities. Common approaches include replaying past experience, regularizing updates to protect prior behavior, reusing or expanding network components, and consolidating skills through world models or learned representations such as successor features. Researchers evaluate these methods on sequential control, navigation, Atari, robotics, and multi-agent benchmarks, with growing attention to partial observability and real-world adaptation. The central tension is balancing stability with plasticity: methods that preserve old skills can slow learning, while aggressive adaptation can cause forgetting, policy collapse, or unsafe behavior.

Latest papers

CardsList

58 papers5 papers in the last four weeks, level with the four weeks before. 0.0% of all new papers.

  1. Mitigating Catastrophic Forgetting with Physics-Indexed Specialist Memory: the Evolutionary Neuroplastic Agent

    Nov 16, 2026Blas Eugenio Vicco Zarate, Miguel Hernán ViccoContinual RLCatastrophic Forgetting

  2. Unipolar Neuron Networks Trained by Recirculation for Reward-Based Continual Learning

    Nov 10, 2026Florin LeonContinual RL

  3. Permanent and Transient Representations for Continual Reinforcement Learning

    Nov 5, 2026Nishanth Anand, Doina PrecupComplementary Learning SystemsContinual Learning

  4. Continual Reinforcement Learning Is an Integration Problem

    Oct 30, 2026Nis Meinert, Jakob Gawlikowski, Edward Grant +6Continual RLLifelong Learning Agents

  5. Before We Adapt: The Zero-Shot Generalization Bottleneck in Continual World Models

    Oct 29, 2026Amir Mesbah, Di WuContinual RLWorld Model Learning

  6. Continual Graph Multi-Agent Reinforcement Learning

    Oct 7, 2026Tommaso Marzi, Ahmed Hendawy, Jan Peters +3graph-based multi-agent reinforcement learningMulti-Agent Reinforcement Learning

  7. Off-Policy Merging Beats On-Policy Self-Distillation for Continual Learning

    Oct 5, 2026Chen Henry Wu, Thomas Zhang, Aditi RaghunathanContinual Learning for LLMsOn-Policy Distillation

  8. How to Find and Reuse Policies for Continuous Adaptation in Lifelong Reinforcement Learning

    Oct 2, 2026Saptarshi Nath, Inish M. D'Souza, Antonio Carta +2Continual RLLifelong Learning Agents

  9. Continual Reinforcement Learning with Neuroevolution

    Oct 1, 2026Eleni Nisioti, Andrea Cossu, Kathrin Korte +1NeuroevolutionLoss of Plasticity

  10. When Validation Stops Learning: Auditing Update Admission for Continual Embodied Agents

    Sep 9, 2026Qinzhen Ma, Ruihai WuContinual Robot LearningSafe RL

  11. A Bellman Optimality Equation for Plasticity

    Sep 9, 2026Jeremy Lucas, Doina PrecupStability-Plasticity DilemmaReinforcement Learning

  12. CIDER: Continual Interactive Distillation for Embodied Reinforcement Learning

    Aug 22, 2026Houlin Li, Minghui Xu, Guo Xu +8Continual Robot LearningContinual RL

  13. Beyond Forgetting: Diagnosing and Harnessing Shared Reasoning in Continual RLVR

    Aug 19, 2026Lirui Luo, Guoxi Zhang, Hongming Xu +3RL for Language Model ReasoningReplay-Based Continual Learning

  14. SingularClip: Preventing Spectral Collapse to Maintain Plasticity in Continual and Reinforcement Learning

    Aug 18, 2026Tyler Kastner, Nimrod De La Vega, Amir-massoud FarahmandLoss of PlasticityContinual Learning

  15. ATLAS: Adaptive Topological Learning with Abstract Successors for Continual Learning

    Aug 5, 2026R. Blake Lawlor, Daniel S. BrownNon-Stationary RLReinforcement Learning

  16. Calibrated Partial Resets: Preventing Policy Collapse in Continual Reinforcement Learning

    Jul 27, 2026Luc McCutcheon, Evangelos Chatzaroulas, Saber FallahNon-Stationary RLNeural Network Initialization

  17. Continual-RL for Generalization in Autonomous Racing on the RoboRacer Platform

    Jul 27, 2026Joel Siegert, Edoardo Ghignone, Michele MagnoBackpropagationContinual Robot Learning

  18. Adaptive Multi-Horizon Reinforcement Learning

    Jul 22, 2026Manoosh Samiei, Doina Precup, Paul MassetContinual RL

  19. Extreme-RGMT: Continual Learning of Highly Dynamic Skills for Robust Generalist Humanoid Control

    Jul 22, 2026Yubiao Ma, Han Yu, Kai Guo +5Continual Robot LearningRobot Skill Learning

  20. RL Forgets! Towards Continual Policy Optimization

    Jul 5, 2026Mao-Lin Luo, Zhe-Xu Wang, Zi-Hao Zhou +4RL Post-TrainingContinual Learning for VLMs

  21. FAR: Failure-Aware Retry for Test-Time Recovery and Continual Policy Improvement

    Jul 1, 2026Haoran Hao, Shahram Najam Syed, Jeffrey Ichnowski +1Robot Policy LearningRobot Policy Adaptation

  22. Learning from Mistakes: Rollout-Retrieval Lifelong Policy Learning for Autonomous Driving

    Jun 29, 2026Cheng Gong, Haoyang Wang, Chao Lu +2Autonomous Driving PlanningContinual RL