Non-Stationary RL

RL: Reinforcement Learning

Overview

Non-stationary reinforcement learning studies how agents can keep making good decisions when rewards, transitions, or task conditions change, as they do in deployed robots, traffic systems, and markets. Approaches include change-point detection and regret-based algorithms, context and meta-learning, replay-data management, and continual-learning methods such as network resets or successor features. Theoretical work gives guarantees in tabular and linear Markov decision processes, while empirical evaluations span robotics, driving, games, and multi-agent settings. A central tension is how to adapt quickly without forgetting useful past knowledge or violating safety constraints, especially when old conditions may return.

Latest papers

CardsList

68 papers4 papers in the last four weeks, down 20% on the four weeks before. 0.0% of all new papers.

  1. Adaptive Memory for Online Reinforcement Learning under Sparse Model Changes

    Nov 16, 2026Sreejeet Maity, Sukanya Modak, Leonardo F. TosoNon-Stationary RLadaptive reinforcement learning

  2. Reinforcement Learning for Inventory Control under Regime-Switching Demand: A Controlled Comparison of LSTM, MLP, and (s,S) Policies

    Nov 11, 2026Alex Haines, Nathanael L. BaisaInventory ControlReinforcement Learning

  3. Opportunity-Cost Option-Critic: Adaptive Switching Costs for Robust Hierarchical Reinforcement Learning

    Nov 10, 2026Khaled Ammoura, Aya Kayal, Naseem DaherHierarchical RLNon-Stationary RL

  4. BECON: Belief-Conditioned Constrained Multi-Objective Reinforcement Learning under Drifting Preferences and Budgets

    Nov 9, 2026Bui Trong Duc, Huynh Thi Thanh BinhMulti-Objective Reinforcement LearningPreference-Based RL

  5. Stochastic Tracking of Drifting Affine Fixed Points

    Oct 19, 2026Sajad KhodadadianStochastic ApproximationNon-Stationary RL

  6. Single or Multiple Policies for Phase-Structured Reinforcement Learning?

    Oct 2, 2026Guilhem Loussouarn, Nancy Nayak, Kin K. LeungReinforcement LearningNon-Stationary RL

  7. Reward Inflation: A Healthy Stimulus for Reinforcement Learning

    Oct 1, 2026Ganghun Lee, Minji Kim, Minsu Lee +1Reward Design for RLNon-Stationary RL

  8. AlphaPareto: Formulaic Alpha Discovery with LLM-Guided Multi-Objective Reinforcement Learning

    Sep 28, 2026Yingbo Zhao, Zeyu Yang, Zhoufan ZhuMulti-Objective Reinforcement LearningNon-Stationary RL

  9. Characterizing Replay Retention Under Dynamics Shift in Model-Based Reinforcement Learning

    Sep 16, 2026Everest Yang, Skye Thompson, George D. KonidarisNon-Stationary RLContinual Robot Learning

  10. Proactive Context-Forecasted Safety Constraints for Nonstationary Reinforcement Learning

    Sep 8, 2026Tim TomashevskiyNon-Stationary RLConstrained RL

  11. Spectral Prioritized Sweeping in Nonstationary Reinforcement Learning

    Sep 5, 2026Hung Pham, Tuan DamNon-Stationary RLModel-Based RL

  12. Online Change-point Detection for Cooperative Multi-Agent Reinforcement Learning

    Sep 4, 2026Fatemeh Saberi Khomami, Julita VassilevaChange-Point DetectionCooperative MARL

  13. ATLAS: Adaptive Topological Learning with Abstract Successors for Continual Learning

    Aug 5, 2026R. Blake Lawlor, Daniel S. BrownNon-Stationary RLReinforcement Learning

  14. A Unified Algorithmic Framework for Hybrid Reinforcement Learning in Tabular MDPs with Shifted Transition Dynamics

    Jul 28, 2026Zheshun Wu, Renjie Zheng, Jinhang Zuo +2Non-Stationary RLRegret Minimization in RL

  15. Calibrated Partial Resets: Preventing Policy Collapse in Continual Reinforcement Learning

    Jul 27, 2026Luc McCutcheon, Evangelos Chatzaroulas, Saber FallahNon-Stationary RLNeural Network Initialization

  16. Two-Timescale Hierarchical Reinforcement Learning for Resilient Operations

    Jul 26, 2026Young Hyun Cho, Franz Stoll, Will Wei Sun +2Non-Stationary RLHierarchical RL

  17. Adjustment Speed as a Safety Constraint for Nonstationary Reinforcement Learning

    Jul 21, 2026Timothy TomashevskiyNon-Stationary RLSafe RL

  18. Breaking Feedback-Blindness: Utility-Augmented Transformer for Sequential Decision Making

    Jul 21, 2026Yuyang Shen, Shan Dai, Daimin ChenNon-Stationary RLSequential Decision Making

  19. PRIME: Plasticity Recovery in Multi-Agent Environments for UAV-Assisted Emergency Communication Networks

    Jul 20, 2026Wen Qiu, Zhiqiang He, Wei Zhao +1Non-Stationary RLReinforcement Learning

  20. In-Context Reinforcement Learning under Non-Stationarity: A Survey

    Jul 1, 2026A Run, Ziluo DingNon-Stationary RLIn-Context RL

  21. Learning to Trigger: Reinforcement Learning at the Large Hadron Collider

    Jun 22, 2026Zixin Ding, Shaghayegh Emami, Giovanna Salvi +7RL ControlNon-Stationary RL

  22. Closing the Feedback Loop: From Experience Extraction to Insight Governance in Verbal Reinforcement Learning

    Jun 16, 2026Yanwei Cui, Xing Zhang, Yulong Zhang +4Continual Learning for LLM AgentsNon-Stationary RL

  23. When Should a Robot Replan? Regret-Guided Update Scheduling in Time-Varying MDPs

    Jun 15, 2026Negin Musavi, Gokul Puthumanaillam, Ruben Hernandez +2Non-Stationary RLRobot Policy Adaptation

  24. A Unified Taxonomy and Evaluation Framework for Distributional Shifts in Reinforcement Learning

    Jun 15, 2026Ardianto Wibowo, Paulo E Santos, Amer Baghdadi +3Distribution Shift RobustnessNon-Stationary RL

  25. Space-sampled Value Decay: Forgetting Mechanisms for Non-stationary Deep Reinforcement Learning

    Jun 10, 2026Felix Störck, Fabian Hinder, Barbara HammerNon-Stationary RLReinforcement Learning

  26. GUI-AC: Enhancing Continual Learning in GUI Agents

    Jun 9, 2026Can Lin, Wenjun Yang, Tao Feng +6Non-Stationary RLRL for GUI Agents