Constrained RL

RL: Reinforcement Learning

Overview

Constrained reinforcement learning studies how agents can maximize rewards while obeying limits on costs such as collisions, energy use, latency, or harm. Many methods model the problem as a constrained Markov decision process and use Lagrangian or primal-dual updates; others enforce feasibility with action masks, projections, safety shields, control barrier functions, or reachability analysis. These approaches are used in settings from robot control and power systems to language-model alignment, with work spanning online and offline learning, multi-agent tasks, and formal guarantees for regret and constraint satisfaction. A central challenge is balancing useful performance with reliable safety: average-cost limits can miss rare severe failures, while strict safeguards may make learning conservative or difficult to scale.

Latest papers

CardsList

250 papers28 papers in the last four weeks, down 26% on the four weeks before. 0.2% of all new papers.

  1. Exchange Policy Optimization Algorithm for Semi-Infinite Safe Reinforcement Learning

    Nov 6, 2025Jiaming Zhang, Yujie Yang, Haoning Wang +2Safe RLConstrained RL

  2. Gain Tuning Is Not What You Need: Reward Gain Adaptation for Constrained Locomotion Learning

    Oct 12, 2025Arthicha Srisuchinnawong, Poramate ManoonpongConstrained RLRL for Legged Locomotion

  3. Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints

    Sep 24, 2025Francesco Emanuele Stradi, Eleonora Fidelia Chiefari, Matteo Castiglioni +2Markov Decision ProcessesConstrained RL

  4. SafeOR-Gym: A Benchmark Suite for Safe Reinforcement Learning Algorithms on Practical Operations Research Problems

    Jun 2, 2025Asha Ramanujam, Adam Elyoumi, Hao Chen +5RL BenchmarksConstrained RL

  5. TraCeS: Learning Per-Timestep Constraint-Violation Credit from Sparse Trajectory-Level Labels

    Apr 17, 2025Siow Meng Low, Ze Gong, Akshat KumarRL ControlCredit Assignment in RL

  6. Learning Constraints-Based Adaptive Hypergraph Neural Networks for Solving Vehicle Routing Problems

    Mar 13, 2025Zhenwei Wang, Tiehua Zhang, Jing Liu +3Constrained RLVehicle Routing

  7. Navigating Demand Uncertainty in Container Shipping: Deep Reinforcement Learning for Enabling Adaptive and Feasible Master Stowage Planning

    Feb 18, 2025Jaike van Twiller, Yossiri Adulyasak, Erick Delage +2Constrained RL

  8. The Price of Failure Risk: Clipped Barrier Policy Gradients with Convex Regularization

    Nov 28, 2024Pekka Malo, Lauri Viitasaari, Antti Suominen +2Policy Gradient MethodsConstrained RL

  9. Constrained Reinforcement Learning for Safe Heat Pump Control

    Sep 29, 2024Baohe Zhang, Lilli Frison, Thomas Brox +1RL ControlConstrained RL