Constrained RL

RL: Reinforcement Learning

Overview

Constrained reinforcement learning studies how agents can maximize rewards while obeying limits on costs such as collisions, energy use, latency, or harm. Many methods model the problem as a constrained Markov decision process and use Lagrangian or primal-dual updates; others enforce feasibility with action masks, projections, safety shields, control barrier functions, or reachability analysis. These approaches are used in settings from robot control and power systems to language-model alignment, with work spanning online and offline learning, multi-agent tasks, and formal guarantees for regret and constraint satisfaction. A central challenge is balancing useful performance with reliable safety: average-cost limits can miss rare severe failures, while strict safeguards may make learning conservative or difficult to scale.

Latest papers

CardsList

250 papers28 papers in the last four weeks, down 26% on the four weeks before. 0.2% of all new papers.

  1. Actor-Predictor Architecture for Reinforcement Learning with Formal Specification Objectives

    Nov 19, 2026Josef Brozovich, Qining Zhang, Lei YingFormal Methods for RLConstrained RL

  2. Power Setpoint Tracking for Large-Scale EV Charging: Transformer-Constrained Charging Policy Learning with Self-Tuning Constraint Prices

    Nov 19, 2026Daniyal Sajedi-Hosseini, Yoshihiko Fujisawa, Shubham Singh +5Electric Vehicle ChargingPower Systems

  3. From Data to Valves: A Self-Learning, Production-Grade Edge Stack for Sustainable HVAC Control

    Nov 18, 2026Abbas Raza Ali, Muhammad Hamza Rehman, Xu Li +1Heating, Ventilation, and Air Conditioning ControlRL Control

  4. Algorithm Distillation for Safe In-Context Reinforcement Learning

    Nov 16, 2026Minjae Kwon, Amir Moeini, Shangtong Zhang +1In-Context RLSafe RL

  5. Subprocess-Constrained Markov Decision Processes

    Nov 16, 2026Jiarui Gan, Debmalya MandalMarkov Decision ProcessesConstrained RL

  6. Comfort as a Constraint or as a Cost in Reinforcement Learning and Model Predictive Building Control

    Nov 16, 2026Joram Liebeskind, Valentin Bhend, Varsha N. Behrunani +1Constrained RLBuilding Energy Management

  7. Towards Probabilistically Safe Reinforcement Learning: Theory and Deployment on Humanoid and Aerial Robots

    Nov 14, 2026Pol Mestres, Varun Gabbita, Jason H. K. Siu +4Reinforcement LearningSafe RL

  8. Internalizing Investment Mandates: A Neurosymbolic RL Approach to Portfolio Allocation

    Nov 12, 2026Zeynep Yıldız, Satchit Chatterji, Ercan Atam +1Constrained RLNeuro-Symbolic RL

  9. A physics-constrained deep reinforcement learning method for autonomous mission planning of Titan deep space probes

    Nov 11, 2026Hanmin Li, Tao Wang, Shuangliang Liu +2Constrained RLPhysics-Informed RL

  10. Epigraph Form Reinforcement Learning-based Safe Trajectory Tracking Control for Connected and Autonomous Vehicles

    Nov 11, 2026Xiaoke Yang, Jin Chen, Yafei Wang +5Robot Trajectory TrackingRL for Autonomous Driving

  11. Conformal Risk Certificates for Portfolio Optimization Under Uncertainty: A Gated Reinforcement-Learning Approach

    Nov 10, 2026Mohammad Zarei, Amirhossein MohammadpourAzari, Moslem HabibiPortfolio OptimizationRisk-Aware Control

  12. Adaptive Quantization Preserves Fast Rates for TD Learning over Rate-Limited Channels

    Nov 9, 2026Sreejeet Maity, Aritra MitraPolicy EvaluationTemporal-Difference Learning

  13. Safe Offline Reinforcement Learning using Behavior Regularisation and Latent Feasibility Guidance

    Nov 7, 2026Mahesh Keswani, Parth Bhardwaj, Ankur Kumar +1Reinforcement LearningSafe Offline RL

  14. Probably Safe Sim-to-Real Transfer with Lifetime Validity

    Nov 6, 2026Rohan Tangri, Jan-Peter CalliessSim-to-Real TransferSafe RL

  15. Accelerating Safe Reinforcement Learning with Massive Parallelism

    Nov 5, 2026Joonyoung Lim, Younghwan YooSafe RLConstrained RL

  16. Monotone Viability Learning for Offline Safe Reinforcement Learning

    Nov 5, 2026Ziqian Wang, Zhen ZhangSafe Offline RLConstrained RL

  17. Provable Zeroth-Order Safe Exploration for Reinforcement Learning from Human Feedback

    Nov 5, 2026Weiqin Chen, Xinmeng Huang, Dongsheng Ding +1Safe RLReinforcement Learning

  18. Provably Efficient Representation Learning for Low-Rank CMDPs

    Nov 5, 2026Kaixuan Liu, Guojun Xiong, Shengpu Tang +2Primal-Dual RLMarkov Decision Processes

  19. Rare Event Constrained Reinforcement Learning with Large Deviations

    Nov 1, 2026Rahul MisraReinforcement LearningConstrained RL

  20. Structural Dual Adaptation for Safe Reinforcement Learning

    Oct 31, 2026Runsheng Yu, Zhuoyang Song, Zengde Deng +3Primal-Dual RLConstrained RL

  21. Last-Iterate Convergence for Constrained MDPs: From Dual Descent to Primal-Dual

    Oct 29, 2026Michael Lu, Max Qiushi Lin, Mo Chen +1Last-Iterate ConvergenceConstrained RL

  22. Force-Driven Hook Disassembly via Constraint-Aware Object-Centric Reinforcement Learning

    Oct 28, 2026Nadeen Elhadad, Takuya Kiyokawa, Kensuke HaradaObject-Centric RLRobotic Manipulation

  23. Variational Consequence-Driven Offline Reinforcement Learning

    Oct 28, 2026Wen Jiang, Ke Jiang, Jin Wang +1Offline RLConstrained RL

  24. Reinforcement learning for constrained stochastic linear--quadratic control in continuous time

    Oct 26, 2026Weiping Wu, Qitong Pan, Xun Li +1Stochastic Optimal ControlLinear Quadratic Regulator

  25. CORMA: Constraint-Routed Decision Mamba for Generalizable Multi-Constraint Offline Safe Reinforcement Learning

    Oct 25, 2026Changxu Ni, Feiran You, Yongan Guo +5Safe RLReinforcement Learning

  26. Physics-Informed Graph-Based Safe RL with Constraint-Specific Critics for Community Battery Coordination in Distribution Network

    Oct 24, 2026Chenghao Huang, Yue Yang, Hao WangPower SystemsSafe RL

  27. RBGA: Residual-Budget Guide Arbitration for Offline-to-Online Safe Reinforcement Learning in Dexterous Manipulation

    Oct 24, 2026Zongyou Yu, Ao Zhou, Xiongbo Shi +7Reinforcement LearningSafe RL