Risk-Sensitive RL

RL: Reinforcement Learning

Overview

Risk-sensitive reinforcement learning studies how agents can make sequential decisions that account for rare failures and undesirable outcomes, not just average reward. Common approaches optimize CVaR, quantile, variance, expectile, or exponential-utility objectives, often using distributional critics, policy gradients, Q-learning, or model-based planning. Safety-constrained methods add tools such as shields, reachability checks, and robust uncertainty sets, with applications ranging from robot navigation and autonomous driving to finance and language-model alignment. The field is developing convergence and sample-complexity guarantees alongside practical methods, while a central tension remains how to estimate tail risk reliably from limited data without making policies excessively conservative.

Latest papers

CardsList

97 papers8 papers in the last four weeks, down 60% on the four weeks before. 0.1% of all new papers.

  1. Residual-Guided Lightweight Reinforcement Learning for Risk-Aware Trajectory Selection with a Frozen World Model

    Nov 17, 2026Jiaqi Wu, Yongqi Dong, Yijie Zhong +6Autonomous Driving PlanningRL for Autonomous Driving

  2. GP--RL--MPC: Uncertainty-Aware Reinforcement Learning-Augmented Model Predictive Control with Gaussian Process Postdecision State-Value Functions

    Nov 17, 2026Jon Li, Jay H. LeeModel Predictive ControlMarkov Decision Processes

  3. CVaR Deep Optimal Stopping

    Nov 8, 2026Yechan Jeong, Youngjoon HongOptimal StoppingConditional Value-at-Risk

  4. Risk-Sensitive Reinforcement Learning for an Options Market Maker: An Empirical Study with Real S&P 500 Options

    Nov 7, 2026Jacky Chen, Ing-Haw Cheng, John Hull +5Quantitative FinanceReinforcement Learning

  5. Finite Time Analysis of Risk-Sensitive RL via Noisy Power Iteration

    Nov 7, 2026Waqar Mirza, Yashaswini Murthy, Laixi Shi +2Risk-Sensitive RLStochastic Approximation

  6. Safety-Focused Reinforcement Learning Using Risk-Sensitive Coupled Control

    Nov 6, 2026Jiabin Lin, Shana Moothedath, Vivek S. BorkarSafe RLRL Control

  7. Deep catastrophic-risk-aware reinforcement learning

    Oct 19, 2026Carlos Octavio Pérez Mendoza, Frédéric GodinRisk-Sensitive RLConditional Value-at-Risk

  8. Reward Objectives for Robust (PO)MDPs: A Law-Preserving Equivalence with (Partially Observable) Games

    Oct 19, 2026Durgam Latha, Dion Reji, Dorde Zikelic +1Partially Observable Stochastic GamesRobust Partially Observable Markov Decision Processes

  9. Provably Efficient Risk-Sensitive Offline Reinforcement Learning via Optimized Certainty Equivalents

    Oct 15, 2026Hanzhen Wang, Boxiang Lyu, Zhongxiang Dai +3Reinforcement LearningRisk-Sensitive RL

  10. Bridging Risk Approximation Gaps in Model Predictive Task Sampling via In-Context Modeling

    Oct 10, 2026Jiarong Wen, Qi Tao, Kaiyu Zhang +5Sample-Efficient RLRL Post-Training

  11. Equal-information evaluation of credit assignment in modular financial reinforcement learning

    Oct 10, 2026Gennadiy Chistiakov, Yury YanovichCredit Assignment in RLReinforcement Learning

  12. Credal Machine Learning for Risk-Averse Decision Making

    Oct 8, 2026Timo Löhr, Paul Hofman, Maximilian Muschalik +1Decision-Making under UncertaintyConditional Value-at-Risk

  13. Safe Meta-Policy Design with Risk Control

    Oct 7, 2026Wenbin Zhou, Michael Lingzhi Li, Shixiang ZhuSafe RLRisk-Sensitive RL

  14. Safe on Average, Unsafe in the Tail: When Is the Episodic-Cost Tail Controllable?

    Oct 7, 2026Samuel Tetteh, Cody FlemingSafe RLConstrained RL

  15. Variance-Averse nn-Step Offline Reinforcement Learning for Sparse Long-Horizon Environments

    Oct 6, 2026Guhyeon Kang, Minhae KwonDistributional RLRisk-Sensitive RL

  16. Risk-Sensitive Crowd Navigation with Adaptive Ellipsoidal Conformal Prediction

    Oct 5, 2026Ruihan A. Li, Ziyao Guo, Yingying LiDistribution Shift RobustnessRobot Navigation

  17. Near-Optimal Sample Complexity for Recursive Entropic Risk Reinforcement Learning with a Generative Model

    Oct 3, 2026Amirparsa Bahrami, Oliver Mortensen, Mohammad Sadegh TalebiRisk-Sensitive RLSample-Efficient RL

  18. FSPO: Policy-Consistent Risk and Pareto-Feasible Control for Budgeted LLM RL Post-Training

    Oct 2, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +3RL HPOReinforcement Learning

  19. PPO-HRAP: Proximal Policy Optimization with a Hybrid Regime-Aware Policy for Risk-Controlled Trading

    Oct 1, 2026Duong Hien Chi Kien, Thanh Trung HuynhReinforcement LearningRisk-Sensitive RL

  20. Exploring More, Reasoning Better: Stepwise Risk-Sensitive GRPO for Diffusion Language Models

    Sep 30, 2026Yue Yu, Bowen Zuo, David Crandall +2RL for Language Model ReasoningGroup Relative Policy Optimization

  21. Robust Risk-Sensitive Reinforcement Learning from Corrupted Human Feedback

    Sep 30, 2026Xinyi Ni, Lifeng LaiRisk-Sensitive RLRobust RL

  22. Tail-Influence Sampling for CVaR Policy Evaluation

    Sep 29, 2026Pauline Bourigault, Xiaotong Ji, Matthieu Zimmer +2Policy EvaluationAdaptive Sampling

  23. Character Training for Risk-Averse Agents

    Sep 29, 2026Arav Dhoot, Punya Syon Pandey, Jamie Johnson +3Risk-Sensitive RLAI Agent Safety

  24. RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games

    Sep 27, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Distribution Shift RobustnessImperfect-Information Games

  25. When Should a Human Take Back Control? Optimal Delegation under Turbulent AI Risk

    Sep 25, 2026Haoze Yan, Julien Roze, Ved Upadhyay +2Hawkes ProcessesHuman Oversight of AI

  26. Robust Adversarial Reinforcement Learning with Risk Sensitivity and Critic Consistency Regularization

    Sep 23, 2026Jiaxi Wu, Tiantian Zhang, Yuxing Wang +2Reinforcement LearningRisk-Sensitive RL

  27. DUGM-R: Uncertainty-Aware Dynamic Grid Mapping and Risk-Triggered Recovery for Learned Local Navigation

    Sep 23, 2026Haoyun Feng, Adrian Rubio-Solis, Zhaodong Guo +1Occupancy Grid MappingRobot Navigation