Distributionally Robust RL

RL: Reinforcement Learning

Overview

Distributionally robust reinforcement learning seeks policies that retain good performance when the true dynamics, rewards, or deployment tasks differ from those seen during training. Common approaches define ambiguity sets using Wasserstein distance, total variation, or divergence measures, then optimize worst-case Bellman values with robust Q-learning, actor-critic, or planning methods. Work spans tabular and function-approximation settings, average-reward control, safety, offline learning, multi-agent games, and reinforcement learning from human feedback. A central tension is that larger uncertainty sets can improve protection against distribution shift but cause excessive pessimism and higher sample costs; support mismatch can make reliable learning impossible without additional assumptions or useful side information.

Latest papers

CardsList

36 papers2 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. Robust Actor-Critic Learning under Transport and Divergence Uncertainty

    Nov 17, 2026Kunqi Huang, Lican Kang, Hongrui Shu +1Robust Markov Decision ProcessesDistributionally Robust RL

  2. On the Reliability of Majority-Vote Pseudo-Labels in Test-Time Reinforcement Learning

    Nov 6, 2026Haoyu Wang, Ru Wang, Yuanyuan Wang +2Test-Time RLRL for Language Model Reasoning

  3. Provably Efficient Q-learning for Robust Reinforcement Learning

    Oct 26, 2026Yuchen Jiao, Gen LiRobust RLDistributionally Robust RL

  4. RSD-Poker: Structure-Adaptive and Shift-Robust Risk-Utility Certification for Residual Policies in Imperfect-Information Games

    Sep 27, 2026Miaobo Hu, Shuhao Hu, Xiaobo Guo +4Distribution Shift RobustnessImperfect-Information Games

  5. Interactive Distributionally Robust Multi-Agent Learning with General Function Approximation

    Sep 25, 2026Debamita Ghosh, George K. Atia, Yue WangFunction Approximation in RLReinforcement Learning

  6. Statistical Convergence of Transformer Encoder-Accelerated Robust Reinforcement Learning

    Sep 20, 2026Suman Banerjee, Hiroyasu TsukamotoReinforcement LearningTransformer-Based RL

  7. Online Robust Reinforcement Learning Through Monte-Carlo Planning

    Sep 16, 2026Tuan Dam, Kishan Panaganti, Brahim Driss +1Monte Carlo Tree SearchDistributionally Robust RL

  8. Quantifying Risk Under Evolving Uncertainty: Belief-Dependent Robustness for Safe Sequential Decision Making

    Aug 18, 2026Deep Kumar Ganguly, Jan KretinskyRisk-Sensitive PlanningRobust RL

  9. Robust Average-Reward Markov Decision Processes: Minimax-Optimal Learning via Plug-in Reductions

    Aug 6, 2026Yuepeng Yang, Yuxin Chen, Yuejie ChiRobust Markov Decision ProcessesAverage-Reward RL

  10. Entropy Regularization Improves Policy Robustness in Continuous-Time Reinforcement Learning

    Jul 3, 2026Jialun Cao, Fernando Acero, David Šiška +1Robust Markov Decision ProcessesMaximum Entropy RL

  11. Stationary Robust Mean-Field Games under Model Mismatches

    Jun 21, 2026Yue WangMean Field GamesGame Theory

  12. Robust QQ-learning for mean-field control under Wasserstein uncertainty in common noise

    Jun 18, 2026Mathieu Laurière, Ariel Neufeld, Kyunghyun ParkQ-LearningWasserstein Distributionally Robust Optimization

  13. A Unifying Lens on Reward Uncertainty in RLHF

    Jun 8, 2026Ely Hahami, Yoel Zimmermann, Ray Zhou +1Reward ModelingKL-Regularized RL

  14. Distributionally Robust Multi-Task Reinforcement Learning via Adaptive Task Sampling

    May 14, 2026Nicholas E. Corrado, Wenyuan Huang, Josiah P. HannaDistributionally Robust RLMulti-Task RL

  15. Central Limit Theorem for Two-Time-Scale Approximate Distributionally Robust RL

    May 8, 2026Shengbo Wang, Zexi ZhangStochastic ApproximationDistributionally Robust RL

  16. Quantile Geometry Regularization for Distributional Reinforcement Learning

    May 5, 2026Zhaofan Zhang, Minghao Yang, Rufeng Chen +2Distributional RLQuantile Regression

  17. Taming the Curses of Multiagency in Robust Markov Games with Large State Space through Linear Function Approximation

    May 4, 2026Jingchu Gai, Laixi ShiMulti-Agent System OptimizationMarkov Models

  18. Wasserstein Distributionally Robust Regret Optimization for Reinforcement Learning from Human Feedback

    Apr 30, 2026Yikai Wang, Shang Liu, Jose BlanchetReward Over-OptimizationRegret Minimization in RL

  19. A Distributionally Robust Reinforcement Learning Framework for Constrained Urban EV Dispatch

    Apr 28, 2026An Nguyen, Hoang Nguyen, Phuong Le +3Electric Vehicle ChargingConstrained RL

  20. Robust Optimization for Mitigating Reward Hacking with Correlated Proxies

    Apr 13, 2026Zixuan Liu, Xiaolin Sun, Zizhan ZhengReward HackingRobust RL

  21. Robust Adversarial Policy Optimization Under Dynamics Uncertainty

    Apr 13, 2026Mintae Kim, Koushil SreenathAdversarial MARLReinforcement Learning

  22. Distributionally Robust Token Optimization in RLHF

    Mar 27, 2026Yeping Jin, Jiaming Hu, Ioannis Ch. PaschalidisLanguage Model RobustnessReasoning Consistency in Language Models

  23. Robust Regularized Policy Iteration under Transition Uncertainty

    Mar 10, 2026Hongqiang Lin, Zhenghui Fu, Weihao Tang +4Offline RLRobust RL

  24. Robust Transfer Learning with Side Information

    Mar 9, 2026Akram S. Awad, Shihab Ahmed, Yue Wang +1Reinforcement LearningRobust Markov Decision Processes

  25. Learning-Based Robust Control: Unifying Exploration and Distributional Robustness for Reliable Robotics via Free Energy

    Mar 6, 2026Hozefa Jesawada, Giovanni Russo, Abdalla Swikir +1Robust ControlDistributionally Robust RL

  26. Fuz-RL: A Fuzzy-Guided Robust Framework for Safe Reinforcement Learning under Uncertainty

    Feb 24, 2026Xu Wan, Chao Yang, Cheng Yang +2Safe RLReinforcement Learning

  27. Finite-Time Convergence of Single-Trajectory Chi-Square Robust Q-Learning With Linear Function Approximation

    Oct 2, 2025Saptarshi Mandal, Yashaswini Murthy, R. SrikantQ-LearningDistributionally Robust RL