Robust RL

RL: Reinforcement Learning

Ask about this topic

Overview

Robust reinforcement learning studies how agents can make reliable decisions when dynamics, observations, rewards, or other agents differ from training conditions. Common approaches include robust Markov decision processes and distributionally robust optimization, adversarial training and domain randomization, and policies that use history or uncertainty estimates to adapt. Safety shields and formal verification add ways to constrain or certify behavior, with evaluation spanning control benchmarks, robotics, driving, and offline or multi-agent settings. A central tension is that worst-case protection can make policies overly conservative, while nominal performance may not predict transfer to unseen shifts; measuring that trade-off remains a key challenge.

Latest papers

CardsList

231 papers26 papers in the last four weeks, up 13% on the four weeks before. 0.2% of all new papers.

  1. Single Agent Robust Deep Reinforcement Learning for Bus Fleet Control

    Aug 28, 2025Yifan Zhang, Liang Zheng, Qifan ZhangReinforcement LearningIntelligent Transportation Systems

    Central South University

  2. Unsupervised Partner Design Enables Robust Ad-hoc Teamwork

    Aug 8, 2025Constantin Ruhdorfer, Matteo Bortoletto, Victor Oei +2Multi-Agent CollaborationAd Hoc Teamwork

    Collaborative Artificial Intelligence, University of Stuttgart, Stuttgart, Germany.

  3. Distributionally Robust Markov Games with Average Reward

    Aug 5, 2025Zachary Roch, Yue WangNash Equilibrium ComputationMulti-Agent System Optimization

    Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida, USA. · Department of Computer Science, University of Central Florida, Orlando, Florida, USA.

  4. Curriculum-Adapted Robust Reinforcement Learning for UAV Deconfliction in Adversarial Environments

    Jun 26, 2025Deepak Kumar Panda, Adolfo Perrusquia, Weisi GuoRobust RLUAV Navigation

    the Faculty of Engineering and Applied Sciences, Cranfield University, MK43 0AL Cranfield, U.K

  5. Discrete Compositional Generation via General Soft Operators and Robust Reinforcement Learning

    Jun 20, 2025Marco Jiralerspong, Esther Derman, Danilo Vucetic +5Scientific DiscoveryGenerative Modeling

    1Université de Montréal · 2Mila · 5Independent +1

  6. Similarity as Reward Alignment: Robust and Versatile Preference-based Reinforcement Learning

    Jun 14, 2025Sara Rajaram, R. James Cotton, Fabian H. SinzOffline RLRobust RL

    Institute for Computer Science and Campus Institute for Data Science, University of Göttingen, Göttingen, Germany · University Hospital Tübingen, Tübingen, Germany · International Max Planck Research School for Intelligent Systems, Tübingen, Germany +2

  7. Efficient Q-Learning and Actor-Critic Methods for Robust Average-Reward Reinforcement Learning

    Jun 8, 2025Yang Xu, Swetha Ganesh, Vaneet AggarwalRobust Markov Decision ProcessesReinforcement Learning

    Purdue University, West Lafayette, Indiana, USA 47907

  8. Distributionally Robust Deep Q-Learning

    May 25, 2025Chung I Lu, Julian Sester, Aijia ZhangRobust Markov Decision ProcessesDeep Q-Learning

    National University of Singapore, Department of Mathematics, 21 Lower Kent Ridge Road, 119077.

  9. Model-Free Robust Average-Reward Reinforcement Learning with Sample Complexity Analysis

    May 18, 2025Zachary Roch, George Atia, Yue WangReinforcement LearningAverage-Reward RL

    Department of Electrical and Computer Engineering, University of Central Florida, Orlando, Florida, USA. · Department of Computer Science, University of Central Florida, Orlando, Florida, USA.

  10. Towards More Efficient, Robust, Instance-adaptive, and Generalizable Sequential Decision making

    Apr 12, 2025Zhiyong WangMulti-Armed BanditsReinforcement Learning

    Department of Computer Science and Engineering, The Chinese University of Hong Kong

  11. A Robust Model-Based Approach for Continuous-Time Policy Evaluation with Unknown Lévy Process Dynamics

    Apr 2, 2025Qihao Ye, Xiaochuan Tian, Yuhua ZhuReinforcement LearningValue Function Estimation

  12. Reward-Centered ReST-MCTS: A Robust Decision-Making Framework for Robotic Manipulation in High Uncertainty Environments

    Mar 7, 2025Xibai WangReward ShapingMonte Carlo Tree Search

    NeuroQuant Labs Limited Hong Kong SAR, China

  13. Distributionally Robust Reinforcement Learning with Human Feedback

    Mar 1, 2025Debmalya Mandal, Paulius Sasnauskas, Goran RadanovicDirect Preference OptimizationLLM Fine-Tuning

    Dept. of Computer Science University of Warwick, UK · Department of Computing Science University of Alberta, Edmonton, Canada · Max-Planck Institute for Software Systems, Germany

  14. Training Verifiably Robust Agents Using Set-Based Reinforcement Learning

    Aug 17, 2024Manuel Wendl, Lukas Koller, Tobias Ladner +1RL ControlReinforcement Learning

    Technical University of Munich, Germany

  15. Enhancing Hardware Fault Tolerance in Machines with Reinforcement Learning Policy Gradient Algorithms

    Jul 21, 2024Sheila Schoepp, Mehran Taghian, Shotaro Miwa +3RL ControlReinforcement Learning

    Department of Computing Science, University of Alberta, 8900 114 St NW, Edmonton, Alberta, T6G 2S4, Canada · Advanced Technology R&D Center, Mitsubishi Electric Corporation, 8-1-1,Tsukaguchi-honmachi, Amagasaki-shi, Hyogo, 661-8661, Japan · Information Technology R&D Center, Mitsubishi Electric Corporation, 5-1-1, Ofuna, Kamakura-shi, Kanagawa, 247-8501, Japan +1

  16. PA-LOCO: Learning Perturbation-Adaptive Locomotion for Quadruped Robots

    Jul 5, 2024Zhiyuan Xiao, Xinyu Zhang, Xiang Zhou +1RL for Legged LocomotionQuadruped Locomotion

    School of Aeronautics and Astronautics, Sun Yat-sen University, Shenzhen 518107, P.R. China.

  17. Lipschitz-Regularized Critics Lead to Policy Robustness Against Transition Dynamics Uncertainty

    Apr 22, 2024Xulin Chen, Ruipeng Liu, Zhenyu Gan +1Robotic RLRobust RL

    College of Engineering & Computer Science, Syracuse University

  18. Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithms

    Apr 4, 2024Miao Lu, Han Zhong, Tong Zhang +1Distributionally Robust RLRobust RL

    †Department of Management Science and Engineering, Stanford University. · ‡Center for Data Science, Peking University. · §Department of Computer Science, University of Illinois Urbana-Champaign.

  19. Corruption Robust Offline Reinforcement Learning with Human Feedback

    Feb 9, 2024Debmalya Mandal, Andi Nika, Parameswaran Kamalaruban +2Offline RLCorruption Robustness

    Dept. of Computer Science University of Warwick, UK · Max-Planck Institute for Software Systems, Germany · Independent Researcher London, UK

  20. Robust Recurrent Reinforcement Learning under Evolving Hidden Disturbances with Application to Rover Wheel Slip

    Jul 29, 2023Saki Omi, Hyo-Sang Shin, Namhoon Cho +2RL for RoboticsReinforcement Learning

    Space Robotics Research Group, Interdisciplinary Centre for Security, Reliability and Trust, University of Luxembourg · School of Aerospace, Transport and Manufacturing, Cranfield University, Cranfield, U.K. · Department of Aerospace Engineering, Seoul National University, Seoul, South Korea

  21. Security of Deep Reinforcement Learning for Autonomous Driving: A Survey

    Dec 12, 2022Ambra Demontis, Srishti Gupta, Maura Pintor +6Robust RLRL for Autonomous Driving

    University of Cagliari · Sapienza, University of Rome · University of Genoa +3