Bayesian RL

RL: Reinforcement Learning

Overview

Bayesian reinforcement learning studies how agents can learn and act when rewards, dynamics, or task goals are uncertain. Common approaches include posterior sampling such as Thompson sampling, Bayes-adaptive planning over beliefs, and Gaussian-process or variational models that use uncertainty to direct exploration. Methods are applied to tabular and linear Markov decision processes, partially observed tasks, continuous control, robotics, and offline learning, with regret guarantees and evaluations on control and manipulation benchmarks. A central tension is balancing informative exploration and safe, robust behavior while keeping inference tractable and avoiding misleading beliefs when the model is misspecified.

Latest papers

CardsList

40 papers9 papers in the last four weeks, up 125% on the four weeks before. 0.1% of all new papers.

  1. OPSRL-SSP: Optimistic Posterior Sampling for Stochastic Shortest Path with Minimax-Optimal Regret

    Nov 8, 2026Yiming Xu, Xian Wei, Cheng ChenReinforcement LearningRegret Minimization in RL

  2. FADE: Factored Ability--Difficulty Filtering for Online RLVR Scheduling

    Nov 2, 2026Tomas Duncun, Jonah Ellison, Mateo Ruiz +2Reinforcement Learning with Verifiable RewardsCurriculum RL

  3. Bayesian Offline Multi-Agent Reinforcement Learning with Latent World Models

    Oct 29, 2026Xi Xiong, Lu Liu, Yiming Li +1Offline MARLModel-Based RL

  4. Approximate Universal Prediction under Interaction

    Oct 24, 2026Richard Cornelius SuwandiBayesian RL

  5. Reinforcement Learning with Multi-Step Transition Predictions: A Bellman Theory

    Oct 23, 2026Chenbei Lu, Zaiwei Chen, Tongxin Li +2Reinforcement LearningModel-Based RL

  6. Is In-Context Reinforcement Learning A Posterior Sampler? An Empirical Study

    Oct 20, 2026Weiqin Chen, Xinlong Du, Gesualdo Scutari +1In-Context RLTransformer-Based RL

  7. Towards instance-dependent regret optimality in Episodic MDPs with Posterior Sampling

    Oct 19, 2026Victor Boone, Cyrille Kone, Waris Radji +2Regret Minimization in RLMarkov Decision Processes

  8. What Information Buys in Active Inference

    Oct 13, 2026Melih Kandemir, Mustafa Mert ÇelikokRL ExplorationActive Inference

  9. MaPP: A Unified Marginalized Posterior-Predictive Framework for Data-Efficient RLVR

    Sep 28, 2026Yangyang Ren, Haodong Zhu, Sheng Xu +4Prompt Selection for RLBayesian RL

  10. Efficient Bayes-Adaptive Reinforcement Learning with Temporal Logic Specifications

    Sep 17, 2026Jonathan Hau, Alessandro AbateBayesian RLSafe RL

  11. Subspace Inference Enables Efficient Active Reward Learning from Preferences

    Sep 3, 2026Yutai Zhou, Erdem BıyıkBayesian RLActive Preference Learning

  12. Quantifying Risk Under Evolving Uncertainty: Belief-Dependent Robustness for Safe Sequential Decision Making

    Aug 18, 2026Deep Kumar Ganguly, Jan KretinskyRisk-Sensitive PlanningRobust RL

  13. Q-based Variational Inverse Reinforcement Learning

    Aug 17, 2026Ondrej Bajgar, Peter Tisnikar, Alessandro Abate +2Reinforcement LearningBayesian RL

  14. Full Bayesian Reinforcement Learning via LF-IBIS

    Jul 2, 2026Stefano Masini, Cecilia Viscardi, Michela BacciniSimulation-Based InferenceReinforcement Learning

  15. Agentic Monte Carlo: Simulating Reinforcement Learning for Black-Box Agents

    Jun 3, 2026Dae Yon Hwang, Raunaq Suri, Valentin Villecroze +4Reinforcement LearningBayesian RL

  16. Bayesian learning for the stochastic shortest path problem

    Jun 3, 2026Chon Wai Ho, Sumeetpal S. Singh, Jiaqi GuoMarkov Decision ProcessesReinforcement Learning

  17. Regularized Offline Policy Optimization with Posterior Hybrid Bayesian Belief

    May 30, 2026Hongqiang Lin, Pengfei Wang, Nenggan ZhengReinforcement LearningBayesian RL

  18. Information-Directed Offline-to-Online Reinforcement Learning

    May 28, 2026Keru ChenRegret Minimization in RLBayesian RL

  19. Evolving Robustness--Exploration Trade-off in Online Reinforcement Learning via Quantile Bayesian Risk MDPs

    May 23, 2026Meichen Song, Yuhao Wang, Enlu ZhouReinforcement LearningBayesian RL

  20. Bayesian policy gradient and actor-critic algorithms

    Apr 30, 2026Mohammad Ghavamzadeh, Yaakov Engel, Michal ValkoBayesian RLTemporal-Difference Learning

  21. Golden Handcuffs make safer AI agents

    Apr 15, 2026Aram Ebtekar, Michael K. CohenAI Agent SafetySafe RL

  22. Integrating Deep RL and Bayesian Inference for ObjectNav in Mobile Robotics

    Mar 26, 2026João Castelo-Branco, José Santos-Victor, Alexandre BernardinoObject-Goal NavigationRobot Navigation

  23. Bayesian Learning in Episodic Zero-Sum Games

    Mar 21, 2026Chang-Wei Yueh, Andy Zhao, Ashutosh Nayyar +1Zero-Sum GamesGame-Theoretic RL

  24. Posterior Sampling Reinforcement Learning with Gaussian Processes for Continuous Control: Sublinear Regret Bounds for Unbounded State Spaces

    Mar 9, 2026Hamish Flynn, Joe Watson, Ingmar Posner +1RL ControlRegret Minimization in RL

  25. A Model-Free Universal AI

    Feb 26, 2026Yegon Kim, Juho LeeReinforcement LearningBayesian RL