Partially Observable Markov Decision Processes

Latest papers 53

All topics
CardsList
  1. Revealing After Overwriting: An Exponential POMDP OPE Lower Bound under History-Dependent Logging

    Oct 4, 2026Youyu Luo, Pengzhan Zhou, Zhida Qin +4Off-Policy EvaluationPartially Observable Markov Decision Processes

  2. A Decentralized Partially Observable Team Decision Methodology with Delayed Information Sharing

    Sep 22, 2026Xiaoxing Ren, Thomas Parisini, Andreas A. MalikopoulosMarkov Decision ProcessesLinear Markov Decision Processes

  3. Reinforcement Learning under State and Outcome Uncertainty: A Foundational Distributional Perspective

    Sep 21, 2026Larry Preuett, Qiuyi Zhang, Muhammad Aurangzeb AhmadDistributional RLMarkov Decision Processes

  4. Adaptive Agent Design

    Sep 14, 2026Raj Kiriti Velicheti, Subhonmesh Bose, Tamer BaşarReinforcement LearningQ-Learning

  5. Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability

    Sep 9, 2026Arnab Chattopadhayay, Debdipta HalderBelief-Space PlanningLLM Agents

  6. Scalable Rao-Blackwellized Online Planning for High-Dimensional POMDPs

    Sep 1, 2026Jiho Lee, Nisar Ahmed, Kyle Hollins Wray +1Belief-Space PlanningPartially Observable Markov Decision Processes

  7. Solving Robust POMDPs with Omega-regular Objectives via Partially Observable Stochastic Games

    Aug 25, 2026Durgam Latha, Dion Reji, S. Akshay +2Robust Markov Decision ProcessesPartially Observable Markov Decision Processes

  8. From Relaxed Indexability to Exact Indexability: A tt-Step Approach for Partially Observable Restless Bandits

    Aug 25, 2026Qizhen Jia, Keqin LiuMulti-Armed BanditsSequential Decision Making

  9. Threshold Structure of Optimal Policies in Restart POMDPs

    Aug 11, 2026Konstantin Avrachenkov, Alexey Piunovskiy, Yi ZhangSequential Decision MakingStochastic Optimal Control

  10. POMDPs for Autonomous Science Exploration

    Aug 4, 2026Daniel Guirguis, Nathan Wallace, Hanna Kurniawati +1Belief-Space PlanningAI for Science

  11. Intention Inference Under Execution Noise: Separating Aleatoric and Epistemic Uncertainty in Social Dilemmas

    Aug 3, 2026Kival Mahadew, Jonathan ShockSocial DilemmasPartially Observable Markov Decision Processes

  12. Minimal Markovization via Stable Quotients in Holonomy-Cover Decision Processes

    Jul 29, 2026Zuyuan Zhang, Yongshan Chen, Mahdi Imani +1Markov Decision ProcessesPartially Observable RL

  13. Semi-Decentralized Multi-Spacecraft Collision Avoidance under Communication Constraints

    Jul 29, 2026Grace Ra Kim, Mahdi Al-Husseini, Duncan Eddy +1Collision AvoidancePartially Observable Markov Decision Processes

  14. Beyond Fixed Goal Delivery: Online POMDP Planning for Target Interception in Crowds

    Jul 20, 2026Himanshu Gupta, Kelvin Aladum, Nisar Ahmed +2Robot NavigationSafe Motion Planning

  15. Learning-Driven Adaptive Audit Scheduling: A Sequential Decision Approach to Off-Chain Data Integrity

    Jul 19, 2026Changting Lin, Fan Li, Weihang Yu +4Markov Decision ProcessesDeep Q-Learning

  16. Expected Free Energy as Belief-Dependent Utility for rho-POMDPs

    Jul 18, 2026Patrick Cooper, Alvaro VelasquezFree Energy CalculationActive Inference

  17. LQG solution for POMDP without estimating states: A minimum variance approach

    Jul 13, 2026Ranjan Sarkar, Prabhat K. MishraStochastic Optimal ControlFeedback Control

  18. Active Noise Floor Estimation for Reliability-Optimal POMDPs: A Value-of-Noise-Information Approach

    Jul 13, 2026Hyung-Jin YoonValue of InformationActive Sensing

  19. Interleaved POMDP Planning for Multi-Object Search in Unknown Multi-Room Household Environments

    Jul 11, 2026Ruochu Yang, Ziyi Xia, Huibo Zhang +6Belief-Space PlanningPartially Observable Markov Decision Processes

  20. QANTIS: Hardware-Calibrated Sequential POMDP Belief Updates on IBM Heron

    Jul 7, 2026Bayram Yuksel Eker, Suayb S. Arslan, Ozgur Nazli +2Belief-Space PlanningBayesian Filtering

  21. REBA: A Revealed Belief Automaton Framework for Online Planning in Continuous POMDPs

    Jun 20, 2026Xiangwei Chen, Lingling Fang, Andreas Holzinger +1Belief-Space PlanningPartially Observable Markov Decision Processes

  22. VOiLA: Vectorized Online Planning with Learned Diffusion Models for POMDP Agents

    Jun 18, 2026Marcus Hoerger, Rishikesh Joshi, Rahul Shome +2Belief-Space PlanningDiffusion-Based Planning

  23. Generative-Model Predictive Planning for Navigation in Partially Observable Environments

    Jun 17, 2026Thomas Quilter, Yifan Zhu, Guorui Quan +2Belief-Space PlanningDiffusion-Based Planning

  24. PO-PDDL: Learning Symbolic POMDPs from Visual Demonstrations for Robot Planning Under Uncertainty

    Jun 14, 2026Wenjing Tang, Xuanjin Jin, Yuan Liu +3Belief-Space PlanningSymbolic Planning

  25. Think Fast and Far: Long-Horizon Online POMDP Planning via Rapid State Sampling

    Jun 3, 2026Yuanchu Liang, Edward Kim, J. Arden Knoll +4Belief-Space PlanningPartially Observable Markov Decision Processes

  26. Why Linear Recurrent Memory Works in Partially Observable Reinforcement Learning

    May 29, 2026Yike Zhao, Onno Eberhard, Malek Khammassi +2Partially Observable RLMarkov Models