Partially Observable Markov Decision Process

Ask about this topic

Recent momentum

-14%

6 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Markov Decision Processes

Neighbouring directions

Markov Decision ProcessesOptimal PoliciesValue FunctionsBellman Equation

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Partially Observable Markov Decision Process.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Partially Observable Markov Decision Process.

Period ending 2026-09-07

3 new papers

A weekly snapshot of new work published in Partially Observable Markov Decision Process.

65 papers

Latest in Partially Observable Markov Decision Process

Open your feed →
CardsList

  1. Reinforcement Learning under State and Outcome Uncertainty: A Foundational Distributional Perspective

    Sep 21, 2026Larry Preuett, Qiuyi Zhang, Muhammad Aurangzeb AhmadPartially Observable Markov Decision Process

  2. Task-Oriented Active Learning of Residual Dynamics for Model Predictive Path Integral Control

    Sep 16, 2026Nobuaki Aoki, Hojin Lee, Stefan Sosnowski +1Model Predictive Path IntegralActive Learning

  3. Exponential Hardness of Off-Policy Evaluation under History-Dependent Logging

    Sep 16, 2026Pranaya JajooOff-Policy EvaluationPartially Observable Markov Decision Process

  4. Learning Intrusion Response Strategies for OT Systems

    Sep 9, 2026Duc Huy Le, Rolf StadlerIntrusion DetectionIncident Response

  5. Belief-State Engine: Augmenting LLMs for Principled Planning Under Partial Observability

    Sep 9, 2026Arnab Chattopadhayay, Debdipta HalderPartially Observable Markov Decision ProcessLatent States

  6. Conditional Timed Partial Orders: An Expressive and Interpretable Framework for Robot Task Specification and Planning

    Sep 7, 2026Sebastian Escobar, Morteza LahijanianPartially Observable Markov Decision ProcessPlanning Methods

  7. Scalable Rao-Blackwellized Online Planning for High-Dimensional POMDPs

    Sep 1, 2026Jiho Lee, Nisar Ahmed, Kyle Hollins Wray +1Robot PlanningPartially Observable Markov Decision Process

  8. Threshold Structure of Optimal Policies in Restart POMDPs

    Aug 11, 2026Konstantin Avrachenkov, Alexey Piunovskiy, Yi ZhangPartially Observable Markov Decision ProcessMarkov Decision Processes

  9. Per-Shipment Multi-Agent Reinforcement Learning for Intermodal Freight Routing Under Hurricane Disruption

    Aug 7, 2026Aliza Sharmin, Xudong Wang, Mustafa Can Camur +1Last MileMulti-Agent Reinforcement Learning

  10. POMDPs for Autonomous Science Exploration

    Aug 4, 2026Daniel Guirguis, Nathan Wallace, Hanna Kurniawati +1Belief SpacePartially Observable Markov Decision Process

  11. Intention Inference Under Execution Noise: Separating Aleatoric and Epistemic Uncertainty in Social Dilemmas

    Aug 3, 2026Kival Mahadew, Jonathan ShockPartially Observable Markov Decision ProcessInitial Human Belief Distributions

  12. Corrigible Assistance in One Round: Pragmatic-Pedagogic Best Response

    Jul 29, 2026Elle Lazarski, Jaime Fernández FisacHuman-Robot CollaborationPartially Observable Markov Decision Process

  13. Minimal Markovization via Stable Quotients in Holonomy-Cover Decision Processes

    Jul 29, 2026Zuyuan Zhang, Yongshan Chen, Mahdi Imani +1Partially Observable Markov Decision ProcessMarkov

  14. Semi-Decentralized Multi-Spacecraft Collision Avoidance under Communication Constraints

    Jul 29, 2026Grace Ra Kim, Mahdi Al-Husseini, Duncan Eddy +1Collision AvoidanceGlobal Coordination

  15. Learning Spatiotemporal Decision Priors for Efficient Path Planning under Partial Observability

    Jul 24, 2026Yi Liu, Hongda Zhang, Leyao Zou +7Coverage Path PlanningPartially Observable Markov Decision Process

  16. The Dark Room in the Reward Channel: Dense Prediction Rewards Collapse GRPO-Trained LLM Agents -- and The Channel, Not the Content, Decides What Works

    Jul 23, 2026Yu WangShared RewardsLarge Language Model Agents

  17. Reward-Driven LLM Agent Workflows: Synthesizing POMDP Routing and Self-Correction for Autonomous Decision-Making

    Jul 19, 2026Amez Amanj Ali, Kuo-Kun TsengMulti-Agent Large Language Model SystemsPartially Observable Markov Decision Process

  18. Expected Free Energy as Belief-Dependent Utility for rho-POMDPs

    Jul 18, 2026Patrick Cooper, Alvaro VelasquezPartially Observable Markov Decision ProcessFree Energy Principle

  19. Interactive Task Alignment as a POMDP

    Jul 17, 2026Andy Dai, Zexue He, Zhenyu Zhang +2Partially Observable Markov Decision Process

  20. LQG solution for POMDP without estimating states: A minimum variance approach

    Jul 13, 2026Ranjan Sarkar, Prabhat K. MishraLinear Quadratic RegulatorDiscrete-Time Linear Systems

  21. Active Noise Floor Estimation for Reliability-Optimal POMDPs: A Value-of-Noise-Information Approach

    Jul 13, 2026Hyung-Jin YoonNoisy DataPartially Observable Markov Decision Process

  22. Interleaved POMDP Planning for Multi-Object Search in Unknown Multi-Room Household Environments

    Jul 11, 2026Ruochu Yang, Ziyi Xia, Huibo Zhang +6Partially Observable Markov Decision ProcessIndoor Environments

  23. Stochastic Linear Bandits with Partially Observed Actions

    Jul 9, 2026Gautam Dasarathy, Vineet Gattani, Lalit JainPartially Observable Markov Decision ProcessPart

  24. Implementation of reinforcement learning in chemical reaction networks: application to phototaxis as curiosity-driven exploration

    Jun 24, 2026Ruyi Tang, Grégoire Sergeant-Perthuis, David ColliauxPartially Observable Markov Decision ProcessReaction

  25. REBA: A Revealed Belief Automaton Framework for Online Planning in Continuous POMDPs

    Jun 20, 2026Xiangwei Chen, Lingling Fang, Andreas Holzinger +1Partially Observable Markov Decision ProcessBelief

  26. Mobile Target Search with Imperfect Perception: A Partially Observable Stochastic Game Theoretical Approach

    Jun 18, 2026Hanzheng Zhang, Shu Liang, Shuyu LiuZero--Sum Differential GamePartially Observable Markov Decision Process

  27. VOiLA: Vectorized Online Planning with Learned Diffusion Models for POMDP Agents

    Jun 18, 2026Marcus Hoerger, Rishikesh Joshi, Rahul Shome +2Partially Observable Markov Decision ProcessDiffusion Planning

  28. Optimizing Lithium Production Decisions under Geological, Demand, and Pricing Uncertainties: A POMDP Framework for Multi-Objective Decision Making

    Jun 17, 2026Anna C. Edmonds, Mansur M. Arief, Robert J. Moss +2Partially Observable Markov Decision ProcessLithium-Ion Batteries

  29. Orchestrated Reality: From Role-Play to Living, Playable Game Worlds -- LLM-Driven World Simulation as a Parameterized-Action POMDP

    Jun 14, 2026Yuhang Huang, Chenmiao Li, Chaowei FangRole-Playing AgentsReal-World Environments

  30. PO-PDDL: Learning Symbolic POMDPs from Visual Demonstrations for Robot Planning Under Uncertainty

    Jun 14, 2026Wenjing Tang, Xuanjin Jin, Yuan Liu +3Partially Observable Markov Decision ProcessBelief Space

  31. Think Fast and Far: Long-Horizon Online POMDP Planning via Rapid State Sampling

    Jun 3, 2026Yuanchu Liang, Edward Kim, J. Arden Knoll +4Partially Observable Markov Decision Process

  32. Minimax-Optimal Policy Regret in Partially Observable Markov Games

    Jun 1, 2026Raman AroraPartially Observable Markov Decision ProcessExpectation-Maximization

  33. Why Linear Recurrent Memory Works in Partially Observable Reinforcement Learning

    May 29, 2026Yike Zhao, Onno Eberhard, Malek Khammassi +2Recurrent ModelPartially Observable Markov Decision Process

  34. Scaling Observation-aware Planning in Uncertain Domains

    May 21, 2026Adrian Zvizdenco, Arthur Conrado Veiga Bosquetti, Alberto Lluch Lafuente +1Partially Observable Markov Decision ProcessPartial Observability

  35. Smaller Abstract State Spaces Enable Cross-Scale Generalization in Reinforcement Learning

    May 19, 2026Nasehatul Mustakim, Lucas LehnertState SpacePartially Observable Markov Decision Process

  36. Context, Reasoning, and Hierarchy: A Cost-Performance Study of Compound LLM Agent Design in an Adversarial POMDP

    May 15, 2026Igor Bogdanov, Chung-Horng Lung, Thomas Kunz +3Large Language Model AgentsPartially Observable Markov Decision Process

  37. Synthesizing POMDP Policies: Sampling Meets Model-checking via Learning

    May 14, 2026Debraj Chakraborty, Anirban Majumdar, Prince Mathew +2Partially Observable Markov Decision ProcessMarkov Decision Processes

  38. Learning POMDP World Models from Observations with Language-Model Priors

    May 13, 2026Valentin Six, Frederik Panse, Mathis Fajeau +7Partially Observable Markov Decision ProcessLatent World Models

  39. Adaptive mine planning under geological uncertainty: A POMDP framework for sequential decision-making

    May 13, 2026Hamza Khalifi, Jef Caers, Yassine Taha +2Partially Observable Markov Decision ProcessMarkov Decision Processes

  40. What Do You Think I Think? Accounting for Human Beliefs Using Second-Order Theory of Mind

    May 12, 2026Patrick Callaghan, Reid Simmons, Henny AdmoniTheory-Of-Mind ReasoningBelief

  41. Ensuring Logic in the Fog: Sound POMDP Synthesis with LTL Objectives

    May 12, 2026Can Zhou, Yulong Gao, Pian YuLinear Temporal LogicsPartially Observable Markov Decision Process

  42. Missingness-MDPs: Bridging the Theory of Missing Data and POMDPs

    May 12, 2026Joshua Wendland, Markel Zubia, Roman Andriushchenko +6Partially Observable Markov Decision ProcessMissing Data

  43. On the Importance of Multistability for Horizon Generalization in Reinforcement Learning

    May 12, 2026Asad Bakija, Florent De Geeter, Julien Brandoit +2Deep Reinforcement LearningPartially Observable Markov Decision Process

  44. When Simulation Lies: A Sim-to-Real Benchmark and Domain-Randomized RL Recipe for Tool-Use Agents

    May 12, 2026Xiaolin Zhou, Aojie Yuan, Zheng Luo +12Deep Reinforcement LearningSim-To-Real Gap

  45. Federated Client Selection under Partial Visibility: A POMDP Approach with Spatio-Temporal Attention

    May 12, 2026Qijun Hou, Yuchen Shi, Pingyi Fan +1Federated LearningPartially Observable Markov Decision Process

  46. Engagement Process: Rethinking the Temporal Interface of Action and Observation

    May 12, 2026Jialian Li, Yuchen Cao, Junhong Liu +5Partially Observable Markov Decision ProcessToward Interaction Dynamics

  47. Finite-Time Analysis of MCTS in Continuous POMDP Planning

    May 8, 2026Da Kong, Vadim IndelmanPartially Observable Markov Decision ProcessMonte Carlo Tree Search

  48. Multi-Environment POMDPs with Finite-Horizon Objectives

    May 8, 2026Léonard Brice, Filip Cano, Krishnendu Chatterjee +2Partially Observable Markov Decision ProcessMarkov Decision Processes

  49. MedExAgent: Training LLM Agents to Ask, Examine, and Diagnose in Noisy Clinical Environments

    May 8, 2026Yicheng Gao, Xiaolin Zhou, Yahan Li +2Clinical ReasoningDiagnostic Benchmark

  50. The Context Gathering Decision Process: A POMDP Framework for Agentic Search

    May 7, 2026Chinmaya Kausik, Adith Swaminathan, Nathan KallusLarge Language Model AgentsAgentic Reasoning

  51. Prediction and Empowerment: A Theory of Agency through Bridge Interfaces

    May 7, 2026Richard CsakyAgentic ControlPartially Observable Markov Decision Process

  52. Structural Equivalence and Learning Dynamics in Delayed MARL

    May 5, 2026Jules Sintes, Ana Bušić, Jiamin ZhuPartially Observable Markov Decision ProcessMulti-Agent Reinforcement Learning

  53. The Design and Composition of Structural Causal Decision Processes

    May 4, 2026Sebastian Benthall, Alan LujanStructural Causal ModelAgent Decisions

  54. A High-Throughput Compute-Efficient POMDP Hide-And-Seek-Engine (HASE) for Multi-Agent Operations

    Apr 29, 2026Timothy Flavin, Sandip SenPartially Observable Markov Decision ProcessMulti-Agent Reinforcement Learning

  55. Variational Neural Belief Parameterizations for Robust Dexterous Grasping under Multimodal Uncertainty

    Apr 28, 2026Clinton Enwerem, Shreya Kalyanaraman, John S. Baras +1Grasp GenerationBelief Space

  56. SLAM as a Stochastic Control Problem with Partial Information: Optimal Solutions and Rigorous Approximations

    Apr 23, 2026Ilir Gusija, Fady Alajaji, Serdar YükselSimultaneous Localization And MappingPartially Observable Markov Decision Process

  57. Robustness Analysis of POMDP Policies to Observation Perturbations

    Apr 23, 2026Benjamin Kraske, Qi Heng Ho, Federico Rossi +2Partially Observable Markov Decision ProcessNon-Stationarity

  58. Interval POMDP Shielding for Imperfect-Perception Agents

    Apr 22, 2026William Scarbro, Ravi MangalShieldingPartially Observable Markov Decision Process

  59. Active World-Model with 4D-informed Retrieval for Exploration and Awareness

    Apr 17, 2026Elaheh Vaezpour, Amirhosein Javadi, Tara JavidiWorld ModelsAutonomous Exploration Strategies

  60. POMDP-based Object Search with Growing State Space and Hybrid Action Domain

    Apr 16, 2026Yongbo Chen, Hesheng Wang, Shoudong Huang +1Partially Observable Markov Decision ProcessRobotics