Partially Observable Markov Decision Processes

Ask about this topic

Momentum

7 papers in the last four weeks, up 75% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 53

All topics
CardsList

  1. Know You Before You Speak: User-State Modeling for LLM Personalization in Multi-Turn Conversation

    May 23, 2026Jiani Luo, Xiaoyan Zhao, Yang Zhang +4LLM PersonalizationUser Modeling

    School of Computing, National University of Singapore, Singapore · School of Artificial Intelligence, Beihang University, Beijing, China · Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China +1

  2. Scaling Observation-aware Planning in Uncertain Domains

    May 21, 2026Adrian Zvizdenco, Arthur Conrado Veiga Bosquetti, Alberto Lluch Lafuente +1Partially Observable Markov Decision Processes

    Technical University of Denmark, Kongens Lyngby

  3. Synthesizing POMDP Policies: Sampling Meets Model-checking via Learning

    May 14, 2026Debraj Chakraborty, Anirban Majumdar, Prince Mathew +2Formal VerificationPartially Observable Markov Decision Processes

    Nanyang Technological University, Singapore · Tata Institute of Fundamental Research, Mumbai, India · Université Libre de Bruxelles, Brussels, Belgium +1

  4. Learning POMDP World Models from Observations with Language-Model Priors

    May 13, 2026Valentin Six, Frederik Panse, Mathis Fajeau +7World Model LearningMarkov Models

    1Max Planck Institute for Intelligent Systems · University of Tübingen · 2IRIIS +3

  5. Adaptive mine planning under geological uncertainty: A POMDP framework for sequential decision-making

    May 13, 2026Hamza Khalifi, Jef Caers, Yassine Taha +2Sequential Decision MakingPartially Observable Markov Decision Processes

    Geology & Sustainable Mining Institute (GSMI), University Mohammed VI Polytechnic (UM6P), 43150, Benguerir, Morocco · Department of Earth and Planetary Sciences, Stanford University, Stanford, CA 94305, USA

  6. Ensuring Logic in the Fog: Sound POMDP Synthesis with LTL Objectives

    May 12, 2026Can Zhou, Yulong Gao, Pian YuBelief-Space PlanningReward Shaping

    Imperial College London, United Kingdom · University College London, United Kingdom

  7. Missingness-MDPs: Bridging the Theory of Missing Data and POMDPs

    May 12, 2026Joshua Wendland, Markel Zubia, Roman Andriushchenko +6Markov ModelsLearning with Missing Data

    1Ruhr University Bochum · 2Brno University of Technology · 3Radboud University Nijmegen +2

  8. Engagement Process: Rethinking the Temporal Interface of Action and Observation

    May 12, 2026Jialian Li, Yuchen Cao, Junhong Liu +5Partially Observable RLPartially Observable Markov Decision Processes

    XPENG ROBOTICS

  9. CLR-voyance: Reinforcing Open-Ended Reasoning for Inpatient Clinical Decision Support with Outcome-Aware Rubrics

    May 10, 2026Aishik Nagar, Arun-Kumar Kaliya-Perumal, Yu-Hsuan Han +5HealthcareClinical Decision Support

    ASUS Intelligent Cloud Services (AICS) · Rehabilitation Research Institute of Singapore, Nanyang Technological University · Department of Family Medicine,2026 Taipei Veterans General Hospital +2

  10. Finite-Time Analysis of MCTS in Continuous POMDP Planning

    May 8, 2026Da Kong, Vadim IndelmanMonte Carlo Tree SearchPartially Observable Markov Decision Processes

    Technion Autonomous Systems Program (TASP) · Technion – Israel Institute of Technology · Stephen B. Klein Faculty of Aerospace Engineering +1

  11. Multi-Environment POMDPs with Finite-Horizon Objectives

    May 8, 2026Léonard Brice, Filip Cano, Krishnendu Chatterjee +2Belief-Space PlanningMarkov Models

    Institute of Science and Technology Austria

  12. The Context Gathering Decision Process: A POMDP Framework for Agentic Search

    May 7, 2026Chinmaya Kausik, Adith Swaminathan, Nathan KallusAgentic SearchLLM Agents

    University of Michigan · Netflix

  13. Prediction and Empowerment: A Theory of Agency through Bridge Interfaces

    May 7, 2026Richard CsakyPartially Observable Markov Decision Processes

  14. Structural Equivalence and Learning Dynamics in Delayed MARL

    May 5, 2026Jules Sintes, Ana Bušić, Jiamin ZhuPartially Observable Markov Decision ProcessesCooperative MARL

    Inria · DIENS, École Normale Supérieure, PSL University · Paris, France +2

  15. A High-Throughput Compute-Efficient POMDP Hide-And-Seek-Engine (HASE) for Multi-Agent Operations

    Apr 29, 2026Timothy Flavin, Sandip SenHigh-Performance ComputingPartially Observable Markov Decision Processes

  16. Optimal sequential decision-making for error propagation mitigation in digital twins

    Apr 24, 2026Annice Najafi, Shokoufeh MirzaeiMarkov Decision ProcessesPartially Observable Markov Decision Processes

    Department of Industrial and Manufacturing Engineering California State Polytechnic University, Pomona Pomona, CA, 91768, USA

  17. SLAM as a Stochastic Control Problem with Partial Information: Optimal Solutions and Rigorous Approximations

    Apr 23, 2026Ilir Gusija, Fady Alajaji, Serdar YükselSimultaneous Localization and MappingStochastic Optimal Control

    Department of Mathematics and Statistics, Queen’s University, Kingston, ON, Canada

  18. Robustness Analysis of POMDP Policies to Observation Perturbations

    Apr 23, 2026Benjamin Kraske, Qi Heng Ho, Federico Rossi +2Partially Observable Markov Decision Processes

    University of Colorado Boulder, Boulder, Colorado, USA · Virginia Tech, Blacksburg, Virginia, USA · Jet Propulsion Laboratory, California Institute of Technology, Pasadena, California, USA

  19. Interval POMDP Shielding for Imperfect-Perception Agents

    Apr 22, 2026William Scarbro, Ravi MangalSafety-Critical ControlAI Agent Safety

    Department of Computer Science Colorado State University Fort Collins, USA

  20. POMDP-based Object Search with Growing State Space and Hybrid Action Domain

    Apr 16, 2026Yongbo Chen, Hesheng Wang, Shoudong Huang +1Mobile RoboticsMonte Carlo Tree Search

    School of Automation and Intelligent Sensing, Shanghai Jiao Tong University, Shanghai, 200240, People’s Republic of China · School of Computing, Australian National University (ANU), Canberra, ACT, 2601, Australia (The main part of this work is completed at ANU) · Key Laboratory of System Control and Information Processing, Ministry of Education of China, Shanghai, 200240, People’s Republic of China +1

  21. Communication Gain and Delay Cost Under Cross-Timestep Delays in Cooperative Multi-Agent Reinforcement Learning

    Apr 4, 2026Zihong Gao, Hongjian Liang, Lei Hao +1Partially Observable Markov Decision ProcessesMulti-Agent Communication

    The State Key Laboratory for Manufacturing Systems Engineering School of Automation Science and Engineering, Xi’an Jiaotong University

  22. Fundamental Limits for Sensor-Based Control via the Gibbs Variational Principle

    Mar 19, 2026Vincent Pacelli, Evangelos A. TheodorouFeedback ControlPartially Observable Markov Decision Processes

    Daniel Guggenheim School of Aerospace Engineering, Georgia Institute of Technology, Atlanta, GA, USA, 30308

  23. Toward Learning POMDPs Beyond Full-Rank Actions and State Observability

    Jan 26, 2026Seiji Shaw, Travis Manderson, Chad Kessens +1Partially Observable Markov Decision Processes

    MIT Computer Science and Artificial Intelligence Lab, 51 Vassar St, Cambridge, MA 02139, USA · DEVCOM Army Research Laboratory 2800 Powder Mill Road, Adelphi, MD 20783, USA