Markov Decision Processes

Ask about this topic

Recent momentum

-41%

13 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Markov Decision Processes

Neighbouring directions

Optimal PoliciesValue FunctionsBellman EquationPartially Observable Markov Decision Process

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

7 new papers

A weekly snapshot of new work published in Markov Decision Processes.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Markov Decision Processes.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Markov Decision Processes.

174 papers

Latest in Markov Decision Processes

Browse all topics →
CardsList

  1. CLR-voyance: Reinforcing Open-Ended Reasoning for Inpatient Clinical Decision Support with Outcome-Aware Rubrics

    May 10, 2026Aishik Nagar, Arun-Kumar Kaliya-Perumal, Yu-Hsuan Han +5Clinical ReasoningRubrics

  2. Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning

    May 9, 2026Minmin Zhang, Sina Aghaei, Soroush SaghafianIn-Context LearningLarge Language Model Fine-Tuning

  3. A Single Deep Preference-Conditioned Policy for Learning Pareto Coverage Sets

    May 9, 2026Akihiro Kubo, Kosuke Nakanishi, Shin IshiiOptimal PoliciesConstrained Reinforcement Learning

  4. Reinforcement Learning for Exponential Utility: Algorithms and Convergence in Discounted MDPs

    May 8, 2026Gugan Thoppe, L. A. Prashanth, Ankur Naskar +1Q-LearningMarkov Decision Processes

  5. Finite-Time Analysis of MCTS in Continuous POMDP Planning

    May 8, 2026Da Kong, Vadim IndelmanPartially Observable Markov Decision ProcessMonte Carlo Tree Search

  6. Multi-Environment POMDPs with Finite-Horizon Objectives

    May 8, 2026Léonard Brice, Filip Cano, Krishnendu Chatterjee +2Partially Observable Markov Decision ProcessMarkov Decision Processes

  7. Improved Model-based Reinforcement Learning with Smooth Kernels

    May 8, 2026Kun Long, Yuqiang Li, Xianyi WuMarkov Decision ProcessesSmoothing

  8. Optimizing Social Utility in Sequential Experiments

    May 7, 2026Ander Artola Velasco, Stratis Tsirtsis, Manuel Gomez-RodriguezExpected UtilityBayesian Experimental Design

  9. Gaming the Metric, Not the Harm: Certifying Safety Audits against Strategic Platform Manipulation

    May 7, 2026Florian A. D. Burnat, Brittany I. DavidsonSafety EvaluationCompliance

  10. Resource-Constrained Robotic Planning in the face of Mixed Uncertainty

    May 7, 2026Yihao Yin, Pian Yu, Andrea Turrini +3Robot PlanningRobotics

  11. A Measure-Theoretic Finite-Sample Theory for Adaptive-Data Fitted Q-Iteration

    May 7, 2026Manuel Haussmann, Mustafa Mert Çelikok, Melih KandemirQ-LearningModel-Free Reinforcement Learning

  12. On-line Learning in Tree MDPs by Treating Policies as Bandit Arms

    May 6, 2026Anvay Shah, Ramsundar Anandanarayanan, Sharayu Moharir +1Markov Decision ProcessesBandits

  13. A Harmonic Mean Formulation of Average Reward Reinforcement Learning in SMDPs

    May 6, 2026Erel Shtossel, Alicia Vidler, Uri Shaham +1Markov Decision Processes

  14. Optimal Posterior Sampling for Policy Identification in Tabular Markov Decision Processes

    May 5, 2026Cyrille Kone, Kevin JamiesonOptimal PoliciesMarkov Decision Processes

  15. Adaptive Estimation and Optimal Control in Offline Contextual MDPs without Stationarity

    May 5, 2026Riddhiman Bhattacharyya, Sayak Chakrabarty, Imon BanerjeeMarkov Decision ProcessesLinear Contextual Bandits

  16. Taming the Curses of Multiagency in Robust Markov Games with Large State Space through Linear Function Approximation

    May 4, 2026Jingchu Gai, Laixi ShiMulti-Agent Reinforcement LearningMarkov Decision Processes

  17. Middle-mile logistics through the lens of goal-conditioned reinforcement learning

    May 4, 2026Onno Eberhard, Thibaut Cuvelier, Michal Valko +1Goal-Conditioned Reinforcement LearningLast Mile

  18. Reinforcement Learning Trained Observer Control for Bearings-Only Tracking

    May 4, 2026Branko Ristic, Sanjeev ArulampalamExtended Kalman FilterDeep Q-Networks

  19. Robust Parameter Learning for Uncertain MDPs

    May 2, 2026Yannik Schnitzer, Alessandro Abate, David ParkerMarkov Decision ProcessesConfidence Intervals

  20. Breaking the Computational Barrier: Provably Efficient Actor-Critic for Low-Rank MDPs

    May 2, 2026Ruiquan Huang, Donghao Li, Yingbin Liang +1Soft Actor-CriticMarkov Decision Processes

  21. Model-Based Reinforcement Learning with Double Oracle Efficiency in Policy Optimization and Offline Estimation

    May 1, 2026Haichen Hu, Jian Qian, David Simchi-LeviOffline Reinforcement LearningMarkov Decision Processes

  22. Data Deletion Can Help in Adaptive RL

    Apr 30, 2026Param Budhraja, Aditya Gangrade, Alex Olshevsky +1Linear Contextual BanditsMarkov Decision Processes

  23. Learning to Route Electric Trucks Under Operational Uncertainty

    Apr 29, 2026Stavros Orfanoudakis, Ziyan Li, Ruixiao Yang +4Electric VehiclesVehicle Routing Problem

  24. A Distributionally Robust Reinforcement Learning Framework for Constrained Urban EV Dispatch

    Apr 28, 2026An Nguyen, Hoang Nguyen, Phuong Le +3Electric VehiclesConstrained Reinforcement Learning

  25. V-GRPO: Online Reinforcement Learning for Denoising Generative Models Is Easier than You Think

    Apr 25, 2026Bingda Tang, Yuhui Zhang, Xiaohan Wang +3Group Relative Policy OptimizationGenerative Models

  26. Optimal sequential decision-making for error propagation mitigation in digital twins

    Apr 24, 2026Annice Najafi, Shokoufeh MirzaeiDigital TwinsDigital Twin Framework

  27. Interval POMDP Shielding for Imperfect-Perception Agents

    Apr 22, 2026William Scarbro, Ravi MangalShieldingPartially Observable Markov Decision Process

  28. Planning in entropy-regularized Markov decision processes and games

    Apr 21, 2026Jean-Bastien Grill, Omar Darwiche Domingues, Pierre Ménard +2Markov Decision ProcessesEntropy Regularized Reinforcement Learning

  29. LASER: Learning Active Sensing for Continuum Field Reconstruction

    Apr 21, 2026Huayu Deng, Jinghui Zhong, Xiangming Zhu +2Latent World ModelsPhysical Dynamics

  30. Policy Gradient Primal-Dual Method for Safe Reinforcement Learning from Human Feedback

    Apr 21, 2026Qiang Liu, Adrienne Kline, Ermin WeiReinforcement Learning From Human FeedbackDeep Reinforcement Learning

  31. StepPO: Step-Aligned Policy Optimization for Agentic Reinforcement Learning

    Apr 20, 2026Daoyu Wang, Qingchuan Li, Mingyue Cheng +4Agentic Reinforcement-Learning FrameworkMarkov Decision Processes

  32. Physics-Informed Causal MDPs for Sequential Constraint Repair in Engineering Simulation Pipelines

    Apr 20, 2026Chuhan QiaoStructural Causal ModelMarkov Decision Processes

  33. DARLING: Detection Augmented Reinforcement Learning with Non-Stationary Guarantees

    Apr 17, 2026Argyrios Gerogiannis, Yu-Han Huang, Venugopal V. VeeravalliModel-Free Reinforcement LearningMarkov Decision Processes

  34. Blazing the trails before beating the path: Sample-efficient Monte-Carlo planning

    Apr 16, 2026Jean-Bastien Grill, Michal Valko, Rémi MunosMarkov Decision ProcessesClassical Planning

  35. When Can You Poison Rewards? A Tight Characterization of Reward Poisoning in Linear MDPs

    Apr 11, 2026Jose Efraim Aguilar Escamilla, Haoyang Hong, Jiawei Li +4Reward ModelingMarkov Decision Processes

  36. End-to-End Efficient RL for Linear Bellman Complete MDPs with Deterministic Transitions

    Mar 24, 2026Zakaria Mhammedi, Alexander Rakhlin, Nneka OkoloMarkov Decision ProcessesOptimal Policies

  37. Reward Redistribution for CVaR MDPs using a Bellman Operator on L-infinity

    Feb 3, 2026Aneri Muni, Vincent Taboga, Esther Derman +2Conditional-Value-At-RiskBellman Equation

  38. Data- and Variance-dependent Regret Bounds for Online Tabular MDPs

    Feb 2, 2026Mingyi Li, Taira Tsuchiya, Kenji YamanishiNear-Optimal Regret GuaranteesMarkov Decision Processes

  39. Toward Learning POMDPs Beyond Full-Rank Actions and State Observability

    Jan 26, 2026Seiji Shaw, Travis Manderson, Chad Kessens +1Partially Observable Markov Decision ProcessMarkov Decision Processes

  40. A Probabilistic Approach to Trajectory-Based Optimal Experimental Design

    Jan 16, 2026Ahmed AttiaBayesian Experimental DesignTrajectory Optimization

  41. Beyond Slater's Condition in Online CMDPs with Stochastic and Adversarial Constraints

    Sep 24, 2025Francesco Emanuele Stradi, Eleonora Fidelia Chiefari, Matteo Castiglioni +2Markov Decision ProcessesO(T^Β)$ Simultaneous Regret

  42. Learning Robust Penetration Testing Policies under Partial Observability: A systematic evaluation

    Sep 24, 2025Raphael Simon, Pieter Libin, Wim MeesPartially Observable Markov Decision ProcessPenetration Testing

  43. Distributionally Robust Markov Games with Average Reward

    Aug 5, 2025Zachary Roch, Yue WangZero--Sum Differential GameMarkov Decision Processes

  44. Learning The Minimum Action Distance

    Jun 10, 2025Lorenzo Steccanella, Joshua B. Evans, Özgür Şimşek +1Markov Decision ProcessesGoal-Conditioned Reinforcement Learning

  45. Shared Modular Recurrence in Contextual MDPs for Universal Morphology Control

    Jun 10, 2025Laurens Engwegen, Max Weltevrede, Caroline Horsch +2Scalable Robot LearningIterative Reinforcement Learning

  46. SafeOR-Gym: A Benchmark Suite for Safe Reinforcement Learning Algorithms on Practical Operations Research Problems

    Jun 2, 2025Asha Ramanujam, Adam Elyoumi, Hao Chen +5Safety ConstraintsDeep Reinforcement Learning

  47. Adaptive Resolving Methods for Markov Decision Processes with Function Approximations

    May 17, 2025Jiashuo Jiang, Yinyu Ye, Yiming ZongMarkov Decision ProcessesOptimal Policies

  48. Reinforcement Learning in Switching Non-Stationary Markov Decision Processes: Algorithms and Convergence Analysis

    Mar 24, 2025Mohsen Amiri, Sindri MagnússonMarkov Decision ProcessesConvergence Analysis

  49. Training on Irrelevant States Implies Data Augmentation: Generalization in Contextual MDPs

    Oct 4, 2024Max Weltevrede, Caroline Horsch, Matthijs T. J. Spaan +1Efficient ExplorationMarkov Decision Processes

  50. Thompson Sampling for Infinite-Horizon Discounted Decision Processes

    May 14, 2024Daniel Adelman, Cagla Keceli, Alba V. Olivares-NadalThompson SamplingMarkov Decision Processes

  51. Distributionally Robust Reinforcement Learning with Interactive Data Collection: Fundamental Hardness and Near-Optimal Algorithms

    Apr 4, 2024Miao Lu, Han Zhong, Tong Zhang +1Markov Decision ProcessesDistributional Learning

  52. Reinforcement Federated Learning Method Based on Adaptive OPTICS Clustering

    Jun 22, 2023Tianyu Zhao, Junping Du, Yingxia Shao +1Federated LearningDistributional Learning

  53. Safe Learning Under Irreversible Dynamics via Asking for Help

    Date pendingBenjamin Plaut, Juan Liévano-Karim, Hanlin Zhu +1Markov Decision ProcessesNear-Optimal Regret Guarantees

  54. Optimization-Based Robust Permissive Synthesis for Interval MDPs

    Date pendingKhang Vo Huynh, David Parker, Lu FengMarkov Decision ProcessesConstraint-Aware Synthesis