Markov Decision Processes

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

16 new papers

A weekly snapshot of new work published in Markov Decision Processes.

Period ending 2026-09-14

11 new papers

A weekly snapshot of new work published in Markov Decision Processes.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Markov Decision Processes.

Inside this field

Focused directions

419 papers

Latest in Markov Decision Processes

Browse all topics →
CardsList

  1. Revisiting TD Target Aggregation under Uncertainty in Q-Learning

    Aug 4, 2026Lipeng Zu, Xiaonan ZhangQ-LearningDeep Q-Networks

  2. SP3O: Reinforcement Learning from Segment Preferences without Reward Modeling

    Aug 3, 2026Evan Assmus, Qining Zhang, Lei YingProximal Policy OptimizationReward Modeling

  3. Robust Counterfactual Policy Optimisation via Nondeterministic Causal Models

    Aug 3, 2026Jessica Lally, Milad Kazemi, Nicola Paoletti +2Counterfactual RolloutsCounterfactual Reasoning

  4. Improved Quantum Algorithms for Reinforcement Learning Under a Generative Model

    Aug 3, 2026Joao F. DoriguelloQ-LearningQuantum Advantage

  5. Analytic Planning under Uncertainty with Moment Closure

    Aug 3, 2026Shishir Sharma, Doina PrecupPredictive UncertaintyValue Functions

  6. Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies

    Aug 3, 2026Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan +1Markov Decision ProcessesMinimax

  7. Intention Inference Under Execution Noise: Separating Aleatoric and Epistemic Uncertainty in Social Dilemmas

    Aug 3, 2026Kival Mahadew, Jonathan ShockPartially Observable Markov Decision ProcessInitial Human Belief Distributions

  8. PAC Approximation and DIRECT Optimization for Parametric Markov Models

    Aug 3, 2026Zhiming Chi, Ying Liu, Andrea Turrini +2Markov Decision ProcessesLlm-Based Optimization Modeling

  9. Upper-Expectile Multi-Step Q-Learning for Off-Policy Reinforcement Learning

    Aug 3, 2026Abdelghani Ghanem, Mounir GhoghoQ-LearningOff-Policy Evaluation

  10. 402Pilot: An x402 Decision Layer for Autonomous Agent Micropayments

    Aug 2, 2026Yin Li, Yanbo He, Boo-Ho Yang +5Payment NetworksAgent Decisions

  11. Climate-Dyna Deep Hedging for XVAs: Model-Based Reinforcement Learning, Residual Climate HVA, and Hedge-Instrument Discovery

    Aug 2, 2026Xiaozhen Wang, Francois Buet-GolfouseClimateValue Functions

  12. Learning Not to Optimize: Physics-Informed Action-Space Reshaping for Intent-Based Network Control

    Aug 2, 2026Zuyuan Zhang, Vaneet Aggarwal, Tian LanOptimal PoliciesOptical Networks

  13. Hierarchical Multilevel Monte Carlo for Order-Optimal Neural Actor-Critic in Average-Reward CMDPs

    Jul 30, 2026Ankur Naskar, Vaneet AggarwalSoft Actor-CriticMarkov Decision Processes

  14. Search as Computation Allocation

    Jul 30, 2026Alexander TuisovComputational CostBellman Equation

  15. Corrigible Assistance in One Round: Pragmatic-Pedagogic Best Response

    Jul 29, 2026Elle Lazarski, Jaime Fernández FisacHuman-Robot CollaborationPartially Observable Markov Decision Process

  16. Minimal Markovization via Stable Quotients in Holonomy-Cover Decision Processes

    Jul 29, 2026Zuyuan Zhang, Yongshan Chen, Mahdi Imani +1Partially Observable Markov Decision ProcessMarkov

  17. Property-driven Causal Abstractions for Markov Decision Processes

    Jul 29, 2026Jule Schmidt, Maximilian Weininger, Clemens Dubslaff +2Markov Decision ProcessesStructural Causal Model

  18. Semi-Decentralized Multi-Spacecraft Collision Avoidance under Communication Constraints

    Jul 29, 2026Grace Ra Kim, Mahdi Al-Husseini, Duncan Eddy +1Collision AvoidanceGlobal Coordination

  19. dtControl2+ε\varepsilon: Trading Optimality for Explainability in MDPs via Decision Trees

    Jul 28, 2026Tereza Kinská, Jan Křetínský, Tobias Meggendorfer +2Decision TreesMarkov Decision Processes

  20. A Unified Algorithmic Framework for Hybrid Reinforcement Learning in Tabular MDPs with Shifted Transition Dynamics

    Jul 28, 2026Zheshun Wu, Renjie Zheng, Jinhang Zuo +2Offline Reinforcement LearningMarkov Decision Processes

  21. Smooth Learning with Hard Constraints via Legendre-Regularized Policies

    Jul 27, 2026Zikun Lin, Rui Chen, Yijie WangOptimal PoliciesRegularization Techniques

  22. Outcome-Fair Restless Multi-Armed Bandits for Stochastic Deadline Scheduling

    Jul 26, 2026Shakti Sharma, Rahul MeshramOptimal SchedulingLinear Bandits

  23. Online Policy Evaluation for MDPs with Dynamic UBSR Measures

    Jul 25, 2026Weikai Wang, Erick DelageMarkov Decision ProcessesOnline

  24. Finite-Time Analysis of the Natural Policy Gradient in Finite-Horizon Markov Decision Processes

    Jul 25, 2026Asha Barua, Sajad KhodadadianPolicy GradientFinite Time Analysis

  25. General Value Functions for Remaining Useful Life and Failure-Mode Prediction

    Jul 24, 2026Hao Yan, Ali Sarabi, Qing Zou +1Useful Life PredictionEarly Failure Prediction

  26. Trajectory-Regularized Stochastic Optimal Control via KL Divergence

    Jul 24, 2026Mintae Kim, Koushil SreenathStochastic Optimal ControlKullback-Leibler Regularization

  27. Learning Spatiotemporal Decision Priors for Efficient Path Planning under Partial Observability

    Jul 24, 2026Yi Liu, Hongda Zhang, Leyao Zou +7Coverage Path PlanningPartially Observable Markov Decision Process

  28. Variance-Reduced Q-Learning over Static and Time-Varying Networks

    Jul 24, 2026Sreejeet Maity, Feng Zhu, Aritra Mitra +1Multi-Agent Reinforcement LearningValue Functions

  29. The Dark Room in the Reward Channel: Dense Prediction Rewards Collapse GRPO-Trained LLM Agents -- and The Channel, Not the Content, Decides What Works

    Jul 23, 2026Yu WangShared RewardsLarge Language Model Agents

  30. Relative Value Learning

    Jul 23, 2026Marc Höftmann, Jan Robine, Stefan HarmelingValue FunctionsBellman Equation

  31. Robust Asynchronous Q-Learning under Reward and State Corruption via Batching

    Jul 23, 2026Sreejeet Maity, Aritra MitraQ-LearningAdversarial Corruption

  32. Active Inference as a Convex Markov Decision Process

    Jul 22, 2026Nikola Milosevic, Nicolás Hinrichs, Nico ScherfEntropy Regularized Reinforcement LearningMarkov Decision Processes

  33. Long-Term Sequential Decision Making under Risk

    Jul 22, 2026Irmaan, Mirzanejad, Nadjet Bourdache +1Sequential Decision MakingConditional-Value-At-Risk

  34. Asymptotically Optimal Regret for Reinforcement Learning without Horizon Dependence

    Jul 22, 2026Runlong Zhou, Zihan Zhang, Maryam Fazel +1Exponential Horizon DependenceRegret

  35. Scalable Policy Optimization for Networked Multi-Agent Reinforcement Learning with Continuous State-Action Spaces

    Jul 20, 2026Dongming Wang, Pengcheng Dai, Wenwu Yu +1Multi-Agent Reinforcement LearningMarkov Decision Processes

  36. Beyond Fixed Goal Delivery: Online POMDP Planning for Target Interception in Crowds

    Jul 20, 2026Himanshu Gupta, Kelvin Aladum, Nisar Ahmed +2Coverage Path PlanningPlanning Methods

  37. Generalised Bellman recurrence and three dualities in sequential decision-making

    Jul 20, 2026Fernando E. Rosas, David Hyland, Daniel PolaniBellman EquationValue Functions

  38. Distributional Soft Bellman Operator under the Cramér Geometry

    Jul 20, 2026Keru Wang, Yixin Deng, Yao Lyu +2Bellman EquationEntropy-Regularized Equilibrium Selection

  39. Theoretical Foundations of max⁡\max@kk Reinforcement Learning

    Jul 20, 2026Riccardo Poiani, Martino Bernasconi, Andrea CelliOptimal PoliciesTop-K

  40. Rationalizing Boltzmann Rationality: An Axiomatic Characterization of Entropy-Regularized Policies

    Jul 19, 2026Silviu PitisEntropy Regularized Reinforcement LearningBellman Equation

  41. Learning-Driven Adaptive Audit Scheduling: A Sequential Decision Approach to Off-Chain Data Integrity

    Jul 19, 2026Changting Lin, Fan Li, Weihang Yu +4Algorithm AuditingMarkov Decision Processes

  42. Non-Asymptotic Best Policy Identification Guarantees in Online Reinforcement Learning

    Jul 19, 2026Joseph Lazzaro, Alessio Russo, Aldo PacchianoOptimal PoliciesMarkov Decision Processes

  43. Searching for Task-Specific Vision Paths: Evolutionary Block Pruning Across Vision-Language Models

    Jul 19, 2026Tarun TomarLarge Vision Language ModelsPoint-Vlms

  44. Reward-Driven LLM Agent Workflows: Synthesizing POMDP Routing and Self-Correction for Autonomous Decision-Making

    Jul 19, 2026Amez Amanj Ali, Kuo-Kun TsengMulti-Agent Large Language Model SystemsPartially Observable Markov Decision Process

  45. Expected Free Energy as Belief-Dependent Utility for rho-POMDPs

    Jul 18, 2026Patrick Cooper, Alvaro VelasquezPartially Observable Markov Decision ProcessFree Energy Principle

  46. From Optimal Policies to Individual Differences: Rethinking Reinforcement Learning for Biology

    Jul 17, 2026Patrick Govoni, Palina Bartashevich, Clémence Bergerot +3BiologicalOptimal Policies

  47. Interactive Task Alignment as a POMDP

    Jul 17, 2026Andy Dai, Zexue He, Zhenyu Zhang +2Partially Observable Markov Decision Process

  48. Mask-Aware Policy Gradients for Diffusion Language Models

    Jul 16, 2026Haran Raajesh, Kulin Shah, Adam Klivans +1Masked Diffusion Language ModelsPolicy Gradient

  49. CASP: Learning-Augmented Offline Approximation with Verifiable Certificates and Bounded-Loss PAC Guarantees

    Jul 16, 2026Haifeng Li, Mo HaiCertificatesLearning-Augmented Algorithms

  50. Learning Who to Treat When Treatment is Missing

    Jul 15, 2026Johnna Sundberg, Rayid Ghani, Eli Ben-Michael +1Heterogeneous Treatment EffectsMissing Data

  51. Equilibrium stability as a driver of cooperation among Q-learners

    Jul 15, 2026Janusz M. Meylahn, Maximilian SchäferAlgorithmic CollusionCooperation

  52. Knowledge- and Gradient-Guided Reinforcement Learning for Parametrized Action Markov Decision Processes

    Jul 14, 2026Jonas Ehrhardt, René Heesch, Oliver NiggemannMarkov Decision ProcessesTemporal Difference

  53. Environment Parameter Gradient Theorem for Policy-Environment Co-Design in Reinforcement Learning

    Jul 14, 2026Amber SrivastavaValue FunctionsGradient Flow

  54. LQG solution for POMDP without estimating states: A minimum variance approach

    Jul 13, 2026Ranjan Sarkar, Prabhat K. MishraLinear Quadratic RegulatorDiscrete-Time Linear Systems

  55. Active Noise Floor Estimation for Reliability-Optimal POMDPs: A Value-of-Noise-Information Approach

    Jul 13, 2026Hyung-Jin YoonNoisy DataPartially Observable Markov Decision Process

  56. Learning to Fine-tune Foundation Models under Resource Limitations

    Jul 12, 2026Thomas Tsouparopoulos, Iordanis KoutsopoulosContinual Fine-TuningWireless Foundation Models

  57. Interleaved POMDP Planning for Multi-Object Search in Unknown Multi-Room Household Environments

    Jul 11, 2026Ruochu Yang, Ziyi Xia, Huibo Zhang +6Partially Observable Markov Decision ProcessIndoor Environments

  58. Comparing Socially-Equitable Renewable Energy Budget Allocation MDP Policies in Mature and Emerging Economies

    Jul 11, 2026Riya Kinnarkar, Mansur M. Arief, Yan Pratama Akhra +1Markov Decision ProcessesEconomies

  59. Robo-ValueRL: Reliable Value Estimation for Offline-to-Online Reinforcement Learning

    Jul 10, 2026Wenke Xia, Pei Ren, Wenbo Yu +10Offline Reinforcement LearningValue Functions

  60. Risk-Aware General-Utility Markov Decision Processes

    Jul 10, 2026Pedro P. Santos, Fábio Vital, Alberto Sardinha +1Markov Decision ProcessesConditional-Value-At-Risk