Sequential Decision Making

Overview

The field studies decisions made in sequence, where each action can change future states, available information, and later choices. Common settings include resource allocation, healthcare, robotics, online markets, and language-model agents, often with uncertainty, limited budgets, or changing environments. Approaches range from Markov decision processes, reinforcement learning, and bandits to online optimization, planning, causal methods, and optimal stopping. A central challenge is balancing reliable guarantees for safety, fairness, and performance with the flexibility and computational efficiency needed for long horizons, partial observability, and real-world change.

Latest papers

CardsList

150 papers13 papers in the last four weeks, down 19% on the four weeks before. 0.1% of all new papers.

  1. Grid Cells as Spectral Successor Features: A Reusable Basis for Continual Reinforcement Learning

    Nov 19, 2026Élodie Côté-Gauthier, Doina Precup, Isabeau Prémont-SchwarzReinforcement LearningContinual RL

  2. Hilbert States for Decision-Making under Partial Observability

    Nov 16, 2026Zibo Meng, Andrew C. M. Austin, Alin AchimDecision-Making under UncertaintySequential Decision Making

  3. Measuring Coherence in Predictive Models

    Nov 15, 2026Jamie Reason, Vik Shirvaikar, Mark van der Wilk +1Sequential Decision Making

  4. Lossless First-Action Menus for Linear-Reward Planning

    Nov 15, 2026Yukun YangSequential Decision MakingMarkov Decision Processes

  5. DECODE: Decomposable Environments for COntrolled Sequential-Decision Evaluation

    Nov 13, 2026Diego Silva Prado, Bruno Caldas de Souza, Tiago Amaral Penteado de Jesus +3Sequential Decision MakingPartially Observable Markov Decision Processes

  6. Multiple-Choice Secretary Problem with Predictions

    Nov 10, 2026Jing Yuan, Qi Cai, Xin Gao +1Sequential Decision MakingLearning-Augmented Algorithms

  7. SIGMO: Sigmoid Gated Interaction-Aware Motion Planning

    Nov 10, 2026Avinash Singh, Manish Saroya, Fatemeh Cheraghi Pouria +5Motion PlanningAutonomous Driving Planning

  8. Uncertainty-Guided Reward Labeling for Reinforcement Learning under Limited Feedback

    Nov 8, 2026Renhao Zhang, Shreyas Chaudhari, Bruno Castro da SilvaReinforcement LearningSequential Decision Making

  9. Dependence-Aware Risk Assessment and Optimal Design of AI-Agent Safeguard Systems

    Oct 30, 2026Yijia Li, Maochao Xu, Peng ZhaoAI Risk ManagementAI Agent Security

  10. SHPRR: An Algorithm for Pure Exploration under Constrained Regret

    Oct 29, 2026Georgina Nouli, Flore Sentenac, Maximilian SchifferBest-Arm IdentificationSequential Decision Making

  11. Online Interval Selection with Binary Predictions: Optimal Consistency and a Continuous Robustness Tradeoff

    Oct 27, 2026Zhong HanSequential Decision Making

  12. JevVLA: Jev-Inspired Energy-Based Adaptation for Vision-Language-Action Policies

    Oct 26, 2026Wei Wang, Wenqiao Zhang, Zheqi Lv +6VLA AdaptationRobotic Manipulation

  13. MA-UITD: Offline Multi-Agent Reward Inference for Characterizing Continuous Social Behavior

    Oct 21, 2026Zeyuan Zhang, Yiyun Yang, Yuan Cheng +2Reinforcement LearningOffline RL

  14. ActTime: Action-Conditioned World Modeling for Time Series

    Oct 19, 2026Xinxing Zhou, Xiaojie Yuan, Yanlong Wen +1Action-Conditioned World ModelsModel-Based Planning

  15. Waiting Buys Exactly Two Moments: Endogenous Identification in Prediction-Driven Allocation

    Oct 16, 2026Rama AlHamidi, Rasul Khanbayov, Erchin Serpedin +1Sequential Decision MakingPredict-Then-Optimize

  16. Robust Reinforcement Learning for Dynamic Treatment Regimes under Model and Measurement Uncertainty

    Oct 15, 2026Chengze Xie, Xuan Wang, Ying Ding +2Robust RLSequential Decision Making

  17. Historical-Feature Residual Adaptation for Sequential Screening

    Oct 13, 2026Yixiang Hong, Yuchen ZhangSequential Decision MakingLearning to Rank

  18. Conformal Sequential Decision Making With Cost and Sublinear Policy Regret Guarantees

    Oct 10, 2026Jayadev Naram, Giuseppe Durisi, Matteo Zecchin +1Sequential Decision MakingOnline Learning

  19. CB-Agent: Concept-Based In-Context Learning for Sequential Action Selection

    Oct 10, 2026Qingyue Zhang, Huaze Tang, Minyu Zhang +3LLM AgentsIn-Context Learning

  20. A 3D Characterization Framework for Intelligent Sequential Decision Making

    Oct 8, 2026Sadig Gojayev, Carolina FortunaSequential Decision MakingAI Agent Evaluation

  21. Strategic Investment Decision Making for Value Creation in Energy Transition: A Reinforcement Learning Approach

    Oct 7, 2026Yasaman Cheraghi, Reidar B. Bratvold, Aojie Hong +2Sequential Decision MakingDecision-Making under Uncertainty

  22. LeanPlan: Optimal Planning with LLM-Generated Heuristics and Admissibility Proofs

    Oct 6, 2026André G. Pereira, Augusto B. Corrêa, Felipe Meneguzzi +1Automated Heuristic DesignLLM Planning

  23. Strategic Multi-Agent Learning for Interpretable Action Valuation of All Players in Football

    Oct 5, 2026Kenjiro Ide, Taiga Someya, Kohei Kawaguchi +1Sequential Decision MakingInterpretability in RL

  24. On Semi-Markov Suboptimality in Hierarchical Reinforcement Learning

    Oct 4, 2026Bingyun Liu, Yuheng JingReinforcement LearningSequential Decision Making

  25. On prediction from expert advice with more than five experts

    Oct 4, 2026Jeff Calder, Nadejda DrenskaSequential Decision Making

  26. ReHoPER: Receding-Horizon Planning for Enhanced Reasoning

    Oct 1, 2026Saeed Ahmadnia, Cornelia CarageaCompositional ReasoningSequential Decision Making

  27. What Must a World Model Distinguish for Planning?

    Sep 26, 2026Rongzhe Wei, Hans Hao-Hsun Hsu, Peizhi Niu +2World Model-Based PlanningWorld Models for Robotics

  28. Robust Successor Features

    Sep 25, 2026Erik Nikulski, Yamen Habib, Vicenç Gomez +3Reinforcement LearningGeneralization in RL