Sequential Decision Making

Follow this topic Ask about this topic

Recent momentum

-69%

5 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

1 new paper

A weekly snapshot of new work published in Sequential Decision Making.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Sequential Decision Making.

74 papers

Latest in Sequential Decision Making

Open your feed →

Adapting to Decision-Relevant Non-Stationarity in Decentralized Heterogeneous Bandits
Sep 15, 2026Zhaojun PengSequential Decision Making Decentralization
Anchored Sequential Deliberation
Sep 15, 2026Sijing Tu, Ashish GoelDeliberation Sequential Decision Making
Direct Diversity Optimization for Diverse Successful Trajectories in Preference Post-Training
Sep 9, 2026Junwon Ko, Dong-Jae Lee, Minchan Kwon +2Post-Training Sequential Decision Making
DNative-Twin: Decision Graphs and Digital Twins for Reconstructable Agentic Decisions
Sep 3, 2026Junjie Pang, Zhenzhen Xie, Haoke Han +3Digital Twins Agent Decisions
Proactive Service Agents: A Unified Decision Framework, Methods, and Evaluation
Sep 3, 2026Yan Tang, Tingyu Cao, Yuanbo Tang +2Proactive Agent Decisions
Reinforcement learning to choose optimizers
Sep 1, 2026Martin van der Schelling, Deepesh Toshniwal, Miguel A. BessaPortfolio Optimization Policy Optimization
Disciplined Bilevel Programming
Sep 1, 2026Hao Zhu, Joschka BoedeckerBilevel Optimization Mixed-Integer Linear Programming
Sequence prediction under a lying oracle
Aug 14, 2026Puspabeethi Samanta, Nikhil Karamchandani, Jayakrishnan NairSequence Modeling Sequential Decision Making
Chance-constrained selection of sequential intervention strategies from counterfactual estimates
Aug 13, 2026Minkyoung Kim, Beakcheol JangCounterfactual Utility Confidence Intervals
Learning Discrete Decisions for MIPs with Constraint-Aware Diffusion
Aug 13, 2026Vincenzo Di Vito, Mehdi Taghizadeh, Deepjyoti Deka +2Mixed-Integer Linear Programming Sequential Decision Making
Let it Cook: Learning to Wait in Sequential Decision Making
Aug 11, 2026Christopher Watson, Arjun Krishna, Dinesh Jayaraman +1Sequential Decision Making Decisions
Adaptive Sequential Test Planning for Multi-Mechanism Reliability Qualification via Bayesian Monte Carlo Tree Search
Aug 10, 2026Youssef A. Elhagrasy, Ian Hill, André IvanovMonte Carlo Tree Search Reliability
Regret, equilibrium, and learning in games: A guided tour
Aug 10, 2026Panayotis MertikopoulosImperfect-Information Games Equilibrium
Bayesian Expected Uncertainty Reduction (B-EUR) Model: A Computational Account of What Makes Design Options Worth Trying
Aug 6, 2026Shimon Honda, Takuma Miyaguchi, Koji Koizumi +3Bayesian Experimental Design Bayesian Inference Approaches
Stochasticity Is Not the Hard Part: Reduction and Complexity in Instructional Sequencing over Prerequisite DAGs
Aug 5, 2026Zonglin Han, Yichen Chen, Jiawen Jiang +2Directed Acyclic Graph Shortest Paths
Hybrid LLM-Augmented Reinforcement Learning Agents for Complex Sequential Decision Tasks
Aug 4, 2026Christophe D. Hounwanou, John Emeka Eze, Yaé Ulrich GabaAgentic Reinforcement Learning Safe Reinforcement Learning
Towards Improving Sequential Decision-Making in LLM Agents via Experience Memory
Aug 4, 2026Jakub Rada, Viliam LisýLarge Language Model Agents Sequential Decision Making
Optimizing Minimax Regret in Uncertain MDPs with Small Sets of Policies
Aug 3, 2026Sterre Lutz, Daniël Vos, Matthijs T. J. Spaan +1Markov Decision Processes Optimal Policies
Reasoning in Real World Clinical Care: Why Large Language Models Are Not Yet Safe for Autonomous Clinical Decision Support
Jul 29, 2026Shayndhan Sivanathan, Shravan Nageswaran, Mehdi Zadem +10Triage Sequential Decision Making
Algorithmic Approaches to Sequential Decision-Making and Social Epistemology
Jul 22, 2026Kavya RavichandranSequential Decision Making Algorithmic Reasoning
Long-Term Sequential Decision Making under Risk
Jul 22, 2026Irmaan, Mirzanejad, Nadjet Bourdache +1Finite-Horizon Episodic Markov Decision Processes Sequential Decision Making
Breaking Feedback-Blindness: Utility-Augmented Transformer for Sequential Decision Making
Jul 21, 2026Yuyang Shen, Shan Dai, Daimin ChenSentence Transformer Models Sequential Decision Making
Generalised Bellman recurrence and three dualities in sequential decision-making
Jul 20, 2026Fernando E. Rosas, David Hyland, Daniel PolaniBellman Equation Value Functions
Learning-Driven Adaptive Audit Scheduling: A Sequential Decision Approach to Off-Chain Data Integrity
Jul 19, 2026Changting Lin, Fan Li, Weihang Yu +4Algorithm Auditing Blockchain
Can Induced Emotion Bias LLM Behaviors in Sequential Decision Making?
Jul 14, 2026Minh Khoi Ho, Zihao Zhu, Runchuan Zhu +4Large Language Models Fail Emotion
Bet on Features: Anytime-Valid and Feature-Aware Auditing of Conditional Quantile Forecasters
Jul 13, 2026Ivane Antonov, Sohom Mukherjee, Richard Pibernik +1Quantile Regression Betting
Similar Accuracy, Unequal Evidence: Search APIs as Decision Surfaces for Tool-Using Agents
Jul 11, 2026Sriram Selvam, Anneswa GhoshApplication Programming Interfaces Incomplete Evidence
STEMGym: Benchmarking Sequential Decision-Making under Dose Budgets in Autonomous Electron Microscopy
Jun 28, 2026Can Polat, Erchin Serpedin, Mustafa Kurban +1Transmission Electron Microscopy Cryo-Electron Microscopy
Position: RL Researchers Need to Distinguish Between Solving Simulators and Using Simulators as a Proxy
Jun 26, 2026Matthew Vandergrift, Esraa Elelimy, Martha WhiteSimulation-Based Reinforcement Learning Safe Reinforcement Learning
The Decision Geometry of Covariance Estimation for the Global Minimum-Variance Portfolio under Heavy Tails
Jun 25, 2026Xavier FonsecaCovariance Estimation Portfolio Optimization
Beyond Next-Observation Prediction: Agent-Authored World Modeling for Sequential Decision Making
Jun 24, 2026Guangfeng Cai, Kaibing Yang, Shuo He +4Sequential Decision Making
Learning Optimization Proxies for Sequential Contextual Stochastic Programs: An Order Fulfillment Application
Jun 24, 2026Tinghan Ye, Shuaicheng Tong, Changkun Guan +2Dynamic Order Fulfillment Operations Stochastic Optimization
Adapt Only When It Pays: Budgeted Decision-Loss Priority for Delayed Online Time-Series Adaptation
Jun 23, 2026Xibai WangSequential Decision Making Time Series Forecasting
Selective Ensemble Based on Preference-Directed Multi-Objective Bandits
Jun 20, 2026Lanjihong Ma, Zhen-Yu Zhang, Masashi Sugiyama +1Pareto Frontier Dynamic Regret Bounds
Decision-Focused Learning: When and Why Traditional Prediction Models Fail
Jun 19, 2026Mo LiuPredictive Uncertainty Sequential Decision Making
Bellman-sufficient Information Complexity
Jun 9, 2026Yunbei XuInformation-Theoretic Limits Optimal Sample Complexity
Performance Evaluation of Social Learning
Jun 8, 2026Felice Scala, Marco Carpentiero, Vincenzo Matta +1Equal Error Rate Optimal Learner
Testing Neural Networks via Bayesian-Guided Exploration of Decision Landscapes
Jun 3, 2026Bin Duan, Meiru Che, Guowei YangBayesian Neural Networks Artificial Neural Networks
Smart Transportation Without Neurons -- Fair Metro Network Expansion with Tabular Reinforcement Learning
Jun 2, 2026Dimitris Michailidis, Sennay Ghebreab, Fernando P. SantosTransit Network Design Traffic Signal Control
Reinforcement Learning with Pairwise Preferences in Long-Term Decision Problems
May 29, 2026Jonathan Colaço Carr, Prakash Panangaden, Doina Precup +1Markov Decision Processes Optimal Policies
TraceGraph: Shared Decision Landscapes for Diagnosing and Improving Agent Trajectories
May 29, 2026Junjie Nian, Kang Chen, Ge Zhang +2Traces Agent Decisions
Optimality of Sequential Filtering Under Independent Cost and Selectivity Models
May 28, 2026Hrishikesh Paranjape, Abhishek Mandal, Xian SunSequential Decision Making Optimality
MechRL: Reinforcement Learning Agents Perform Circuit Discovery for Mechanistic Interpretability
May 25, 2026Barsat KhadkaMechanistic Interpretability Circuits
Goal-driven Bayesian Optimal Experimental Design for Robust Decision-Making Under Model Uncertainty
May 25, 2026Jinwoo Go, Xiaoning Qian, Byung-Jun YoonBayesian Experimental Design Bayesian Inference Approaches
SeqRoute: Global Budget-Aware Sequential LLM Routing via Offline Reinforcement Learning
May 25, 2026Zhongling Xu, Shunan Zheng, Wei WangLarge Language Model Routing Adaptive Scheduling
Neural Bayesian Sequential Routing
May 22, 2026Yongchao HuangBayesian Neural Networks Belief-Space Planning
The Secretary Problem with a Stochastic Precursor
May 21, 2026Franziska Eberle, Alexander LindermayrOptimal Stopping Learning-Augmented Algorithms
Mind the Sim-to-Real Gap & Think Like a Scientist
May 20, 2026Harsh Parikh, Gabriel Levin-Konigsberg, Dominique Perrault-Joncas +1Sim-To-Real Gap Simulation-Based Reinforcement Learning
D $^3$ -Subsidy: Online and Sequential Driver Subsidy Decision-Making for Large-Scale Ride-Hailing MarketD^3-Subsidy: Online and Sequential Driver Subsidy Decision-Making for Large-Scale Ride-Hailing Market
May 19, 2026Taijie Chen, Rui Su, Siyuan Feng +6Bike-Sharing Systems Gradient-Based Trajectory Optimization
Decision-Aware Proximal Bridge Learning for Optimal Treatment Selection
May 16, 2026Tomàs Garriga, Alejandro Almodóvar, Axel Brando +3Causal Inferences Treatment
Toward Template-Free Explainability for Monte Carlo Tree Search
May 15, 2026Siqi Lu, Mirsaleh Bahavarnia, Hiba Baroud +3Monte Carlo Tree Search Concept-Based Explainability
Adaptive mine planning under geological uncertainty: A POMDP framework for sequential decision-making
May 13, 2026Hamza Khalifi, Jef Caers, Yassine Taha +2Partially Observable Markov Decision Process Underground Tunnels
Polyhedral Instability Governs Regret in Online Learning
May 13, 2026Yuetai Li, Fengqing Jiang, Yichen Feng +6Submodular Maximization Regret
Contextual Bandits for Resource-Constrained Devices using Probabilistic Learning
May 13, 2026Marco Angioli, Kevin Johansson, Antonello Rosato +2Resource-Constrained Devices Sequential Decision Making
Information-Theoretic Generalization Bounds for Sequential Decision Making
May 12, 2026Futoshi Futami, Masahiro FujisawaGeneralization Bounds Mutual Information
The Value of Mechanistic Priors in Sequential Decision Making
May 11, 2026Itai Shufaro, Gal Benor, Shie MannorSequential Decision Making Dynamic Regret Bounds
Large Language Models for Sequential Decision-Making: Improving In-Context Learning via Supervised Fine-Tuning
May 9, 2026Minmin Zhang, Sina Aghaei, Soroush SaghafianIn-Context Learning Large Language Model Fine-Tuning
Understanding Performance Collapse in Layer-Pruned Large Language Models via Decision Representation Transitions
May 8, 2026Boyu Shi, Chang Liu, ChuanBao Gao +2Representation Quality Sequential Decision Making
Agentick: A Unified Benchmark for General Sequential Decision-Making Agents
May 7, 2026Roger Creus Castanyer, Pablo Samuel Castro, Glen BersethAgentic Benchmarks Agent Decisions
PRISM: Perception Reasoning Interleaved for Sequential Decision Making
May 6, 2026Mohamed Salim Aissi, Clemence Grislain, Clement Romac +4Perception Prism

Sep 15, 2026 · cs.LGJ/K move · Enter open · S save

Adapting to Decision-Relevant Non-Stationarity in Decentralized Heterogeneous Bandits

Zhaojun Peng

Decentralized bandit systems often contain heterogeneous agents: rewards can change at individual agents even when the best action for the network stays the same. These local changes may cancel when rewards are averaged across agents, so the number of local changes

\Stloc

can be much larger than the number of changes in the best common arm

\Stdec

. We introduce Decision-Relevant Fresh Comparison (DRFC), which uses new, balanced samples from all agents to compare arms at the network level and switches only when fresh global evidence indicates that the common best arm has changed. We prove a high-probability dynamic regret bound with no adaptation term depending on

\Stloc

, and show that every algorithm must still pay for identifying genuine decision switches and propagating them through the communication graph. Under a distinct time-average benchmark, an anytime-valid sliding-window extension handles gradual drift; experiments on synthetic, semi-real, and MovieLens-1M replays show that DRFC ignores decision-irrelevant local changes while the extension avoids false switches.

Sequential Decision Making Decentralization

Open paper Ask about it PDF