Lossless First-Action Menus for Linear-Reward Planning
Organizations: School of Management, Beijing Institute of Technology
Abstract
We study sequential decision making where an agent reserves a minimum menu of initial actions before multi-objective trade-offs are revealed, followed by unrestricted continuation planning once linear reward weights arrive. We prove that a menu preserves the unrestricted optimal return across all linear scalarizations if and only if its reachable continuations cover all vertices of the full feature polytope. This geometric equivalence yields an output-sensitive algorithm that is fixed-parameter tractable in the vertex count, combining scalar backward induction with oracle-based facet identification. On explicitly layered graphs with unit feature increments, menu verification is coNP-complete and synthesis is complete for the second existential level of the polynomial hierarchy, even under additive loss strictly below one. In fixed dimensions two and higher, verification is polynomial whereas synthesis remains NP-complete, while one-dimensional instances admit polynomial-time solutions.
Figures & tables
| First action | Achievable totals | Corners of bounding box |
|---|---|---|
| Input regime | Verification | Synthesis |
|---|---|---|
| General (unit incr.) | coNP-c (Thm Computational Intractability on Layered Graphs ) | -c (Thm Computational Intractability on Layered Graphs ) |
| (rational labels) | Poly (Thm Dimensional Dichotomy on Unit-Increment Graphs ) | Poly (Thm Dimensional Dichotomy on Unit-Increment Graphs ) |
| Fixed (unit incr.) | Poly (Thm Dimensional Dichotomy on Unit-Increment Graphs ) | NP-c (Thm Dimensional Dichotomy on Unit-Increment Graphs ) |
| Parameterized | FPT (Thm Output-Sensitive Exact Synthesis via Polytope Projections ) | FPT (Thm Output-Sensitive Exact Synthesis via Polytope Projections ) |
Sequential Decision Making
Sequential Decision Making studies how to choose actions over time when outcomes, information, resources, or goals can change.
See all 150 papers