math.OCMar 17, 2026

Featurized Occupation Measures for Structured Global Search in Numerical Optimal Control

Authors: Qi Wei, Jianfeng Tao, Haoyang Tan, Hongyu Nie

Organizations: School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China

Abstract

Numerical optimal control is split between globally structured but dimensionally intractable Hamilton--Jacobi--Bellman (HJB) methods and scalable but local trajectory optimization. We introduce Featurized Occupation Measures (FOM), a finite-dimensional primal--dual interface where HJB subsolutions guide primal search and primal occupation data can inform certificate refinement. Explicit and implicit realizations, based on finite Liouville tests and rollout-sampled residuals, are proved asymptotically consistent with the exact occupation-measure LP. FOM also identifies when HJB-type certificates avoid full state-space representation. For factor graphs induced by compatible passivity-based interconnections, blockwise HJB inequalities yield block-additive OM-dual certificates, including blockwise approximate variants. The curse of dimensionality is then shifted from state dimension to interconnection topology. Approximate certificates remain reusable under time shifts and bounded model perturbations, with explicit degradation bounds. A static obstacle-avoidance benchmark illustrates how tighter certificates improve sample-based global search.

Figures & tables

Explore similar work

Jul 26, 2026

When Rates Are Geometric: Rate-Certificate Transfer for Contact Splittings in Optimization

Discrete optimization algorithms are often analyzed through continuous-time limiting ODEs, but a convergence certificate for the ODE is not automatically one for the discrete algorithm. We develop contact Hamiltonian systems as a setting where the transfer can be made precise. A contact Hamiltonian HH on J1(Rn)J^1(\mathbb{R}^n) obeys the intrinsic decay identity H˙=−H ∂sH\dot H = -H\,\partial_s H, so an augmented energy E\mathcal{E} built from HH, together with the conformal rate ∂sH\partial_s H, is a continuous-time rate certificate whenever E\mathcal{E} controls the objective gap. Our main theorem states, under three named and independently checkable hypotheses, that an order-rr contact splitting with step hh transfers this certificate over the finite horizon set by backward error analysis. The discrete decay envelope is governed by the modified conformal factor up to O(hr)O(h^r) perturbations plus a backward-error shadowing defect, and the mechanism is inherited exactly because the modified Hamiltonian is itself a contact Hamiltonian. Quadratic heavy ball is a fully solvable example: its projected dissipative-leapfrog spectrum agrees with established conformal-symplectic optimization theory, while the augmented contact Hamiltonian yields a sharp objective-to-certificate comparison that verifies the transfer hypotheses. For strongly convex objectives with state-dependent damping, an explicit Bregman-type Lyapunov certificate instead transfers by an auxiliary-shadowing corollary. The decomposition H=K+V+DH=K+V+D into kinetic, objective-encoding potential, and dissipation terms serves as a design template, with a catalogue of closed-form sub-flows including contact-specific damping families. Numerical experiments confirm the predicted conformal-factor tracking orders and show competitive performance on ill-conditioned benchmarks and deep-learning tasks.
Jun 16, 2026

Horizon-Uniform Sensitivity Certificates for Finite-Horizon Pontryagin Systems

Finite-horizon optimal-control computations repeatedly solve two-point Pontryagin boundary value problems whose conditioning can deteriorate as the horizon grows. We give a verifiable data-level certificate under which it does not. Hyperbolicity of the reduced state--costate transition matrix, together with scaled stable--unstable boundary transversality, yields an endpoint-corrected Green inverse with horizon-independent constants and weighted contractions transfer this inverse to the nonlinear problem, so the original Pontryagin endpoint rows x0=xinx_0=x_{\rm in} and pT=rx(xT,y)p_T=r_x(x_T,y) carry a unique local stationary branch whose first-order expansion and Lipschitz constants are uniform in the horizon. Consequently the finite-horizon feedback map is horizon-uniformly Lipschitz, first-order expandable, and satisfies an exact shrinking-horizon consistency identity. Symplectic and Riccati criteria certify the hypotheses from matrix data: every stabilizable definite linear-quadratic system with invertible dynamics and a locally concave terminal Hessian at the reference qualifies. Reproducible computations illustrate both certificates.
Jun 22, 2026

Hessian-augmented Supervised Learning for Hamilton-Jacobi-Bellman PDEs

A data-driven method is developed for approximating value functions in deterministic optimal control problems with nonlinear control-affine dynamics. The Pontryagin Maximum Principle optimality system is solved from multiple initial conditions to generate training data consisting of values, gradients, and Hessians of the value function, where Hessian information is obtained from a matrix Riccati equation along optimal trajectories. These quantities augment a weighted least-squares regression over sparse polynomial bases on hyperbolic cross index sets, with gradients and Hessians contributing additional linear equations per sample and substantially reducing sample complexity compared to value-only regression. Feedback laws are recovered analytically from the learned value function. In high dimensions, a partial Hessian strategy controls the cost of data generation. The approach is validated on problems of increasing state dimension, where second-order data augmentation is shown to improve approximation accuracy and closed-loop performance, with up to an order-of-magnitude reduction in the number of training samples required relative to lower-order methods.