math.OCSep 27, 2026

Sharp Critical Minimax Laws and No-Learning Thresholds in Continuous-Time Adaptive Control

Authors: Chen Jia

Abstract

We study episodic continuous-time control with an unknown vector control gain, scalar state, quadratic action cost, and smooth convex terminal cost. In the scalar Gaussian experiment, let Δ(H)Δ(H) denote the minimax improvement over zero control and set δ=2H2−1δ=\sqrt2H^2-1. We prove the critical law Δ(H)≍δ4log⁡(1/δ)(δ↓0),Δ(H)\asymp δ^4\sqrt{\log(1/δ)} \qquad (δ\downarrow0), with a matching lower and upper bound. The lower bound follows from a uniform deficit--energy inequality valid for fully adaptive controls with unbounded amplitudes, while a moving soft-threshold feedback attains the rate. For local parameters θ=N−1/4hθ=N^{-1/4}h, ∣h∣≤H|h|\le H, we show that the normalized minimax regret over NN episodes is within O(N−1/2)O(N^{-1/2}) of a fixed-horizon Gaussian sequential control problem, without an additional dimension factor. The terminal task enters the limit only through cg=Var⁡(g(Z))c_g=\operatorname{Var}(g(Z)). The Gaussian problem exhibits an exact no-learning phase transition: CdT(H)=TH2/2  ⟺  H4T≤d2/2,C_d^T(H)=TH^2/2 \iff H^4T\le d^2/2, yielding the asymptotic task boundary cgH4=d2/2c_gH^4=d^2/2.

Explore similar work

CardsList
  1. Rate-Optimal Regret for the Safe Learning-based Control of the Constrained Linear Quadratic Regulator

    Apr 24, 2026Spencer Hutchinson, Nanfei Jiang, Mahnoosh AlizadehStochastic Linear Dynamical SystemsStochastic Optimal Control