This paper proposes HyperKKL, a novel learning approach for designing Kazantzis-Kravaris/Luenberger (KKL) observers for non-autonomous nonlinear systems. While KKL observers offer a rigorous theoretical framework by immersing nonlinear dynamics into a stable linear latent space, its practical realization relies on solving Partial Differential Equations (PDE) that are analytically intractable. Current existing learning-based approximations of the KKL observer are mostly designed for autonomous systems, failing to generalize to driven dynamics without expensive retraining or online gradient updates. HyperKKL addresses this by employing a hypernetwork architecture that encodes the exogenous input signal to instantaneously generate the parameters of the KKL observer, effectively learning a family of immersion maps parameterized by the external drive. We rigorously evaluate this approach against a curriculum learning strategy that attempts to generalize from autonomous regimes via training heuristics alone. The novel approach is illustrated on four numerical simulations in benchmark examples including the Duffing, Van der Pol, Lorenz, and Rössler systems.
Figures & tables
Figure 1: Dynamic HyperKKL Architecture (Phase 2). The base encoder T^θbase and decoder T^ϕbase∗ , pre-trained on autonomous dynamics in Phase 1, are frozen. A shared LSTM encoder processes the input window u[t−w,t] and produces a hidden state ht , which is passed to two separate MLP decoder heads that predict chunked weight perturbations Δθenc and Δϕdec . The perturbations are added to the frozen base weights, yielding input-conditioned maps T^(x;θbase+Δθ) and T^∗(z;ϕbase+Δϕ) .
Method
Duffing
Van der Pol
Zero
Const
Sin
Sqr
Zero
Const
Sin
Sqr
Autonomous
0.04 (5.6)
0.63 (66)
0.26 (26)
0.33 (31)
0.15 (7.0)
0.35 (23.1)
0.23 (9.8)
0.25 (10.5)
Curriculum
0.27 (33)
0.64 (63)
0.44 (41)
0.57 (46)
1.10 (51.4)
1.00 (54.3)
1.15 (51.5)
1.15 (51.7)
Static HyperKKL
0.04 (5.6)
0.39 ↓ (38)
0.10 ↓ (9.3)
0.17 ↓ (14)
0.12 ↓ (5.3)
0.26 ↓ (14.1)
0.24 (10.2)
0.25 (10.8)
Dynamic HyperKKL
0.08 (8.2)
0.56 ↓ (62)
0.24 ↓ (25)
0.27 ↓ (28)
0.12 ↓ (5.0)
0.38 (25.6)
0.21 ↓ (8.6)
0.22 ↓ (9.1)
Table 1: State Estimation Performance (Duffing and Van der Pol): RMSE (SMAPE %) . Lower is better.
Method
Rossler (Chaotic)
Lorenz (Chaotic)
Zero
Const
Sin
Sqr
Zero
Const
Sin
Sqr
Autonomous
1.14 (6.7)
1.75 (8.6)
1.47 (7.6)
1.48 (8.3)
5.56 (18)
5.50 (18)
5.58 (18)
5.55 (18)
Curriculum
5.58 (35)
5.55 (35)
5.94 (37)
5.61 (38)
11.5 (41)
11.4 (41)
11.6 (42)
11.6 (42)
Static HyperKKL
1.14 (6.7)
1.50 ↓ (9.5)
1.70 (10)
1.75 (12)
5.56 (18)
16.0 (51)
16.3 (52)
16.2 (51)
Dynamic HyperKKL
1.01 ↓ (5.1)
1.57 ↓ (7.7)
1.38 ↓ (6.0)
1.36 ↓ (6.9)
6.67 (22)
6.64 (22)
6.67 (22)
6.66 (22)
Table 2: State Estimation Performance (Rossler and Lorenz): RMSE (SMAPE %) . Lower is better.
Figure 2: Duffing (Square Input): The Dynamic HyperKKL adapts to discontinuous square waves without the transient spikes seen in static methods.
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 3: Duffing System: State estimation time-series.
Figure 4: Van der Pol System: State estimation time-series.
Figure 5: Rossler System (Chaotic): State estimation time-series.
Figure 6: Lorenz System (Chaotic): State estimation time-series.
Kazantzis-Kravaris/Luenberger (KKL) observers are a class of state observers for nonlinear systems that rely on an injective map to transform the nonlinear dynamics into a stable quasi-linear latent space, from where the state estimate is obtained in the original coordinates via a left inverse of the transformation map. Current learning-based methods for these maps are designed exclusively for autonomous systems and do not generalize well to controlled or non-autonomous systems. In this paper, we propose two learning-based designs of neural KKL observers for non-autonomous systems whose dynamics are influenced by exogenous inputs. To this end, a hypernetwork-based framework (HyperKKL) is proposed with two input-conditioning strategies. First, an augmented observer approach (HyperKKLobs) adds input-dependent corrections to the latent observer dynamics while retaining static transformation maps. Second, a dynamic observer approach (HyperKKLdyn) employs a hypernetwork to generate encoder and decoder weights that are input-dependent, yielding time-varying transformation maps. We derive a theoretical worst-case bound on the state estimation error. Numerical evaluations on four nonlinear benchmark systems show that input conditioning yields consistent improvements in estimation accuracy over static autonomous maps, with an average symmetric mean absolute percentage error (SMAPE) reduction of 29% across all non-zero input regimes.
Yahia Salaheldin Shaaban, Abdelrahman Sayed Sayed, M. Umar B. Niazi +1
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE. · Univ Gustave Eiffel, COSYS-ESTAS, F-59657 Villeneuve d’Ascq, France. · Department of Decision and Control Systems and Digital Futures, KTH Royal Institute of Technology, SE-100 44 Stockholm, Sweden.
This paper proposes a computable state-estimation error bound for learning-based Kazantzis--Kravaris/Luenberger (KKL) observers. Recent work learns the KKL transformation map with a physics-informed neural network (PINN) and a corresponding left-inverse map with a conventional neural network. However, no computable state-estimation error bounds are currently available for this approach. We derive a state-estimation error bound that depends only on quantities that can be certified over a prescribed region using neural network verification. We further extend the result to bounded additive measurement noise and demonstrate the guarantees on nonlinear benchmark systems.
Hannah Berin-Costain, Harry Wang, Kirsten Morris +1
Department of Applied Mathematics, University of Waterloo, Waterloo, ON N2L 3G1, Canada · University of Toronto, Toronto, ON M5S 1A1, Canada
Offline models for autonomous robots often fail under time-varying dynamics outside their training distribution. Koopman operator theory offers a linear representation of nonlinear dynamics via lifting, but its transition to real-time recursive estimation may suffer numerical vulnerabilities: covariance windup under low excitation when using exponential forgetting, and vanishing gain without forgetting. This paper introduces a Covariance-Regulated Recursive Koopman Learning (CR-RKL) framework with two complementary strategies--error dead-zone gating and constant-trace normalization--each independently capable of preventing covariance explosion and parameter freezing, with the latter additionally preserving the geometric structure of uncertainty. Validated on a non-holonomic differential-drive robot with wheel slip and Stribeck friction and on a 26-gram butterfly-inspired flapping-wing micro aerial vehicle, CR-RKL achieves numerically stable and accurate online modeling, and when embedded in model predictive control, it maintains reliable tracking performance under uncertain, time-varying dynamics.
Weibin Gu, Chen Yang, Lu Shi +1
1Tsinghua University, PR China · 2China University of Petroleum-Beijing at Karamay, PR China · 3Xinchen Qihang Inc., PR China