cs.LGNov 1, 2026

Beyond Unit-Circle Eigenvalues: Invariant Bases for Stable State Space Dynamics

Authors: Jiaqian Zhu, Yang Zhang, Junhua Ding, Xiaowei Yu

Organizations: Missouri University of Science and Technology · University of North Texas · University of Wyoming

Abstract

Diagonal state space models process long sequences at linear cost, yet the same transition is applied at every step of a rollout, so an unconstrained recurrence holds no quantity fixed and the state decays or grows without bound. Current designs constrain one quantity, and preserving one does not guarantee preservation of the others, so a model can hold its norm to machine precision while momentum drifts by hundreds of percent. We claim that the conserved quantities of a diagonal recurrence are layered, that each layer requires a strictly stronger condition on the operator, and that a unit-modulus spectrum reaches only the outermost. Acting on the claim, we enforce the conditions required for every layer by construction. The generator of the Kronecker-Cayley transition (KC) is a graph Laplacian over object subspaces, H=L⊗Im\mathbf{H}=\mathbf{L}\otimes I_m, advanced by a Cayley transform, and the step stays diagonal at O(N3+N2m)O(N^3+N^2m) cost. The conserved set is exactly a 2m22m^2-dimensional family of quadratic forms, held at every parameter value, so the quantities and the dynamics the construction reaches are fixed before training. On four conservation benchmarks, KC holds total mass at or near the reference floor while every diagonal baseline loses it by orders of magnitude. We further compare against mass correction and find that two correctors fail once the underlying prediction diverges, which shows that assembly rather than correction is necessary for a guarantee that holds across the rollout. A free modal basis trained under a conservation penalty conserves only by freezing its spectrum, whereas the assembled operator conserves with every mode but one free to rotate. Beyond these benchmarks, KC holds the linear momentum of three NN-body systems and, at the operator level, the conserved quantity in molecular dynamics, chemical kinetics, pharmacokinetics and power-grid swing dynamics.

Figures & tables

Explore similar work

Mar 16, 2026

Trustworthy Koopman Operator Learning: Invariance Diagnostics and Error Bounds

Koopman operator theory provides a global linear representation of nonlinear dynamics and underpins many data-driven methods. In practice, however, finite-dimensional feature spaces induced by a user-chosen dictionary are rarely invariant, so closure failures and projection errors lead to spurious eigenvalues, misleading Koopman modes, and overconfident forecasts. This paper addresses a central validation problem in data-driven Koopman methods: how to quantify invariance and projection errors for an arbitrary feature space using only snapshot data, and how to use these diagnostics to produce actionable guarantees and guide dictionary refinement? A unified a posteriori methodology is developed for certifying when a Koopman approximation is trustworthy and improving it when it is not. Koopman invariance is quantified using principal angles between a subspace and its Koopman image, yielding principal observables and a principal angle decomposition (PAD), a dynamics-informed alternative to SVD truncation with significantly improved performance. Multi-step error bounds are derived for Koopman and Perron--Frobenius mode decompositions, including RKHS-based pointwise guarantees, and are complemented by Gaussian process expected error surrogates. The resulting toolbox enables validated spectral analysis, certified forecasting, and principled dictionary and kernel learning, demonstrated on chaotic and high-dimensional benchmarks and real-world datasets, including cavity flow and the Pluto--Charon system.
Sep 29, 2026

Non-Commutative Lie-Algebraic State-Space Models: Finite-Division Variety Laws, Semidirect Cascades, and Gradient Saddle Escape

Structured state-space sequence models (SSMs) achieve linear-time inference and logarithmic-time parallel training via associative scans, yet diagonal transitions generate solvable semigroups unable to track non-solvable group words or 3D rigid-body manifolds. We present Non-Commutative Lie-Algebraic State-Space Models (Lie-SSMs), parameterizing recurrent updates on Lie algebra tangent spaces via the matrix exponential. First, using an o-minimal cylindrical flag collar, we establish an unconditional single-layer finite-division criterion for contracting SO(3)SO(3) and SU(2)SU(2) heads, proving odd-prime Sylow abelianity, odd-pp-core centrality, and exponent-30 commutator obstructions excluding S5S_5 in SO(3)m,SU(2)m,SO(3)^m, SU(2)^m, and SO(4)mSO(4)^m while identifying the sharp threshold d∗(S5)=d∗(A6)=5d^*(S_5)=d^*(A_6)=5 in SO(5)SO(5). Second, Depth-2 semidirect and Schreier 22-cocycle cascades resolve S5S_5, 2I≅SL2(F5)2I\cong SL_2(F_5), and Heis(Fp)\mathrm{Heis}(F_p) in O(log⁡T)O(\log T) scan depth, whereas unnormalized contracting coupling collapses exponentially without Directional RMSNorm. Third, we characterize the Θ(εc−1)Θ(\varepsilon^{c-1}) Chen--Magnus--Hall--Witt commutator saddle and 1/∣[G,G]∣1/|[G,G]| coset-centroid dilution, proving generic first-order symmetry breaking at ε=0\varepsilon=0 and teacher-forced local Polyak--Łojasiewicz convergence under dense prefix supervision and factored readouts (99.90%/99.40%99.90\%/99.40\% on S5S_5 at T=128T=128; 100.00%100.00\% on D16D_{16}). Across SE2(3)SE_2(3) Left-Jacobian odometry, Hillis--Steele/Blelloch GPU scans (48.24×48.24\times forward, 20.27×/10.28×20.27\times/10.28\times full-layer speedup at T=2048T=2048), and three 3D IMU benchmarks (UCI HAR, UCI HAPT-PT, and 17-subject REALDISP), Lie-SO(3)SO(3) models reach 95.69%±0.14%95.69\%\pm 0.14\% on HAR, 88.44%±0.83%88.44\%\pm 0.83\% episode logit-vote (83.97%±1.20%83.97\%\pm 1.20\% C3 window in 30-subject 5-fold CV; 87.16%±0.64%87.16\%\pm 0.64\% 9-subject split) on HAPT-PT, and 84.23%±1.00%84.23\%\pm 1.00\% on REALDISP.
Mar 5, 2026

Kraus Constrained Sequence Learning For Quantum Trajectories from Continuous Measurement

Real-time reconstruction of conditional quantum states from continuous measurement records is a fundamental requirement for quantum feedback control, yet standard stochastic master equation (SME) solvers require exact model specification, known system parameters, and are sensitive to parameter mismatch. While neural sequence models can fit these stochastic dynamics, the unconstrained predictors can violate physicality such as positivity or trace constraints, leading to unstable rollouts and unphysical estimates. We propose a Kraus-structured output layer that converts the hidden representation of a generic sequence backbone into a completely positive trace preserving (CPTP) quantum operation, yielding physically valid state updates by construction. We instantiate this layer across diverse backbones, RNN, GRU, LSTM, TCN, ESN and Mamba; including Neural ODE as a comparative baseline, on stochastic trajectories characterized by parameter drift. Our evaluation reveals distinct trade-offs between gating mechanisms, linear recurrence, and global attention. Across all models, Kraus-LSTM achieves the strongest results, improving state estimation quality by 7% over its unconstrained counterpart while guaranteeing physically valid predictions in non-stationary regimes.