math.NAApr 28, 2026

State-Dependent Lyapunov Analysis of Rank-1 Matrix Factorization

Authors: Jaehong Moon

Organizations: Industrial & Enterprise Systems Engineering University of Illinois at Urbana-Champaign Urbana, IL 61801

Abstract

We study gradient descent for rank-1 matrix factorization through a state-dependent Lyapunov perspective. The central object is a parameterized quadratic certificate I(δ;)I(δ;\,\cdot) whose boundary-inward property induces a monotone state parameter δtδ_t, thereby certifying that the trajectory is confined to a shrinking family of level sets. For certified initializations below the critical step size, this mechanism proves convergence to global minimizers. Above the critical step size, the same monotone-state mechanism instead leads to a balanced terminal regime; for a range of post-critical step sizes, the reduced dynamics exhibit period-2 behavior consistent with edge-of-stability phenomena. We further show that the scalar certificate is not an ad hoc algebraic construction: under structural axioms and a natural state-parameter normalization, it is uniquely determined by the monotonicity mechanism. Numerical experiments suggest that this state-dependent Lyapunov mechanism persists beyond the proved cases, including two-dimensional rank-1 approximation and quartic augmentations of scalar factorization.

Explore similar work

CardsList