math.OCMay 27, 2026

Implicit Regularization in Perturbed Deep Matrix Factorization: Spectral Conditions and Stability

Authors: Jingzhe WangHung-Hsu Chou

Organizations: Department of Informatics and Networked Systems, University of Pittsburgh · Department of Mathematics, University of Pittsburgh

Abstract

This paper studies the stability of low-rank implicit regularization in perturbed deep matrix factorization, where the target matrix is corrupted by a noise matrix. We first derive sufficient spectral conditions under which gradient descent exhibits a low-rank phase in the noiseless setting. These conditions show how the target spectrum, initialization, and step size jointly determine the existence of a nonempty low-rank interval. We then analyze the perturbed gradient descent dynamics, proving convergence guarantees and quantifying how the perturbation affects iteration complexity and eigenvalue recovery. Finally, we show that the low-rank phase persists under perturbation, with explicit dependence on the perturbation size. Numerical experiments support the theoretical findings.

Explore similar work

CardsList
  1. Near-Optimal Nonconvex Matrix Completion

    Sep 15, 2026Jian-Feng Cai, Xiliang Lu, Juntao YouTensor CompletionConvex Optimization