cs.LGMar 19, 2026

Global Convergence of Multiplicative Updates for the Matrix Mechanism: A Collaborative Proof with Gemini 3

Authors: Keith Rush

Organizations: Google DeepMind

Abstract

We analyze a fixed-point iteration v←φ(v)v \leftarrow φ(v) arising in the optimization of a regularized nuclear norm objective involving the Hadamard product structure, posed in DMR+22 in the context of an optimization problem over the space of algorithms in private machine learning. We prove that the iteration v(k+1)=diag((Dv(k)1/2MDv(k)1/2)1/2)v^{(k+1)} = \text{diag}((D_{v^{(k)}}^{1/2} M D_{v^{(k)}}^{1/2})^{1/2}) converges monotonically to the unique global optimizer of the potential function J(v)=2Tr((Dv1/2MDv1/2)1/2)−∑viJ(v) = 2 \text{Tr}((D_v^{1/2} M D_v^{1/2})^{1/2}) - \sum v_i, closing a problem left open there. The bulk of this proof was provided by Gemini 3, subject to some corrections and interventions. Gemini 3 also sketched the initial version of this note. Thus, it represents as much a commentary on the practical use of AI in mathematics as it represents the closure of a small gap in the literature. As such, we include a small narrative description of the prompting process, and some resulting principles for working with AI to prove mathematics.

Figures & tables

Explore similar work

CardsList
  1. Ky Fan Norms and Beyond: Dual Norms and Combinations for Matrix Optimization

    Dec 10, 2025Alexey Kravatskiy, Ivan Kozyrev, Nikolai Kozlov +3LMO MethodsDeep Learning Optimization

  2. MiMuon: Mixed Muon Optimizer with Improved Generalization for Large Models

    May 19, 2026Feihu Huang, Yuning Luo, Songcan ChenNeural Network GeneralizationDeep Learning Optimization

  3. Improving the matrix multiplication exponent with modern optimization and AlphaEvolve

    Aug 17, 2026Emilien Dupont, Marvin Eisenberger, Borislav Kozlovskii +7Matrix Optimization