math.FAMar 30, 2026

Minimum Norm Interpolation via the Local Theory of Banach Spaces: The Role of 22-Uniform Convexity

Authors: Gil Kur, Pierre Bizeul

Organizations: Institute for Machine Learning, ETH Zürich · Department of Mathematics, Weizmann Institute of Science

Abstract

The minimum-norm interpolator (MNI) framework has recently attracted considerable attention as a tool for understanding generalization in overparameterized models, such as neural networks. In this work, we study the MNI under a 22-uniform convexity assumption, which is weaker than requiring the norm to be induced by an inner product; in this setting, the MNI typically does not admit a closed-form solution. At a high level, we show that this condition yields an upper bound on the MNI bias in both linear and nonlinear models. We further show that this bound is sharp for overparameterized linear regression when the norm's unit ball is in isotropic or John's position and the covariates are i.i.d.\ sub-Gaussian, for example, when each covariate vector has i.i.d. Rademacher entries. Finally, under the same assumption on the covariates, we prove sharp generalization bounds for the ℓp\ell_p-MNI when p∈(1+C/log⁡d,2]p \in \bigl(1 + C/\log d, 2\bigr]. To the best of our knowledge, this is the first work to establish sharp bounds for non-Gaussian covariates in linear models when the norm is not induced by an inner product. This work is deeply inspired by classical work on KK-convexity and recent work on the geometry of 22-uniformly convex and isotropic convex bodies.

Explore similar work

CardsList
  1. Benign Overfitting for General Norms and Distributions

    Sep 27, 2026Daniel Barzilai, Ohad ShamirBenign OverfittingStatistical Learning Theory

  2. Grokking through the Lens of Minimum-Norm Interpolation

    Sep 29, 2026Gil Kur, Ileana Rugina, Clémentine Carla Juliette Dominé +1Statistical Learning TheoryImplicit Regularization

  3. Generalization error of min-norm interpolators in transfer learning

    Jun 20, 2024Yanke Song, Kenneth Gu, Sohom Bhattacharya +1OOD GeneralizationCross-Domain Transfer Learning