stat.MLSep 30, 2026

Minimax Additive Regression under Unknown Dependent Designs

Authors: Baptiste Ferrere, Fabrice Gamboa, Jean-Michel Loubes

Organizations: Université de Toulouse EDF R&D · Université de Toulouse ANITI

Abstract

We study additive regression under a potentially non-product random design on [0,1]d[0,1]^d, allowing the dimension dd to grow with the sample size nn. We introduce coupled smoothness classes that separately control the regularity of the marginal densities and the density-weighted additive components. To handle dependence, we adapt a Riesz-basis construction for functional ANOVA models and establish compatibility bounds with constants independent of the dimension under uniform bounds on the joint density. We construct thresholded least-squares estimators and establish matching minimax upper and lower bounds for prediction with known or unknown marginal densities, under suitable dimension-growth conditions. When the marginal densities are at least as smooth as the weighted components, the unknown-density problem attains the known-density minimax rate. When the densities are less smooth, their regularity determines the minimax rate over the coupled class. Finally, we show that the centered additive components can be recovered at the same aggregate upper rate, without an additional order of error.

Explore similar work

CardsList
  1. Statistical Properties of Deep Neural Networks with Dependent Data

    Oct 14, 2024Chad BrownExponential FamilyMinimax Rate

  2. Characterizing the Generalization Error of Random Feature Regression with Arbitrary Data-Augmentation

    May 11, 2026Lucas Morisset, Alain Durmus, Adrien HardyData AugmentationRegularization