stat.MLNov 15, 2026

The Manifold-Index Model: provably and efficiently avoiding the statistical and computational curse of dimensionality

Authors: Yantao Wu, Mauro Maggioni

Organizations: Department of Mathematics, Johns Hopkins University, Baltimore, MD 21218, USA · Department of Mathematics and Department of Applied Mathematics & Statistics, Johns Hopkins University, Baltimore, MD 21218, USA

Abstract

We study vector-valued regression with predictors filling a tube around an unknown mm-dimensional manifold M\mathcal{M} in RD\mathbb{R}^D. In the Manifold-Index Model, the mean response is F=f∘ΠMF=f\circΠ_{\mathcal{M}}, where ΠMΠ_{\mathcal{M}} is the nearest-point projection onto M\mathcal{M} and f:M→Rpf:\mathcal{M}\to\mathbb{R}^p is a possibly non-injective link function. Multiscale ANisotropic lOcal Regression (MANOR) estimates tangent planes by multiscale PCA of predictors with similar responses, then refines them by pooling outer products of local slopes. The neighborhoods narrow tangentially while retaining complete normal fibers. We assume a Lipschitz link differential and bounded response noise. For p≥mp\ge m, under our geometric and sampling conditions, nn independent observations give mean tangent-space error of order n−2/(m+4)n^{-2/(m+4)} and integrated squared prediction error at the mm-dimensional nonparametric rate n−4/(m+4)n^{-4/(m+4)}, up to logarithmic factors. In a scaling regime with fixed intrinsic dimension, model and scale parameters, and ratio of manifold volume to the mm-th power of its reach, the required sample size grows polynomially in D+pD+p, and computation is polynomial in nn, DD and pp. Numerical experiments on curves with non-monotone links and surfaces with vector-valued responses compare observed convergence rates with the theoretical bounds; a Langevin dynamics example tests prediction of hitting probabilities under an approximate manifold-index model.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Riemannian Simultaneous Inference for Tangent Vector Field Regression

    Sep 18, 2026Xiaotian Chang, Yangdi Jiang, Qirui HuNonparametric Regression

  2. Average Gradient Outer Product in kernel regression provably recovers the central subspace for multi-index models

    May 14, 2026Libin Zhu, Damek Davis, Dmitriy Drusvyatskiy +1Kernel Ridge RegressionRepresentation Learning

  3. Intrinsic Wasserstein Rates for Score-Based Generative Models on Smooth Manifolds

    May 15, 2026Guoji Fu, Taiji Suzuki, Wee Sun Lee +1Intrinsic DimensionalityGenerative Modeling