math.STNov 18, 2026

Functional Principal Component Analysis: Minimax Optimality from Sparse to Dense Designs and Beyond

Authors: Shunxing Yan, Fang Yao

Organizations: Department of Statistics and Data Science, Tsinghua University · School of Mathematical Sciences, Center for Statistical Science, Peking University

Abstract

Functional principal component analysis (FPCA) plays a central role as a dimension-reduction and representation tool in functional data analysis, but its minimax theory for diverging spectral indices under noisy discrete observation has remained open for over two decades. To fill this gap, we consider a sieve-based FPCA framework that pools discrete measurements across subjects and accommodates sampling frequencies ranging from sparse to dense under random designs. We begin by establishing new minimax rates for covariance estimation over general bivariate function classes beyond tensor-product low-complexity structures, thereby identifying the intrinsically two-dimensional optimal rate. Our central theoretical contribution is to establish minimax optimal rates for both individually labelled eigenfunctions with diverging indices and leading principal subspaces of increasing dimensions, under explicit growth and regularity conditions. To establish these results, we develop a general framework for sharp minimax analysis of FPCA under discrete observation, separating spectral approximation from stochastic perturbations and exploiting their distinct structures, thereby offering a new approach to a broad class of nonparametric spectral estimation problems. For both spectral targets, the optimal rates reveal two distinct statistical mechanisms, spectral identification and nonparametric reconstruction, whose interplay gives rise to either four or two sampling regimes. This yields, for the first time, a precise characterization of the impact of discrete sampling across the full range from sparse to dense designs. Finally, as a downstream application, we analyze FPCA-based functional linear regression and show that the FPCA-based estimator attains the minimax-optimal rates.

Figures & tables

Explore similar work

CardsList
  1. Functional linear regression from sparse to dense designs: a pooling-ridge method and minimax optimality

    Aug 26, 2026Shunxing Yan, Fang YaoLinear RegressionMinimax Estimation

  2. PCA of probability measures: Sparse and Dense sampling regimes

    Feb 2, 2026Gachon Erell, Jérémie Bigot, Elsa CazellesPrincipal Component AnalysisDimensionality Reduction

  3. A Functional SVD Framework for Regularized Multivariate Functional PCA with Dual Penalization

    Sep 13, 2026Yue Zhao, Hossein Haghbin, Rebecca Sanders +1Functional Data AnalysisPrincipal Component Analysis