math.STMar 20, 2026

Minimax and Adaptive Covariance Matrix Estimation under Differential Privacy

Authors: T. Tony Cai, Yicheng Li

Organizations: Department of Statistics and Data Science, The Wharton School, University of Pennsylvania · KLATASDS-MOE, School of Statistics, East China Normal University

Abstract

Estimating covariance matrices is fundamental to a wide range of statistical applications. This paper studies minimax and adaptive estimation of high-dimensional covariance matrices under ρρ-zero-concentrated differential privacy (ρρ-zCDP) over three nested classes: the pointwise-decay class Hα\mathcal{H}_α, the row-tail class Gα\mathcal{G}_α, and the separated-block class Fα\mathcal{F}_α. We consider both squared operator norm loss and normalized squared Frobenius norm loss. For Hα\mathcal{H}_α and Gα\mathcal{G}_α, we develop center--outer dyadic estimators tailored to the refined geometry of the two classes, while for Fα\mathcal{F}_α, we develop a blockwise tridiagonal estimator. The resulting minimax-optimal rates reveal a nontrivial interplay among the smoothness αα, the loss, the geometry of the covariance class, and the privacy constraint. In contrast to the non-private setting, privacy distinguishes covariance classes that share the same leading non-private rate and induces a polynomial dependence on the ambient dimension. We further develop procedures that adapt to the unknown decay parameter over all three covariance classes under both losses, at the cost of at most polylogarithmic factors. To establish minimax lower bounds, we develop a novel differentially private van Trees inequality that connects Fisher information with the ρρ-zCDP constraint and may be useful for other private estimation problems. We also construct carefully designed prior distributions to obtain matching minimax lower bounds.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Private Adaptive Covariance Estimation via Gaussian Graphical Models

    May 22, 2026Cecilia Ferrando, Miguel Fuentes, Brett Mullins +2Differential PrivacyCovariance Estimation

  2. On the Curse of Dimensionality in Private Sparse Covariance Estimation and PCA

    Jun 20, 2026Syamantak Kumar, Shourya Pandey, Purnamrita Sarkar +1Principal Component AnalysisMinimax Estimation