cs.LGSep 19, 2026

Improved Private Sparse Covariance Estimation with Multiscale Threshold Tests

Authors: Zihan Zhang

Organizations: Department of CSE, HKUST

Abstract

We study differentially private covariance estimation in operator norm for mean-zero sub-Gaussian distributions with unknown covariance support and at most kk nonzero entries per row. We develop a multiscale random-threshold algorithm with sample complexity \ot(k2/α2+kd/(αε))\ot(k^2/α^2+k\sqrt d/(α\varepsilon)) for (ε,δ)(\varepsilon,δ)-differential privacy and error at most ασ2ασ^2, where dd is the dimension and σσ is a known sub-Gaussian scale. The bound improves the privacy-dependent term of the existing \ot(k2/α2+k3/2d/(αε))\ot(k^2/α^2+k^{3/2}\sqrt d/(α\varepsilon)) \citep{kumar2026curse} upper bound by a factor of k\sqrt k, and matches the lower bound of Ω~(k2/α2+kd/(αε))\widetildeΩ(k^2/α^2 + k\sqrt{d}/(α\varepsilon)) in its applicable parameter regime. Our key technical ingredient is a direct operator-norm bound on the centered fluctuations of an ideal reconstruction, exploiting conditional independence rather than accumulating entrywise errors across each row. A multiscale allocation of threshold tests balances reconstruction variance against query sensitivity. Together, these ingredients sharpen the trade-off between approximation error and privacy protection, removing the additional k\sqrt{k} factor from the privacy-dependent sample complexity.

Explore similar work

CardsList
  1. On the Curse of Dimensionality in Private Sparse Covariance Estimation and PCA

    Jun 20, 2026Syamantak Kumar, Shourya Pandey, Purnamrita Sarkar +1Principal Component AnalysisMinimax Estimation

  2. Private Adaptive Covariance Estimation via Gaussian Graphical Models

    May 22, 2026Cecilia Ferrando, Miguel Fuentes, Brett Mullins +2Differential PrivacyCovariance Estimation

  3. Privately Estimating Monotone Statistics in Polynomial Time

    May 27, 2026Gavin Brown, Ephraim Linder, Mahbod Majid +1Sample ComplexityDifferential Privacy