Paper ID: 2502.18698 • Published Feb 25, 2025
Tukey Depth Mechanisms for Practical Private Mean Estimation
Gavin Brown, Lydia Zakynthinou
University of Washington•University of California
TL;DR
Get AI-generated summaries with premium
Get AI-generated summaries with premium
Mean estimation is a fundamental task in statistics and a focus within
differentially private statistical estimation. While univariate methods based
on the Gaussian mechanism are widely used in practice, more advanced techniques
such as the exponential mechanism over quantiles offer robustness and improved
performance, especially for small sample sizes. Tukey depth mechanisms carry
these advantages to multivariate data, providing similar strong theoretical
guarantees. However, practical implementations fall behind these theoretical
developments.
In this work, we take the first step to bridge this gap by implementing the
(Restricted) Tukey Depth Mechanism, a theoretically optimal mean estimator for
multivariate Gaussian distributions, yielding improved practical methods for
private mean estimation. Our implementations enable the use of these mechanisms
for small sample sizes or low-dimensional data. Additionally, we implement
variants of these mechanisms that use approximate versions of Tukey depth,
trading off accuracy for faster computation. We demonstrate their efficiency in
practice, showing that they are viable options for modest dimensions. Given
their strong accuracy and robustness guarantees, we contend that they are
competitive approaches for mean estimation in this regime. We explore future
directions for improving the computational efficiency of these algorithms by
leveraging fast polytope volume approximation techniques, paving the way for
more accurate private mean estimation in higher dimensions.
Figures & Tables
Unlock access to paper figures and tables to enhance your research experience.