Generating differentially private synthetic data with meaningful Wasserstein utility guarantees is challenging in high dimensions. For datasets of size n on [0,1]d with d≥2, existing pure ε-differentially private mechanisms achieve expected 1-Wasserstein error of order (εn)−1/d, reflecting the curse of dimensionality. While this rate is optimal in the worst case, it can be overly pessimistic when the data are supported on a lower-dimensional set. We formalize this through a multiscale packing-growth dimension k, which captures the geometric complexity of the support via the growth of packing numbers across scales. We propose \emph{Adaptive Pruned-PMM}, a pure ε-differentially private mechanism that combines private depth selection with our pruned variant of the Private Measure Mechanism (PMM) of He et al.\ (2023). The mechanism supports deeper, geometry-adapted hierarchies with expected running time O(d(n+d)log(εn)), which is near-linear in n for fixed dimension and privacy budget. Under an external multiscale packing-growth condition with dimension k, we show that, for fixed positive privacy budgets and fixed geometry, the expected 1-Wasserstein error is of order (εn)−1/k for k>1 as n grows. We also prove a lower bound under a corresponding internal packing-growth condition, showing that the exponent 1/k is sharp within this framework.
Figures & tables
Figure 1 : Coarse partitions lead to poor geometric fidelity, finer partitions better track the support but introduce more noisy counts.
Figure 2 : Left: Adaptive Pruned-PMM lowers empirical W1 relative to the ambient-depth PMM baseline as d grows. Right: Pruned-PMM preserves PMM-level W1 while reducing runtime and visited nodes. Ratios are Pruned-PMM/PMM for W1 , and PMM/Pruned-PMM for runtime and nodes.
Figure 3 : Depth sweep on the 2D shape suite. For each depth, points and error bars average over the nine shapes and 10 independent runs per shape. Pruned-PMM has comparable empirical W1 to full PMM, while using substantially less runtime and visiting far fewer tree nodes.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 4 : Adaptive depth selection on n=30000 samples from linear k -dimensional coordinate subspaces of [0,1]d .
Figure 5 : Two-dimensional shape suite, part I. Pruned-PMM remains visually close to full PMM on curved and manifold-like supports.
Figure 6 : Two-dimensional shape suite, part II. Pruned-PMM remains close to full PMM on multimodal, grid-like, and piecewise-structured supports.
We study the problem of generating synthetic data under differential privacy. We establish fixed-parameter tractability (FPT) for this problem where the parameter is the treewidth of the query family's incidence graph. Our algorithms attain optimal error rates across all regimes and are realized by two different approaches: the first is based on linear programming (LP) and the FPT of the separation problem for the LP dual; the second is based on a subsampled private multiplicative weights method, where we obtain FPT for sampling from Gibbs distributions. Both approaches are unified by a dynamic programming framework over a tree decomposition.
Badih Ghazi, Cristóbal Guzmán, Pritish Kamath +3
Google Deepmind · Institute for Mathematical and Computational Engineering, Faculty of Mathematics and School of Engineering, Pontificia Universidad Cat´olica de Chile · Google Research
In this paper, we study the problem of sampling from a distribution under the constraint of differential privacy (DP). Prior works measure the utility of DP sampling with density ratio-based measures such as KL divergence. However, such formulations suffer from two key limitations: 1) they fail to capture the geometric structure of the support, and 2) they are not applicable when the supports of the distributions differ. To deal with these issues, we develop a novel framework for DP sampling with Wasserstein distance as the utility measure. In this formulation, we propose Wasserstein Projection Mechanism (WPM), a minimax optimal mechanism based on Wasserstein projection. Furthermore, we develop efficient algorithms for computing the proposed mechanisms approximately and provide convergence guarantees.
Shokichi Takakura, Seng Pei Liew, Satoshi Hasegawa
We study the problem of differentially private (DP) k-means clustering in Euclidean space. Previous solutions rely on summing the private data directly, which induces a sensitivity proportional to the domain. We introduce PE-means, an extension of the private evolution (PE) algorithm (an increasingly popular method for synthetic data generation), to the problem of k-means clustering. The key advantage of PE is that it only computes a private histogram with constant sensitivity to guide the evolution. Our adaptation of PE includes new evolutionary operators for clustering, as well as other algorithmic improvements of independent interest. Overall, PE-means achieves an average improvement of 26% in clustering loss over state-of-the-art baselines such as Google's LSH-based algorithm and DP-Lloyd variants.