stat.MLJul 9, 2026

High-Dimensional Procrustes Matching via Tree Counts

Authors: Xiaochun NiuTselil SchrammJiaming Xu

Organizations: The Fuqua School of Business, Duke University, Durham NC, USA · Department of Statistics, Stanford University, Stanford, CA, USA

Abstract

Suppose we observe two sets of nn Gaussian vectors in Rd\mathbb{R}^d, with the promise that, after applying a permutation of [n][n] and a rotation of Rd\mathbb{R}^d, the two sets are ρρ-correlated. The Procrustes matching problem asks us to recover the unknown permutation of [n][n] that aligns the two sets. The problem is well-studied in the low-dimensional regime d=O(logn)d=O(\log n), but the high-dimensional regime dlognd\gg \log n has remained largely uncharted: prior matching guarantees require nearly perfect correlation ρ=1o(1)ρ=1-o(1), even for information-theoretic recovery. Our main result is a polynomial-time algorithm for exact recovery at constant correlation. The algorithm works by computing and comparing weighted counts of a specially chosen family of ``wide'' trees. So long as dpolylog(n)d\ge \mathrm{polylog}(n), the algorithm succeeds with high probability for any ρ2>αρ^2>\sqrtα, where α0.338α\approx 0.338 is Otter's tree-counting constant. We complement this algorithmic result with an improved information-theoretic guarantee, showing that exact recovery is possible when ρ2max{logn/d,logn/n}ρ^2 \gtrsim \max\{\log n/d,\sqrt{\log n/n}\}. We also carry out a low-degree advantage calculation, which suggests that the condition ρ2>αρ^2 > \sqrtα is necessary for any tree-counting algorithm.

Explore similar work

Jun 14, 2026stat.ML

Phase Transition in Convex Relaxations for Graph Alignment

We study the graph alignment problem for correlated Gaussian Orthogonal Ensemble (GOE) matrices, where the goal is to recover a hidden vertex permutation given two correlated symmetric Gaussian matrices (A,B)(A, B) with correlation 1/1+σ21/\sqrt{1+σ^2}. While the maximum likelihood estimator is information-theoretically optimal, its computation, which reduces to a quadratic assignment problem, is intractable. Motivated by this, we analyze convex relaxations based on minimizing AXXBF\|AX - XB\|_F over the set of doubly stochastic matrices and the unit hypercube. We show that when the correlation parameter satisfies σ=o(n1/2/log4n)σ= o(n^{-1/2}/\log^4 n), the solution of either relaxation (X)(X^\star) concentrates around the ground-truth permutation matrix (Π)(Π^\star), i.e., XΠF2=o(n)\|X^\star-Π^\star\|_F^2 = o(n), implying recovery of all but a vanishing fraction of vertices after simple post-processing. Combined with existing lower bounds, our results precisely characterize that XΠF2\|X^\star-Π^\star\|_F^2 transitions from o(n)o(n) for σ=o~(n1/2)σ= \tilde{o}(n^{-1/2}) to Ω(n)Ω(n) for σ=Ω~(n1/2)σ= \tildeΩ(n^{-1/2}). In doing so, our analysis significantly tightens prior results and extends them beyond doubly stochastic relaxations.
Laurent Massoulié, Sushil Mahavir Varma, Louis Vassaux +1
Jun 12, 2026cs.LG

Riemannian Metric Matching for Scalable Geometric Modeling of Distributions

High-dimensional datasets often concentrate near low-dimensional structures, but estimating their geometry from samples typically relies on graphs and kernels that scale poorly with dataset size and dimension. We propose Riemannian metric matching: a denoising probabilistic framework for learning the Riemannian geometry of data using neural networks. Specifically, we learn the carré du champ operator, which, using diffusion geometry, gives us access to the Riemannian geometry toolkit for downstream machine learning and statistical tasks. Our key observation is that the carré du champ operator can be formulated as a conditional expectation over random perturbations of the data, which can be exploited for sample-wise training and constant cost, amortized inference without explicit kernel construction. Empirically, metric matching rivals or improves the accuracy of kk-NN-based diffusion geometry estimators, while enabling amortized inference that is up to 400×400\times faster, and supports graph-free geometric analysis on high-dimensional images where nearest neighbors break down.
Jacob Bamberger, Adam Gosztolai, Pierre Vandergheynst +2
May 19, 2026cs.LG

Optimal Reconstruction from Linear Queries

We study the problem of reconstructing an unknown point in Rd\mathbb{R}^d from approximate linear queries. This setting arises naturally in applications ranging from low-dimensional remote sensing and signal recovery to high-dimensional data analysis and privacy-sensitive inference. Our main goal is to characterize the optimal reconstruction error as a function of the number of queries TT, the ambient dimension dd, and the noise parameter δδ. We first analyze the limit TT \to \infty and show that the optimal reconstruction error converges to the explicit value 2d/(d+1)δ\sqrt{2d/(d+1)} δ, which plays a role analogous to the Bayes optimal error in supervised learning. When the dimension is fixed, we show that the excess error above this limit decays doubly exponentially fast as TT \to \infty, a rate that is significantly faster than those typically encountered in learning curves. When the dimension grows, we show that a number of queries on the order of exp(d)\exp(d) is necessary and sufficient to achieve vanishing excess error. Finally, we introduce and analyze an improper variant of the reconstruction problem. From a technical perspective, our main contribution is a generalization of Jung's theorem (1901). The classical theorem bounds the maximum possible radius of a set of diameter 1 and characterizes extremal bodies. Our generalization provides a robust variant that characterizes near-extremal bodies and is proved via geometric and dynamical arguments exploiting symmetry and Lie group actions.
Yuval Filmus, Shay Moran, Elizaveta Nesterova