cs.ITSep 14, 2026

Zero-SNR Analyticity of the Scalar MMSE Is Equivalent to Gaussianity

Authors: Yixing Zhang

Abstract

Let Ys=sX+ZY_s=\sqrt{s}X+Z, where ZZ is standard Gaussian and independent of the real random variable XX. We prove that, under the square-exponential moment condition EeβX2<\mathbb{E}e^{βX^2}<\infty for some β>0β>0, the scalar minimum mean-square error mmseX(s)\operatorname{mmse}_X(s) is analytic at zero signal-to-noise ratio if and only if XX is Gaussian, with constant random variables included as degenerate Gaussians. The proof converts estimation in the Gaussian channel into a backward heat flow acting on the moment-generating function M(z)=EezXM(z)=\mathbb{E}e^{zX}. Under the stated tail condition, every non-Gaussian input forces MM to have a nonzero complex zero. We show that each zero cluster produces a finite singularity in its localized Borel transform at the action ξ=z02/2ξ=z_0^2/2. After removing the action scale, the Borel coefficients have a nonzero n1/2n^{-1/2} prefactor for a simple zero. A zero of multiplicity m2m\geq 2 splits according to the roots of a Hermite polynomial and instead contributes a prefactor nm/2erm2nn^{-m/2}e^{r_m\sqrt{2n}}. A finite-disc localization and relative-cycle continuation argument then show that at least one such singularity survives in the full Borel transform. Thus, for every non-Gaussian input in the stated class, the formal zero-SNR expansion is Gevrey-1 but divergent. Rational-MMSE rigidity and the analogous analyticity criterion for mutual information follow as corollaries.

Explore similar work

May 2, 2026stat.ML

Mean Testing under Truncation beyond Gaussian

We characterize the fundamental limits of high-dimensional mean testing under arbitrary truncation, where samples are drawn from the conditional distribution P(S)P(\cdot \mid S) for an unknown truncation set SS that may hide up to an ε\varepsilon-fraction of the probability mass. For distributions with pp-th directional moments of magnitude at most νP,pν_{P,p}, truncation induces a bias of order O(νP,pε11/p)O(ν_{P,p}\varepsilon^{1-1/p}). This bias creates a sharp information-theoretic detectability floor: when the signal αα falls below this threshold, the null and alternative hypotheses are indistinguishable even with infinite data. Above this floor, we prove that a simple second-order test achieving near-optimal sample complexity n=O ⁣(ΣP(α4νP,pε11/p)2d)n = O\!\left(\frac{\|Σ_P\|}{(α-4ν_{P,p}\varepsilon^{1-1/p})^2}\sqrt{d}\right). We further identify a structural escape from this finite-moment bias barrier. Under a directional median regularity assumption, truncation bias improves to linear order O(ε)O(\varepsilon). This reveals an intermediate regime in which estimation requires Θ(d)Θ(d) samples for uniform recovery, while testing recovers the classical Θ(d)Θ(\sqrt d) rate once truncation bias is eliminated. Together, our results provide a unified framework for mean testing under truncation, connecting finite-moment, sub-Gaussian, and median-regular structural regimes.
Yuhao Wang, Roberto Imbuzeiro Oliveira, Themis Gouleakis
Aug 31, 2026math.ST

Compact and Infinite-Order Error Analysis for Null-Space SVD Estimation

We study null-space estimation from a noisy matrix. For a simple left null space, we first derive an exact compact expression for the error of the smallest left singular vector. We then give an all-order series for the SVD vector and projector, followed by compact and consistently truncated series forms for the fixed-realization empirical risk and conditional population generalization risk. The recursion extends to a multiple-dimensional null space by following the complete invariant subspace. The convergence radius is not inferred from an error plot: it is computed independently from the nearest complex exceptional point that joins a retained eigenvalue branch to its complement. A reduced-nullity experiment shows that moving this spectral boundary can increase the radius, although the improvement is not monotone in the retained nullity. For individually ordered null directions under Gaussian training with τmτ\geq m, we prove that the Wishart splitting matrix WW gives a strict second-order empirical ranking. Gaussian averaging equalizes the leading generalization risks at both small and very large noise, while a column-swap theorem proves strict expected generalization ranking for an isotropic signal subspace. For unequal spikes, an exact population-overlap criterion and a simultaneous 99%99\% Monte Carlo confidence certificate explain the observed intermediate ranking. A sixth-order risk correction improves the lower-crossover estimate in the reported experiment. This equal--ranked--equal phenomenon is a finite-sample diagnostic related to spectral mixing, but its tolerance crossings, the exceptional-point radius, and the asymptotic BBP threshold are three distinct quantities.
Xin Li, Jonathan Cohen, Rami Puzis
Jun 4, 2026cs.IT

The Sharp Phase Transition of Tyler's M-Estimator for Robust Subspace Recovery

Robust Subspace Recovery (RSR) aims to identify an underlying d-dimensional subspace from a dataset heavily corrupted by outliers. Complexity-theoretic results establish a threshold for the problem's computational hardness based on the dimension-scaled signal-to-noise ratio (DS-SNR): the problem is SSE-hard when the DS-SNR is strictly less than 1, and solvable via practical algorithms when it is greater than 1 under general position assumptions. However, the exact behavior of practical algorithms at the critical boundary DS-SNR = 1 has remained unknown. This work resolves the behavior of Tyler's M-estimator (TME) at this critical boundary, consequently establishing a sharp phase transition. Specifically, we prove that TME converges exactly to the true subspace for DS-SNR \geq 1 under a new stability condition, which is less restrictive than the general position assumptions used in prior literature. Our analysis utilizes a decomposition of the TME iterates within a majorization-minimization framework.
Gilad Lerman, Teng Zhang