stat.MLMay 2, 2026

Mean Testing under Truncation beyond Gaussian

Authors: Yuhao WangRoberto Imbuzeiro OliveiraThemis Gouleakis

Organizations: Amazon · IMPA, Rio de Janeiro, RJ, Brazil · Nanyang Technological University

Abstract

We characterize the fundamental limits of high-dimensional mean testing under arbitrary truncation, where samples are drawn from the conditional distribution P(S)P(\cdot \mid S) for an unknown truncation set SS that may hide up to an ε\varepsilon-fraction of the probability mass. For distributions with pp-th directional moments of magnitude at most νP,pν_{P,p}, truncation induces a bias of order O(νP,pε11/p)O(ν_{P,p}\varepsilon^{1-1/p}). This bias creates a sharp information-theoretic detectability floor: when the signal αα falls below this threshold, the null and alternative hypotheses are indistinguishable even with infinite data. Above this floor, we prove that a simple second-order test achieving near-optimal sample complexity n=O ⁣(ΣP(α4νP,pε11/p)2d)n = O\!\left(\frac{\|Σ_P\|}{(α-4ν_{P,p}\varepsilon^{1-1/p})^2}\sqrt{d}\right). We further identify a structural escape from this finite-moment bias barrier. Under a directional median regularity assumption, truncation bias improves to linear order O(ε)O(\varepsilon). This reveals an intermediate regime in which estimation requires Θ(d)Θ(d) samples for uniform recovery, while testing recovers the classical Θ(d)Θ(\sqrt d) rate once truncation bias is eliminated. Together, our results provide a unified framework for mean testing under truncation, connecting finite-moment, sub-Gaussian, and median-regular structural regimes.

Explore similar work

Jun 25, 2026cs.DS

Fast algorithms for learning a Gaussian under halfspace truncation with optimal sample complexity

We study the fundamental problem of learning a high-dimensional Gaussian truncated to an unknown halfspace. Lee, Mehrotra and Zampetakis (FOCS'24) recently obtained the first polynomial time algorithm for this problem, but their resulting sample and time complexity bounds are not optimal. Under non-trivial truncation, for any target accuracy ε>0\varepsilon > 0 and dimension dd we give an efficient algorithm that uses n=O~(d2/ε2)n = \tilde{O}(d^2/\varepsilon^2) samples and learns the underlying Gaussian to error ε\varepsilon in total variation distance. Our algorithm is also fast: its runtime is dominated by the cost of computing the empirical covariance matrix. Both our sample and time complexity are optimal in terms of dd and ε\varepsilon even without truncation: in this regard, we can learn a Gaussian under halfspace truncation for free. The key ingredient behind our result is a novel reinterpretation of the low-degree moments of the truncated Gaussian in terms of a relative truncation parameter. This relative truncation parameter uniquely determines the parameters of the untruncated Gaussian and enables direct parameter recovery. This reinterpretation allows us to circumvent the time intensive projected stochastic gradient descent procedure that is widely used in learning under truncation.
Haitong Liu, Deepak Narayanan Sridharan, David Steurer +1
Mar 17, 2026cs.LG

High-Dimensional Gaussian Mean Estimation under Realizable Contamination

We study mean estimation for a Gaussian distribution with identity covariance in Rd\mathbb{R}^d under a missing data scheme termed realizable εε-contamination model. In this model an adversary can choose a function r(x)r(x) between 0 and εε and each sample xx goes missing with probability r(x)r(x). Recent work Ma et al., 2024 proposed this model as an intermediate-strength setting between Missing Completely At Random (MCAR) -- where missingness is independent of the data -- and Missing Not At Random (MNAR) -- where missingness may depend arbitrarily on the sample values and can lead to non-identifiability issues. That work established information-theoretic upper and lower bounds for mean estimation in the realizable contamination model. Their proposed estimators incur runtime exponential in the dimension, leaving open the possibility of computationally efficient algorithms in high dimensions. In this work, we establish an information-computation gap in the Statistical Query model (and, as a corollary, for Low-Degree Polynomials and PTF tests), showing that algorithms must either use substantially more samples than information-theoretically necessary or incur exponential runtime. We complement our SQ lower bound with an algorithm whose sample-time tradeoff nearly matches our lower bound. Together, these results qualitatively characterize the complexity of Gaussian mean estimation under εε-realizable contamination.
Ilias Diakonikolas, Daniel M. Kane, Thanasis Pittas
Sep 8, 2026stat.ML

Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff

We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query Q:R{0,1}Q: \mathbb{R}\to\{0,1\} chosen by a central learner. The distribution has mean in [λ,λ][-λ,λ] and kk-th central moment at most σkσ^k, for a fixed k>1k>1. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every k>1k>1, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit estimators when every one-set Q1(1)Q^{-1}(1) is restricted to a union of at most ss intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order (λσ/(sε2))log(1/δ)(λσ/(s\varepsilon^2))\log(1/δ), giving the full tradeoff between sample complexity and interval complexity to within kk-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Ivan Lau, Jonathan Scarlett