stat.MLApr 9, 2026

Order-Optimal Sequential 1-Bit Mean Estimation in General Tail Regimes

Authors: Ivan Lau, Jonathan Scarlett

Organizations: National University of Singapore

Abstract

In this paper, we study the problem of mean estimation under 1-bit communication constraints. We propose a novel adaptive mean estimator based solely on randomized threshold queries, where each 1-bit outcome indicates whether a given sample exceeds a sequentially chosen threshold. Our estimator is (ε,δ)(ε, δ)-PAC for any distribution with a bounded mean μ∈[−λ,λ]μ\in [-λ, λ] and a bounded kk-th central moment E[∣X−μ∣k]≤σk\mathbb{E}[|X-μ|^k] \le σ^k for any fixed k>1k > 1. Moreover, our sample complexity is order-optimal in all such tail regimes, i.e., for every such kk value. For k≠2k \neq 2, our estimator's sample complexity matches the unquantized minimax lower bounds plus an unavoidable O(log⁡(λ/σ))O(\log(λ/σ)) localization cost. For the finite-variance case (k=2k=2), our estimator's sample complexity has an extra multiplicative O(log⁡(σ/ε))O(\log(σ/ε)) penalty, and we establish a novel information-theoretic lower bound showing that this penalty is a fundamental limit of 1-bit quantization. We also establish a significant adaptivity gap: for both threshold queries and more general interval queries, the sample complexity of any non-adaptive estimator must scale linearly with the search space parameter λ/σλ/σ, rendering it vastly less sample efficient than our adaptive approach. Finally, we present algorithmic variants that (i) handle an unknown sampling budget, (ii) adapt to an unknown scale parameter σσ given (possibly loose) bounds, (iii) require only two stages of adaptivity to achieve order-optimal sample complexity at the expense of more general 1-bit queries, and (iv) leverage multiple local samples per 1-bit query to proportionally reduce communication costs.

Explore similar work

Sep 8, 2026

Non-Adaptive 1-Bit Mean Estimation: Minimax Rates and the Sample-Interval Tradeoff

We study distributed one-dimensional mean estimation under a 1-bit communication constraint. Each agent observes one sample, drawn independently from an unknown distribution, and returns a single bit in response to a query Q:R→{0,1}Q: \mathbb{R}\to\{0,1\} chosen by a central learner. The distribution has mean in [−λ,λ][-λ,λ] and kk-th central moment at most σkσ^k, for a fixed k>1k>1. The order-optimal two-stage protocol of Lau and Scarlett uses responses from the first batch to choose the second-batch queries, motivating the question of whether this single round of interaction is necessary. We answer this negatively: for every k>1k>1, a non-adaptive protocol attains the adaptive 1-bit minimax rate (and concurrent works reached the same conclusion via different strategies). We further determine the minimax sample complexity among non-adaptive 1-bit estimators when every one-set Q−1(1)Q^{-1}(1) is restricted to a union of at most ss intervals. Relative to unrestricted non-adaptive 1-bit querying, this constraint adds a term of order (λσ/(sε2))log⁡(1/δ)(λσ/(s\varepsilon^2))\log(1/δ), giving the full tradeoff between sample complexity and interval complexity to within kk-dependent constant factors. As a corollary, we identify, order-wise, the minimum interval budget needed to retain the unrestricted 1-bit minimax sample rate.
Aug 3, 2026

Interaction Is Not Necessary for Order-Optimal 1-Bit Mean Estimation

This paper is concerned with one-bit mean estimation, where each independent sample is represented by a single binary message. We consider distributions on R\mathbb{R} with mean in [−λ,λ][-λ,λ] and absolute kk-th central moment at most σkσ^k, where k>1k>1 is fixed. For this class, previous work attained the optimal sample complexity for general queries using a two-stage protocol. The first stage localizes the mean. The second-stage queries are chosen after localization and refine the estimate around the decoded center. We show that this interaction can be avoided by constructing a randomized fully non-adaptive protocol that fixes all queries before observing the data and matches the optimal adaptive sample complexity. For target accuracy εε and confidence 1−δ1-δ, its sample complexity scales as log⁡λσ+{(σ/ε)2log⁡(1/δ),k>2,(σ/ε)2log⁡(σ/ε)log⁡(1/δ),k=2,(σ/ε)k/(k−1)log⁡(1/δ),1<k<2,\log\fracλσ + \begin{cases} (σ/ε)^2\log(1/δ), & k>2,\\ (σ/ε)^2\log(σ/ε)\log(1/δ), & k=2,\\ (σ/ε)^{k/(k-1)}\log(1/δ), & 1<k<2, \end{cases} up to constants depending only on kk. In the range covered by the known lower bound, this rate is minimax optimal even among fully adaptive protocols. This gives a negative answer to the COLT 2026 open problem asking whether interaction is necessary for order-optimal one-bit mean estimation with general queries \citep[Open Problem~1]{lau2026open}.
Jul 3, 2026

Open Problem: Is Interaction Necessary for Order-Optimal 1-bit Mean Estimation?

We ask whether interaction is necessary for order-optimal 1-bit mean estimation over nonparametric finite-moment classes. Adaptive threshold-query protocols achieve the order-optimal 1-bit minimax rate, and the same rate is attainable with general 1-bit queries using only one adaptive transition (i.e., two stages of querying). In the non-adaptive setting, threshold and interval queries are known to be highly suboptimal, but the case of arbitrary non-adaptive quantizers remains unresolved. Can such quantizers match the adaptive rate, yielding an optimal one-shot protocol? Or is the known two-stage estimator stage-optimal, with a single adaptive transition being necessary and sufficient?