cs.LGAug 20, 2026

Exact Minimax One-Bit Unbiased Compression: Heavy-Tail Necessity and Finite-Randomness Approximation

Authors: Tao Jiang, Minbo Gao, Shaowei Cai

Organizations: Key Laboratory of System Software (Chinese Academy of Sciences) State Key Laboratory of Computer Science Institute of Software, Chinese Academy of Sciences School of Computer Science and Technology, University of Chinese Academy of Sciences Beijing, China

Abstract

A pointwise-unbiased one-bit compressor reconstructs every real input in expectation while transmitting one bit. For a scalar source PP with CDF FF, mean mm, and J(P)=∫RF(r)(1−F(r)) dr\mathcal J(P)=\int_{\mathbb R}\sqrt{F(r)(1-F(r))}\,dr, we prove that the infimum of the source-averaged reconstruction second moment over all public-coin one-bit codes unbiased on R\mathbb R is m2+J(P)2m^2+\mathcal J(P)^2. For regular full-support sources, a distribution-centered random-threshold code attains this value; a converse over arbitrary randomized binary encoders and an equality analysis characterize every attaining code up to null sets, bit relabeling, and public-seed refinement. For the Gaussian location family N(μ,σ2)\mathcal N(μ,σ^2) with ∣μ∣≤cσ|μ|\le cσ, the equal prior on the endpoint means is least favorable and the minimax value is σ2Λc2σ^2Λ_c^2. Exact Gaussian minimax optimality forces a critical heavy tail: at the endpoint means, absolute moments are finite exactly for p<3p<3, and Pr⁡(W>t)=Θ(t−3/log⁡t)\Pr(W>t)=Θ(t^{-3}/\sqrt{\log t}). A Cauchy-mixture robustification inflates the second moment by at most 1/(1−η)1/(1-η) while making every positive-order absolute moment finite. Finite-support public randomness with finite decoder means cannot achieve exact unbiasedness on R\mathbb R, but a bounded-output approximation using exactly RR shared random bits has explicit bias and second-moment bounds converging to the minimax constant. Finally, coordinate allocation communicates exactly BB bits per Gaussian-gradient query. On Kim's continuous quadratic hard family, the expected optimization guarantee matches the lower bound in its dependence on (σ,d,B,ε)(σ,d,B,\varepsilon), and a finite-variance high-probability bound incurs only a logarithmic confidence factor.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Recovery Guarantees for Posterior Sampling of One-Bit Compressed Sensing

    Oct 8, 2026Jing Ma, Yujia Wu, Zhaoqiang LiuCompressed SensingSample Complexity

  2. PrismQuant: Rate-Distortion-Optimal Vector Quantization for Gaussian-Mixture Sources

    May 15, 2026Bumsu Park, Chanho Park, Youngmok Park +1Rate-Distortion TheoryGaussian Mixture Models