stat.MLMay 29, 2026

Batched Stochastic Linear Bandits with 1-Bit Communication Constraints

Authors: Ivan LauDaniel McMorrowKevin JamiesonJonathan Scarlett

Organizations: National University of Singapore · University of Washington

Abstract

We study stochastic linear bandits under a natural combination of batching and communication constraints: the time horizon is partitioned into batches of equal size BB, and during each batch the learner sends BB requested arm pulls to an agent, who then observes the corresponding BB rewards and responds with a single bit of feedback to the learner. For each batch, the learner specifies the 1-bit quantization rule the agent uses, which may depend on all previously received bits but not on any past rewards directly. This setting addresses a significant yet unexplored ``middle ground'' between previous models having per-round quantization only or total bit budgets only. We establish a minimax lower bound showing that Ω(Bmin{d,logA})Ω(B\min\{d,\log\lvert \mathcal{A} \rvert\}) regret is unavoidable due to the 1-bit communication bottleneck, even in the absence of noise. Combined with standard statistical limits, this yields a general lower bound of Ω~(Bmin{d,logA}+dTmin{d,logA})\widetildeΩ(B\min\{d,\log\lvert \mathcal{A} \rvert\} + \sqrt{dT \min\{d,\log\lvert \mathcal{A} \rvert\}}). We develop two phased-elimination algorithms based on GG-optimal designs and 1-bit mean estimation. The first achieves O~(dB+dT)\widetilde{O}(dB + d\sqrt{T}) regret, matching the lower bound up to logarithmic factors when A=exp(Ω(d))\lvert \mathcal{A} \rvert = \exp(Ω(d)), and the second incorporates a safe-arm identification and warm-start procedure to obtain O~(BlogA+d3/2B+dTlogA)\widetilde{O}(B\log\lvert \mathcal{A} \rvert + d^{3/2}\sqrt{B} + \sqrt{dT\log\lvert \mathcal{A} \rvert}) regret, which is near-optimal in broad scaling regimes of (A,B,d,T)(\lvert \mathcal{A} \rvert, B, d, T). Together, our results demonstrate that a single bit of feedback per batch suffices to nearly match the minimax regret of unconstrained linear bandits in broad scaling regimes, even for batch sizes as large as Θ(T)Θ(\sqrt{T}).

Explore similar work

Aug 8, 2026cs.LG

Information Routing across Batch Boundaries: Memory--Batch Tradeoffs in Lipschitz Bandits

Adaptive learning needs both a state that preserves what observations imply and opportunities to act on that state. We study this width--depth tradeoff in stochastic Lipschitz bandits. After each pull, the learner retains at most WW bits of live reward-dependent state and organizes its pulls into at most BB committed batches. For Wdlog(eT)W\gtrsim_d\log(eT), we characterize minimax expected pseudo-regret up to logarithmic factors; the lower bounds hold for every WW. Besides the classical sequential and unrestricted-memory batch costs, the frontier contains the new penalty Td+2d+3(1+(B1)W)1d(d+3),T^{\frac{d+2}{d+3}} \bigl(1+(B-1)W\bigr)^{-\frac1{d(d+3)}}, proving that state width and update depth are not interchangeable. The interaction is an information-routing constraint: at regional scale ss, low regret forces the committed action transcript to encode Θd(sd)Θ_d(s^{-d}) regional decisions, while the collected boundary states carry at most (B1)W(B-1)W bits of entropy. Matching policies stream and erase verification statistics while retaining a mask of a safe active set, either in memory or fragment by fragment. The theorem recovers the full-dimensional worst-case batch-only frontier and logarithmic-memory achievability in the fully sequential specialization; static batch boundaries match predictable adaptive ones.
Zicheng Lyu, Zengfeng Huang
May 30, 2026cs.IT

Information-Theoretic Lower Bounds for Bit-Constrained Stochastic Optimization via a Reduction to Compressed Gaussian Mean Estimation

Low-precision pretraining (FP8, MXFP4, NVFP4) is now standard for frontier language models, yet the literature is almost entirely achievability -- algorithms and empirical scaling laws -- with no matching characterization of what is information-theoretically possible. We study a B-bit quantized stochastic first-order oracle: an optimizer interacts for T rounds and receives, each round, a B-bit adaptive public-coin description of its stochastic gradient. Our main contribution is an exact reduction from optimizing a strongly convex quadratic family to interactively compressed Gaussian mean estimation -- under the B-bit oracle the query carries no information, so optimization collapses exactly onto a sequential distributed-estimation problem. This yields two unconditional lower bounds, a communication bound TB = Omega(d) and a statistical bound T = Omega(sigma^2 d / eps^2), and the sharp product-form bound T = Omega((sigma^2 d / eps^2) max{1, d/B}). The product form is also unconditional: a B-bit transcript carries at most O(TB / sigma^2) of Fisher trace about the mean, so bits rather than dimension limit the recoverable information, and combined with the multivariate van Trees inequality this gives the bound directly, without bounded-likelihood-ratio truncation. We give a near-matching achievability result with exact per-round bit accounting under a bounded-dynamic-range oracle, tight up to a logarithmic factor; the lower bound is for truly Gaussian (unbounded) gradients, and closing this oracle gap is left open. A sequential rate-distortion perspective extends the reduction to correlated and drifting oracles and corrects an earlier conjecture: positive noise correlation raises the bound by (1+rho)/(1-rho) rather than relaxing it. The bounds give an information-theoretic baseline for any low-bit gradient path, not an optimality claim about deployed FP4 systems.
Munsik Kim
Jun 15, 2026cs.LG

Near-Optimal Stochastic Linear Bandits with Delay

We study stochastic linear bandits with delayed feedback under several delay models and establish near-optimal regret guarantees. Our results identify when delayed linear bandits exhibit the same qualitative behavior as multi-armed bandits (MAB), and when the linear structure creates fundamentally new challenges. Specifically, (1) for \emph{loss-independent delays}, where the delay does not depend on the realized loss (but potentially depends on the arm), we show that delays incur only an additive regret penalty. Under stochastic delays, this penalty scales with the expected delay, while under adversarial delays, it scales with the maximum number of outstanding observations. Notably, both delay penalties are dimension-free, improving upon the state-of-the-art results; (2) for \emph{loss-dependent delays}, we show that linear bandits are substantially harder than MAB: unlike in MAB, we prove matching (up to log factors) upper and lower bounds in linear bandits, whose delay penalty depends on the square root of the dimension. (3) for the \emph{delay-as-payoff model}, a special case of loss-dependent delay, we show that the optimal MAB guarantee, which depends only on the delay of the optimal arm, is also unattainable in linear bandits. Together, these results provide a sharp characterization of how delayed feedback interacts with linear generalization.
Ofir Schlisselberg, Mengxiao Zhang, Yishay Mansour