cs.ITOct 6, 2026

Slow Beats Fast at the Kesten-Stigum Threshold: Minimax, Fisher-Information and Belief-Propagation Characterizations of the Information-Computation Gap in Sparse Stochastic Block Models

Authors: Soroor Ghandali

Abstract

We study community recovery in the sparse symmetric stochastic block model with qq communities, average degree dd and signal strength λλ through statistical decision theory and Fisher information, and obtain three characterizations of the Kesten-Stigum threshold dλ2=1dλ^2=1 and of the information-computation gap below it. First, on each community-size profile the minimax risk of any class of rules closed under averaging and vertex relabeling equals its Bayes risk under the uniform prior; the posterior mean is the unique Bayes rule and is admissible, and the Bayes risk of degree-DD polynomial rules is the trivial risk times 1−CorrD21-\mathrm{Corr}_D^2. Combined with known low-degree and information-theoretic results, this gives the gap as a worst-case statement: for q≥5q\ge 5 there is a window below the threshold in which no low-degree rule beats the trivial risk asymptotically, while an exponential-time rule does on a set of labelings of probability 1−o(1)1-o(1). Second, the Fisher information about λλ carried by cycle counts is a series with terms of order k(dλ2)kk(dλ^2)^k, convergent exactly when dλ2<1dλ^2<1; below the threshold the relative error of every unbiased cycle-based estimator of λkλ^k stays above an explicit constant, and every cycle-count test has success probability bounded below one. Third, the derivative of belief propagation at its uninformative fixed point multiplies a random perturbation by ∣λ∣d|λ|\sqrt{d} per iteration, and one EM step taken there leaves λλ unchanged. A signal-to-noise computation recovers the condition dλ1/χ>1dλ^{1/χ}>1 of Chin et al. for q=nχq=n^χ communities and identifies personalized PageRank as a walk count with suboptimal weights. Experiments on networks with up to 3×1053\times 10^5 vertices confirm the threshold for q=2q=2, the hard window for q=5q=5, and the many-community scaling.

Explore similar work

Jun 1, 2026cs.IT

Query-Limited Community Recovery in Stochastic Block Models

We study exact community recovery in the two-community stochastic block model on nn vertices under limited and noisy access to network data. The learner may query a noisy neighborhood oracle that reveals each true neighbor of a queried vertex independently with fixed probability and never returns non-neighbors, subject to a finite query budget. We consider both oracle-only access and a combined model where the learner also observes a single subsampled copy of the underlying graph. For oracle-only access, balanced uniform querying gives a sharp non-adaptive benchmark: when each vertex is queried the same integer number of times, the observations reduce to an SBM with attenuated edge probabilities and the Abbe-Bandeira-Hall exact-recovery threshold applies. We show that this benchmark is not adaptively optimal: a two-stage adaptive strategy succeeds with n+o(n)n+o(n) queries in a regime where balanced uniform querying requires mnm n queries for some m>1m>1. With an additional subsampled graph, we prove a sublinear-query adaptivity gap: balanced data-independent uniform querying with a sublinear budget does not improve over the subsampled graph alone, whereas adaptive querying can target a small set of uncertain vertices and achieve exact recovery. Thus adaptive data acquisition can strictly improve the information-theoretic limits of exact recovery.
Apr 21, 2026stat.ML

Achieving the Kesten-Stigum bound in the non-uniform hypergraph stochastic block model

We study the community detection problem in the non-uniform hypergraph stochastic block model (HSBM), where hyperedges of varying sizes coexist. This setting captures higher-order and multi-view interactions and raises a fundamental question: can multiple uniform hypergraph layers below the detection threshold be combined to enable weak recovery? We answer this question by establishing a Kesten--Stigum-type bound for weak recovery in a general class of non-uniform HSBMs with rr blocks, generated according to multiple symmetric probability tensors. In the case r=2r=2, we show that weak recovery is possible whenever the sum of the signal-to-noise ratios across all uniform hypergraph layers exceeds one, thereby confirming the positive part of a conjecture in (Chodrow et al., 2023). Moreover, we provide a polynomial-time spectral algorithm that achieves this threshold via an optimally weighted non-backtracking operator. For the unweighted non-backtracking matrix, our spectral method attains a different algorithmic threshold, also conjectured in (Chodrow et al., 2023). Our approach develops a spectral theory for weighted non-backtracking operators on non-uniform hypergraphs, including a precise characterization of outlier eigenvalues and eigenvector overlaps. We introduce a novel Ihara--Bass formula tailored to weighted non-uniform hypergraphs, which yields an efficient low-dimensional representation and leads to a provable spectral reconstruction algorithm. Taken together, these results provide a principled and computationally efficient approach to clustering in non-uniform hypergraphs, and highlight the role of optimal weighting in aggregating heterogeneous higher-order interactions.
Jul 18, 2026math.ST

The Value of Depth in Message Passing on Sparse Graphs: A Kesten-Stigum Dichotomy

How deep does a graph neural network need to be on a sparse graph? We study its purest statistical form: node classification on the sparse contextual stochastic block model (CSBM) with average degree Δ=O(1)Δ=O(1), whose local weak limit is a broadcast-labelled Poisson Galton-Watson tree. Prior work derived a message-passing classifier hℓh_\ell that aggregates from each vertex at distance k≤ℓk\le\ell the attenuated evidence 2artanh⁡(γkt(Xv))2\operatorname{artanh}(γ^k t(X_v)), with γγ the edge signal and tt a bounded likelihood-ratio transform of the feature. We prove that the value of depth is governed by a single number, the Kesten-Stigum ratio κ=γ2Δκ=γ^2Δ. Below the threshold (κ<1κ<1), the error sequence is Cauchy at a geometric rate, ∣E(ℓ)−E(ℓ′)∣≤Cκ(ℓ+1)/3|\mathcal{E}(\ell)-\mathcal{E}(\ell')|\le Cκ^{(\ell+1)/3} for all ℓ′>ℓ\ell'>\ell, so all layers beyond depth O(log⁡(1/ε))O(\log(1/ε)) change the error by less than εε; conversely, under mild regularity each sufficiently deep layer still flips the decision with probability at least cκℓ/2cκ^{\ell/2}, the empirically sharp exponent. Above the threshold (κ>1κ>1), depth is geometrically productive: E(ℓ)\mathcal{E}(\ell) is driven to a branching-process floor of order at most 1/(κ−1)1/(κ-1) at any geometric rate κ−sℓκ^{-s\ell}, s<1s<1 (this bound has content only for κ>17κ>17). No local classifier of any depth beats the universal floor e−ΔΦ(−ζ)e^{-Δ}Φ(-ζ) set by isolated roots (ζζ the feature signal-to-noise ratio), while the first layer provably helps by an explicit total-variation amount. Simulations with an exact belief-propagation baseline on the same trees show that the pairwise rule's error curve is mildly non-monotone in ℓ\ell, so an optimal finite depth exists (an exact instance is certified in the appendix), while BP saturates strictly faster, at an effective per-layer ratio below κκ that we identify.