cs.LGJun 15, 2026

Entropy-Gated Latent Recursion

Authors: Soham BhattacharjeeDushyant Singh ChauhanSalem LahlouMartin TakacNils Lukas

Organizations: Department of Machine Learning Mohamed bin Zayed University of Artificial Intelligence Abu Dhabi, United Arab Emirates

Abstract

Inference-time scaling has become the dominant lever for improving language-model reasoning, but existing methods derive rollout diversity from a single source: stochastic token-level sampling. We argue that this single-axis sampling space is fundamentally limiting, and identify a second, fully deterministic and complementary axis: the layer span LL at which a frozen model's top decoder layers are recursively re-applied at high-uncertainty tokens. Different choices of LL produce distinct rollouts that solve different subsets of problems, with no stochasticity. We instantiate this axis through Entropy-Gated Latent Recursion (EGLR), a training-free decoding procedure that re-applies the top-LL layers for at most KmaxK_{\max} iterations until the next-token distribution converges. Combined with TT temperature samples, EGLR turns a single-axis stochastic rollout pool into an L×TL\times T Cartesian sampling space at almost the same per-rollout cost. We characterize this space across 88 instruction-tuned models and 66 math reasoning benchmarks, and show that the LL-axis is genuinely complementary to temperature: on MATH-500 with Qwen2.5-3B-Instruct, the joint L×TL\times T oracle reaches 91.6%91.6\%, +8.2+8.2 percentage points beyond the temperature-only oracle (83.4%83.4\%) and +10.4+10.4 points beyond the layer-only oracle (81.2%81.2\%), confirming that the two axes capture genuinely complementary problems. The expanded rollout pool provides richer per-prompt candidates for any downstream procedure that consumes rollouts, including self-consistency, best-of-NN with verifiers, and group-relative RL training (GRPO), opening a new direction for inference-time scaling that does not rely on stochastic noise.

Explore similar work

CardsList