cs.CCJul 20, 2026

The Dimension of Nonterminating Resampling Computations

Authors: Yunbei Xu

Organizations: National University of Singapore

Abstract

A randomized algorithm may terminate almost surely even though exceptional random tapes make it run forever. This paper studies the survival tail, the Kolmogorov complexity of one such tape, and the Hausdorff dimension of all of them. For each s>0s>0 at which the powered repair matrices commute, the main theorem bounds wP[w]s\sum_wP[w]^s over surviving prefixes ww, uniformly over deterministic nonanticipating selectors. The case s=1s=1 controls termination; the full family gives weak-source and dimension bounds. The source powers contain information absent even from the ordinary repair kernel and the complete stopping-time law. Under one common finite tape source, two overlapping disagreement-repair rules on a four-vertex path have the same ordinary kernels and the same stopping-time law for every selector, yet their nontermination dimensions can be arbitrarily close to zero and one. At one common source-power level, the same dominated tape source makes one rule run forever but gives the other an exponential stopping tail. The separation is caused by action labels that produce the same state transition and are therefore invisible at power one. For bounded-dependence kk-SAT, conditional block min-entropy above the trace-growth threshold gives exponential termination, and the effective dimension of an individual infinite run is bounded by the trace growth induced by the clauses repaired infinitely often. Tree formulas asymptotically attain the maximum-degree dimension and global source bounds, while clique formulas attain the graph-specific one-step threshold in the stated regime. An exact backward likelihood identity complements these setwise results with tail and coding bounds for each run.

Explore similar work

Jul 8, 2026cs.LG

The Optimal Sample Complexity of Learning Autoregressive Chain-of-Thought

We prove that, in the realizable PAC setting, the sample complexity of exact-trace learning for full autoregressive Chain-of-Thought traces is upper bounded by the standard multiclass rate of the local next-token class, where this rate is governed by the Daniely--Shalev-Shwartz dimension. Under exact-trace loss, one wrong action makes the whole trace incorrect; nevertheless, for every stopping rule halt\mathtt{halt} and every pointwise halt\mathtt{halt}-halting local class H\mathrm{H}, nPACε,δ(Rollhalt(H))=O((DSdim(H)+log(1/δ))/ε)n_{\mathrm{PAC}}^{\varepsilon,δ}(\operatorname{Roll}_{\mathtt{halt}}(\mathrm{H}))=O((\operatorname{DSdim}(\mathrm{H})+\log(1/δ))/\varepsilon), with no dependence on rollout length. The dependence on DSdim(H)\operatorname{DSdim}(\mathrm{H}) is worst-case optimal, since one-step stopping recovers ordinary multiclass learning of H\mathrm{H}. The proof introduces parity dimension, a rollout-stable refinement of DS dimension based on even pseudo-cubes. It controls one-inclusion density via a low-coordinate spanning theorem on finite restrictions and, unlike DS dimension itself, does not increase under autoregressive rollout. We also show why this detour is necessary: DS dimension can increase under rollout.
Zhiyuan Li
Jan 26, 2026cs.CL

LLMs versus the Halting Problem: Characterizing Program Termination Reasoning

Determining whether a program terminates is a central problem in computer science. Turing's Halting Problem established termination as undecidable, showing that no algorithm can universally determine termination for all programs and inputs. Hence, verification tools approximate termination, sometimes failing to prove or disprove; these tools rely on problem-specific architectures and are usually tied to particular programming languages. Recent advances in LLMs raise a natural question: To what extent can they reason about program termination? We evaluate frontier LLMs on a diverse set of C programs from the International Competition on Software Verification (SV-Comp) 2025. Our results show that GPT-5 and Claude Sonnet-4.5 achieve scores comparable to top-ranked verification tools (with test-time scaling). However, while models often correctly infer whether programs terminate, they frequently fail to construct a witness as formal proof, revealing a gap between semantic recognition and symbolic proof generation. Performance further degrades as code length increases. Beyond witness automaton graphs, we introduce a divergence-precondition formulation that characterizes non-termination conditions as logical constraints. We hope these findings motivate future research on real-world termination benchmarks, neuro-symbolic approaches that combine LLMs with symbolic verification methods, and, more broadly, LLM reasoning on other undecidable problems.
Oren Sultan, Jordi Armengol-Estape, Pascal Kesseli +4
Sep 14, 2026cs.LG

Learning CNF Formulas from Uniform Random Solutions: Near-Tight Sample Complexity for Valiant's Algorithm

We revisit Valiant's algorithm (Commun. ACM'84) for learning nn-variable CNF formulas with clause size kk and variable degree dd from i.i.d. uniform random solutions in the local lemma regime. For fixed t1t\geq1, under k(1+1/t)logdk\gtrsim(1+1/t)\log d, Valiant's algorithm achieves total variation error ε\varepsilon with O~(nt/ε)\widetilde{O}(n^{\lceil t \rceil}/\varepsilon) sample complexity. For t>1t>1, we prove a matching lower bound for Valiant's algorithm. At t=1t=1 (covering 0<t<10<t<1), we show Valiant's algorithm has optimal sample complexity up to logarithmic factors by an information-theoretic lower bound Ω~(n/ε)\widetildeΩ(n/\varepsilon).
Weiming Feng, Yixiao Yu, Yiyao Zhang