Replay-Gated Neural Execution: Decoupling Persistent Behavioral Specifications from Neural Realizations in Frozen Language Models
Organizations: The Chinese University of Hong Kong, Shenzhen Shenzhen, China
Abstract
Input-conditioned neural interventions raise a runtime question: what persists when one behavioral specification admits multiple actions whose validity depends on execution state? We introduce replay-gated neural execution, separating five objects: a persistent behavioral predicate, its state-indexed certified realization set, a transient action witness, a budget-limited finder, and execution authorization. Candidates undergo isolated FP32/BF16 replay of the frozen model; commitment additionally requires a valid run audit. Experiments on Qwen3-0.6B and SmolLM2-360M-Instruct establish distinct failure modes for these objects. Independent initializations yield distinct certified actions in all 24 tested fixed-state cells. Unchanged SmolLM2 witnesses remain certified in all 128 native states but only 66 of 384 off-diagonal transfers. All 767 archived Qwen witnesses replay successfully, yet a budget-limited finder misses one known-realizable cell in all three prespecified runs. Of 1,141 replay-submitted candidates, 174 fail item certification. A frozen three-tier cascade uses these boundaries to reject uncertified proposals and escalate audit-valid search misses. On 256 previously sealed Qwen Fresh requests, 221 first certify at the lowest-cost tier and all 256 receive audited authorization, with no observed bypass. Relative to frozen full search, the median singleton search-and-certification cost ratio is 0.1055 and P95 is 1.3485, including failed tiers. Within the studied behavioral family on two small models, these results support state-indexed, set-valued execution semantics: specifications persist, search proposes witnesses, and replay certification plus run audit grants execution authority.
Figures & tables
| Tier | Candidate generation | Update budget | Visible information | Escalation or termination |
|---|---|---|---|---|
| Tier1 | Protocol-visible pullback warm start followed by a short full-space certified solve | , and protocol-permitted | Escalate after an audit-valid search miss; fail closed on an invalid run | |
| Tier2 | Augmented curvature and relinearization | Same frozen interface | Escalate after an audit-valid search miss; fail closed on an invalid run | |
| Tier3 | Singleton WitnessSearch matching the full baseline | Frozen full lifecycle | Same frozen interface | Abstain after audit-valid search exhaustion; fail closed on an invalid run |
| Cohort | Size | Purpose |
|---|---|---|
| Reachability Public | Physical reachability and cross-precision gating | |
| Reference Stability | (767 reference + 1 abstention) | Witness replay and difficult-cell rediscovery |
| CascadePilot | One-time qualification and cost gate | |
| Frozen Fresh | New-context evaluation of the frozen policy | |
| Unseen Utility | Sealed | Outside the scope of this paper |
| Active ( ) | LCB95 | Paired-replay-equivalent cost reduction | ||
|---|---|---|---|---|
| 1 | 1.3485 | |||
| 2 | 1.0973 | |||
| 4 | 0.9434 | |||
| 8 | 0.9037 | |||
| 64 | 0.6479 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Metric | Frozen definition |
|---|---|
| Top-1 | Target ranks first among all 64 candidates, evaluated separately in FP32 and BF16 |
| Effect peak | Target-score effect is maximal relative to the zero action |
| Robust margin | Target exceeds the runner-up by at least at each precision |
| Exact zero | Empty Utility or abstention keeps the hard write path exactly zero |
| Permutation | Equivariance error under the frozen candidate-list transformation family is at most ; this does not refer to search-generation order |
| Cohort P99 | Nearest-rank/upward quantile over committed actions; threshold , separate from item certification |
| Evidence block | Cohort | Frozen result | Role in the claim |
|---|---|---|---|
| Protocol H1: reachability | ; P99 ; max | Port reachability | |
| Protocol H2: non-uniqueness | 16 cells 8 initializations | 16/16 each have 8 distinct certified solutions; 448 pairs; relative min , max | Actions are non-unique at fixed cell |
| Protocol H3: Reference Stage A | 767 cells | ; minimum margins | Frozen-witness validity |
| Protocol H3: Reference Stage B | 23 preselected difficult cells | 22 cells ; one cell | Existence counterexample; no population-rate estimate |
| Retrospective cascade | 767 cells | versus full solver ; | Full solver is not a realizability criterion |
| Protocol H4: CascadePilot | ; ; no authorization bypass | Tier1 sufficient on Pilot |
Runtime Enforcement for AI Agents
Runtime enforcement for AI agents checks and constrains actions as they execute, helping prevent unsafe or unauthorized effects.
See all 279 papers