A Calibrated Test of Internal Action Maps: State Signals Without Global Affine Closure
Organizations: Zhejiang University
Abstract
A hidden state signal can be decodable or causally usable without supporting a reusable action map. We test whether action maps fitted without a source reach its natural post-action activation and compose. We organize the tests as an evidence lattice and validate the geometric branch on a known affine S_5 carrier: all held-source folds pass one-step, composition, inverse, decoding, and commutativity gates. Structured curvature and held-domain conjugacy raise error monotonically, but only 23/30 strongest cells flip a closure gate, bounding rather than universalizing calibration. In post-trained Qwen/Qwen3-4B, frozen final-token h28 affine maps have mean held-entity error .519, versus .398 for within-test-domain cross-fit. Seven randomized entity splits and map geometry do not support a purely entity-specific account. Earlier h4/h16 layers fit one-step transitions better, but h4 conflict-state decoding is weak and lexical controls remain unresolved. Three matched intervention datasets regenerated from one frozen checkpoint show causal effects only at h28/h36. Outcome-aware refitting improves h28 one-step error to .474 (.469 with weighting), yet no refit passes composition. Learned finite worlds likewise preserve relative algebraic signals or shared charts without held-source affine closure. Within the tested carriers, state availability, causal use, local geometry, and reusable closure are separable. The result is limited to one pretrained model, sampled final-token layers, two finite worlds, and the tested affine or diagnostic function classes.
Figures & tables
| Node | Measurement | Licensed statement | Does not establish |
|---|---|---|---|
| State availability | Held-data decoding versus label controls | State information is available to the decoder | Causal use or a natural update path |
| Causal-use branch | Matched intervention versus wrong-state/translation controls | A state direction is locally usable by the output computation | Held-source closure or an on-manifold transition |
| Closure/law branch | Natural endpoints, then composition/inverse/commutativity | The tested map transfers and satisfies the reported law | Local output use or an untested carrier |
| Behavioral eligibility | Task success and state differentiation | Model-level interpretation is meaningful | A unique internal implementation |
| Branch conjunction | Causal use plus reusable closure/laws under eligibility | A causally faithful reusable operator in the tested carrier | Universality across models, layers, tokens, or function classes |
| Split | Rows/seed | Entities | State categories | Templates | Role |
|---|---|---|---|---|---|
| Train | 2,500 | A–D | all five | 0, 1 | Map fitting |
| Validation | 500 | E | all five | 0, 1 | Rank/ridge selection |
| Test | 1,000 | F–G | all five | 0, 1 | Held-entity/context evaluation |
| Setting | Test | Verdict | Decisive evidence |
|---|---|---|---|
| Exact carrier | Zero/support recovery | POSITIVE CONTROL RECOVERED | All formal/reproduction/support folds pass near numerical precision. |
| Exact carrier | Structured stress | STRUCTURED CALIBRATION LIMITED | Monotone errors, but 23/30 rather than 24/30 gate flips. |
| Qwen3-4B h28 | Frozen H1 train-only | NOT SUPPORTED | Mean ; 4/15 below ; cross-fit is descriptive. |
| Qwen3-4B h28 | Entity/context diagnostic | ACTION-DOMINANT GEOMETRY | Within/cross ratio about ; action distance dominates. |
| Qwen3-4B h4 | Lexical diagnostic | LEXICAL ROLE UNRESOLVED | Weak conflict probe; distance and token-only controls do not adjudicate. |
| Sampled layers | Paired interventions | CAUSAL DEPTH PATTERN REPLICATED | h4/h16 intervals include zero; h28/h36 positive in all datasets. |
| Candidate carrier | One-step | Composition | Causal use | Current status |
|---|---|---|---|---|
| Final-token residual h4 | pass | not supported | not detected | Low-dimensional geometry; lexical role unresolved |
| Final-token residual h16 | pass | not supported | not detected | Layer-local affine geometry only |
| Final-token residual h28 | fit-scope sensitive | not supported | replicated positive | Causally usable signal without global affine closure |
| Final-token residual h36 | not supported | not tested | replicated positive | Causal-use branch only |
| Last-16 static token embeddings | not supported | not tested | not tested | Does not explain h4 by itself |
| Other tokens/cross-layer spans | not tested | not tested | not tested | Live alternative |
Hidden-State Probing
Hidden-state probing reads model activations to study what they represent and whether those signals support monitoring or control.
See all 47 papers