Protected Cores Are Not Enough: Certifying AI-Proposed Revisions of Temporal Specifications
Organizations: University of Insubria, Varese, Italy
Abstract
Runtime monitoring traditionally evaluates a specification that is fixed before execution or externally modified when requirements change. In learning-enabled and data-intensive systems, however, the temporal relationships represented by a specification may themselves evolve. Allowing an AI component to directly replace a formal specification is unsafe: it may overfit transient behavior, weaken protected requirements, or activate statistically unsupported revisions. We introduce an intersymbolic architecture in which an untrusted AI proposer suggests temporal specification revisions and a symbolic governor controls their activation. Two results organize the framework. First, origin-version semantics makes the outcome of each obligation invariant to later revisions. Second, aggregate certification can conceal systematic failures on protected triggers; simultaneous aggregate and core-conditional post-selection certification controls both targets. A structural invariant preserves designer-protected components, and a proposer-independent lifetime error bound supports repeated activation decisions. The statistical bound concerns the predictable means of completed certification samples; interpreting it as future operational validity requires an additional stability assumption. Controlled synthetic experiments use a frozen supervised AI proposer to illustrate the masked-core failure at one decision and across repeated governed revisions. The proposer is a supervised regressor trained offline on synthetic tasks and frozen before use; it ranks candidates by predicted aggregate margin and never observes the protected-trigger success rate, so the masked-core failure arises from optimising the aggregate rather than from an adversary constructed by hand.
Figures & tables
| Step | Phase | Condition | Governor action |
|---|---|---|---|
| 1 | Observe | Every event | Advance all unresolved origin-version obligations. Record every trigger status and response outcome that becomes observable at , using the specification version under which the corresponding obligation originated. Update the detector for the active specification . |
| 2 | Certify | A candidate has been selected | Advance the certification-only monitor on candidate origins . Add newly completed outcomes to the aggregate sample and, when enabled, to the core sample. Evaluate and . |
| 3 | Activate | satisfies Definition 2 for the first time at | Set , , and . The new version governs origins from onward. Obligations with earlier origins retain their origin versions. |
| 4 | Propose | a drift declaration occurs at and no candidate has yet been selected while is active | Obtain , discard every candidate that fails , select at most one survivor, fix its error allocation, set , and start prospective certification. |
| 5 | Continue | Neither activation nor candidate selection occurs | Keep active. Continue resolving obligations under their origin versions. A drift declaration, proposal, or admissibility check alone does not change the active specification. |
| True | Procedure | Activations | Wilson 95% (%) | Median | Censored |
|---|---|---|---|---|---|
| 0.890 | Direct proposal | 1000/1000 | [99.6, 100.0] | 0 | 0 |
| Fixed-time, repeatedly tested | 56/1000 | [4.3, 7.2] | 107 | 944 | |
| Exact test with spending | 0/1000 | [0.0, 0.4] | – | 1000 | |
| Paper’s Hoeffding bound | 0/1000 | [0.0, 0.4] | – | 1000 | |
| 0.899 | Direct proposal | 1000/1000 | [99.6, 100.0] | 0 | 0 |
| Fixed-time, repeatedly tested | 190/1000 | [16.7, 21.5] | 249 | 810 |
| Tasks | Exact rankings | Ranking errors | Mean margin regret |
|---|---|---|---|
| 500 | 435 | 65 | 0.0035 |
| Certification rule | Below core | Wilson 95% | Median event | |
|---|---|---|---|---|
| 0.01 | Aggregate only | 200/200 | [98.1, 100.0] | 3,305 |
| 0.01 | Aggregate + core | 0/200 | [0.0, 1.9] | – |
| 0.03 | Aggregate only | 200/200 | [98.1, 100.0] | 5,795 |
| 0.03 | Aggregate + core | 0/200 | [0.0, 1.9] | – |
| 0.05 | Aggregate only | 200/200 | [98.1, 100.0] | 12,329 |
| 0.05 | Aggregate + core | 0/200 | [0.0, 1.9] | – |
| Aggregate-only activations | Joint activations | Joint median core | Joint censored | |
|---|---|---|---|---|
| 0.00 | 0/100 | 0/100 | – | 100 |
| 0.50 | 0/100 | 0/100 | – | 100 |
| 0.80 | 100/100 | 0/100 | – | 100 |
| 0.88 | 100/100 | 0/100 | – | 100 |
| 0.92 | 100/100 | 0/100 | – | 100 |
| 0.95 | 100/100 | 100/100 | 4,177 | 0 |
| Certification rule | Mean activations | Mean proposals | Below core | Sample-target failure |
|---|---|---|---|---|
| Aggregate only | 4.82 | 5.82 | 27/100 | 0/100 |
| Aggregate + core | 2.68 | 3.68 | 0/100 | 0/100 |
| Quantity | Result |
|---|---|
| Completed alarm obligations | 30,000 |
| Observed protected share | 0.099 |
| Candidate aggregate success | 0.953 |
| Candidate protected success | 0.608 |
| Aggregate-only activation sample | 3,321 |
| Joint activation | not activated |