AI Harness: Certification under Proposal-Conditioned Information for Foundation-Model Agents
Organizations: Hong Kong Baptist University Hong Kong, China · Beijing Normal University Zhuhai, China
Abstract
Foundation-model agents are often modeled as policies over an observed state. In deployed systems, however, a runtime may intervene only after the model has emitted a semantic proposal, making the proposal both an action candidate and a decision-time observation generated by a history-conditioned process. We show that collapsing this structure into a state-only proposal envelope can preserve proposal coverage while destroying certifiability. In a finite robust interface, the viability kernel of the collapsed model is contained in the physical projection of the history-augmented kernel, and the collapse is lossless exactly when every proposal-conditioned collapsed fiber retains a common robust-safe intervention. This gap can be maximal even with constant-size proposal and history alphabets. The same common-action condition yields a dual result: observing the current proposal can restore robust feasibility when it separates latent modes requiring incompatible interventions. We extend these one-step results over time using exact finite beliefs and standard safety and reachability fixed points, separating indefinite operational viability from finite worst-case verified progress. Controlled model-in-the-loop tests reproduce the predicted obstructions when telemetry or effect verification is removed or intervention authority is restricted. Thus, our contribution is not a new fixed-point calculus, but a characterization of when proposal--history correlation at the model--tool boundary is necessary for certification.
Figures & tables
| Contract | Violation | Physical | Verified |
|---|---|---|---|
| Full harness | 0/428 | 428/428 | 428/428 |
| No telemetry | 0/428 | 0/428 | 0/428 |
| Restricted authority | 0/428 | 410/428 | 410/428 |
| No effect verification | 0/428 | 410/428 | not certifiable |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
AI Agent Safety
AI agent safety studies how to prevent and detect harmful actions by autonomous systems that use tools, memory, and multi-step plans.
See all 330 papers