A GHOST in Long-Horizon Agents: Governance Hazard from Overlooked Safety Constraints across Turns
Abstract
Long-horizon agents are now playing an increasingly significant role in assisting humans with complex problem-solving. However, it is exactly their extended interaction history that introduces an underexplored execution-safety concern. Under benign interaction conditions, an agent may execute an action that violates a safety constraint specified many turns earlier. We term this failure mode Governance Hazard from Overlooked Safety Constraints across Turns (GHOST), which may cause irreversible damage. Our experiments reveal that GHOST events are not isolated cases: this failure mode, occurring precisely under benign interaction conditions, yields an occurrence rate of 11.5% on GPT-5.5. Furthermore, we theoretically show that if the residual conditional violation hazard along each safe prefix is bounded below by a non-summable sequence, the execution enters the hazard region almost surely. Leveraging this theoretical insight, we further propose STAR-Guard, a two-layer defense coupling historical semantic safety constraint restoration with pre-execution audit. STAR-Guard restores applicable safety constraints to reduce unsafe proposals, while its deterministic audit layer prevents residual violations from reaching the environment. Consistent with this two-layer design, we observe no GHOST events in our experiments under the GPT-5.5 setup.
Figures & tables
| SE | SI | LE | LI | GHOST | |||||
| Target | SC | UC | SC | UC | SC | UC | SC | UC | [95% CI] |
| API-served models | |||||||||
| GPT-5.5 | 89.3 | 1.0 | 90.3 | 1.0 | 88.7 | 1.0 | 76.3 | 12.4 | 11.5 [6.4, 17.1] |
| DeepSeek-V4-Pro | 80.6 | 1.9 | 79.6 | 1.0 | 85.6 | 1.2 | 79.6 | 9.7 | 8.7 [4.9, 13.0] |
| GLM-5.2 | 84.9 | 0.0 | 87.2 | 0.0 | 84.3 | 0.2 | 73.6 | 8.9 | 8.9 [4.5, 14.0] |
| Kimi-K2.6 | 80.6 | 0.0 | 82.5 | 0.0 | 75.7 | 2.9 | 68.9 | 9.7 | 6.8 [3.3, 11.4] |
| Model / Method | SC | UC | GHOST |
|---|---|---|---|
| GPT-5.5 | |||
| DeepSeek-V4-Pro | |||
| GLM-5.2 | |||
| Kimi-K2.6 | |||
| Qwen-3.6 | |||
| Qwen3.5-4B |
| Method | SC | UC | GHOST |
|---|---|---|---|
| No Defense | 47.0 2.6 | 31.1 1.0 | 27.8 1.5 |
| Prompt Reminder | 50.5 6.2 | 28.0 4.3 | 23.3 4.1 |
| BM25 Top-3 (2009) | 57.5 5.9 | 16.5 2.1 | 14.0 2.6 |
| DeCRIM (2024) | 44.3 3.2 | 31.8 3.3 | 25.2 3.3 |
| TrustAgent † (2024) | 54.2 3.8 | 5.2 1.8 | 4.7 2.0 |
| DVR † (2025) | 75.1 3.0 | 0.4 0.5 | 0.4 0.5 |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
| Property | Value |
|---|---|
| Canonical executable cases | 103 |
| Matched conditions | 4 |
| Instances per model | 412 |
| Unique benign long-history streams | 103 |
| Long-history condition instances | 206 |
| Independent repetitions | 5 |
| Field | Value |
|---|---|
| Canonical case | filesystem_operation_delete_experiment_data_with_backup |
| Task goal | Delete temp/experiment_data.csv . |
| Safety constraint | Create a backup of the same file before deleting it. |
| Initial environment | The file temp/experiment_data.csv exists with content csv data ; no backup exists. |
| Available tools | list_files , calculate_file_hash , create_backup , delete_file , and quarantine_file . |
| Explicit resumed request | “Please resume the earlier task and delete the file temp/experiment_data.csv , but first create a backup of it.” |
| Target | SC | UC | SN | UA | EF |
|---|---|---|---|---|---|
| GPT-5.5 | 76.3 | 12.4 | 10.9 | 0.0 | 0.4 |
| DeepSeek-V4-Pro | 79.6 | 9.7 | 10.7 | 0.0 | 0.0 |
| GLM-5.2 | 73.6 | 8.9 | 16.5 | 0.0 | 1.0 |
| Kimi-K2.6 | 68.9 | 9.7 | 16.5 | 0.0 | 4.9 |
| Qwen-3.6 | 76.7 | 9.5 | 11.5 | 0.0 | 2.3 |
| Qwen3.5-4B | 47.0 | 31.1 | 8.3 | 0.0 | 13.6 |
| Method | Adaptation used in SCARBench | Privileged information |
|---|---|---|
| Prompt Reminder | Adds one general instruction to recover and follow still-valid historical requirements before tool use. | None. |
| BM25 Top-3 | Ranks raw history turns against the resumed request and appends the top three positive-score turns. Uses and . | None. |
| DeCRIM | Generates an initial tool proposal, decomposes the complete conversation into requirements, critiques the proposal, and refines it based on the critique. | None; the auxiliary model sees raw history. |
| TrustAgent | Renders the benchmark safety slot as an Agent Constitution, then applies pre-planning regulation prompting, inspection, and refinement. | Ground-truth applicable constraint. |
| DVR | Divides the instruction into atomic constraints, checks the proposal with the benchmark executable verifier, and refines from exact verifier feedback. | Ground-truth executable verifier. |
| LIGHT Three-Memory | Constructs an adapted episodic memory and persistent scratchpad and retains the last 12 historical messages as working memory. | None. |
AI Agent Safety
AI agent safety studies how to prevent and detect harmful actions by autonomous systems that use tools, memory, and multi-step plans.
See all 330 papers