SecureGARD: Dynamic Ontology-Guided Governance for Secure Tool-Using LLM Agents
Organizations: MIIT Key Laboratory of Pattern Analysis and Machine Intelligence, College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China · Tsinghua University, Beijing, China · Beihang University, Beijing, China · College of Electronic and Information Engineering, Tongji University, Shanghai, China ·
Abstract
Tool-using large language model (LLM) agents translate model outputs into consequential actions, turning indirect prompt injection into an execution-security problem. Existing defenses constrain tool calls, trajectories, or information flows, but often leave action semantics, state dependencies, and evidence relations implicit, limiting generalization across heterogeneous tools and complicating safe updates. We present SecureGARD, a dynamic ontology-guided governance framework. SecureGARD grounds heterogeneous calls in a shared semantic representation and combines an executable ontology with episode-level task state to derive deterministic ready, waiting, and forbidden decisions. A waiting decision identifies an unmet but recoverable obligation, enabling bounded replanning without expanding the agent's authorization boundary. SecureGARD evolves its ontology offline from verified training executions. An offline LLM proposes instance-independent action-state axioms, which are accepted only if they address ontology errors exposed by training failures, preserve logical consistency and protected entailments, and pass held-out validation before the ontology is frozen. We evaluate SecureGARD on AgentDojo, ASB, and AgentDyn under benign and indirect prompt-injection settings. SecureGARD achieves a 0% attack success rate (ASR) across all three benchmarks while improving task utility under attack compared with existing baselines. These results show that explicit semantic governance can strengthen execution security without indiscriminate blocking.
Figures & tables
| LLM | Method | AgentDojo | ASB | AgentDyn | ||||||
|---|---|---|---|---|---|---|---|---|---|---|
| CU | AU | ASR | CU | AU | ASR | CU | AU | ASR | ||
| GPT-4o-mini | No Defense | 67.4 | 37.3 | 27.3 | 51.7 | 37.7 | 49.1 | 46.7 | 35.7 | 50.0 |
| Tool Filter | 59.5 | 41.0 | 9.0 | – | – | – | 6.7 | 4.8 | 6.2 | |
| Progent | 45.3 | 33.3 | 10.3 | 25.5 | 28.5 | 15.8 | 6.7 | 3.8 | 10.3 | |
| DRIFT | 57.3 | 50.3 | 2.3 | 26.5 | 28.5 | 4.7 | 18.3 | 20.3 | 3.1 | |
| CaMeL | 30.3 | 33.6 | 0.7 | – | – | – | 0.0 | 0.0 | 0.0 | |
| Ontology | New Axioms | Protected Ret. | CU | AU | ASR |
|---|---|---|---|---|---|
| Initial ontology | 0 | 6/6 (100.0) | 36.5 | 31.8 | 4.3 |
| Frozen ontology | 24 | 6/6 (100.0) | 34.8 | 32.5 | 0.0 |
| Pipeline Event | Count | Rate (%) |
|---|---|---|
| Total attacked executions | 477 | 100.0 |
| Observation modified by evidence processing | 421 | 88.3 |
| Attack-aligned action proposed | 38 | 8.0 |
| Rejected or deferred by adjudication | 13 | 2.7 |
| Attack-aligned action executed | 26 | 5.5 |
| Successful attack | 0 | 0.0 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Seed | CU | AU | ASR |
|---|---|---|---|
| 17 | 58.8 | 60.2 | 0.0 |
| 42 | 58.8 | 61.6 | 0.0 |
| 73 | 56.7 | 60.2 | 0.0 |
| 101 | 55.7 | 59.7 | 0.0 |
| Avg. Std. |
AI Agent Security
Artificial intelligence agent security studies attacks and safeguards for tool-using, persistent, and collaborative systems across digital and physical settings.
See all 558 papers