Auditable Belief Updates as a Missing Safety Layer for LLM-Powered Multi-Agent Systems
Organizations: School of Computer Science and Informatics, University of Liverpool, UK
Abstract
Large Language Models (LLMs) are increasingly being used as cognitive interfaces that shape how users interpret evidence, communicate, and make decisions. As deployed systems become more multimodal, tool-using, and multi-agent, safety failures no longer arise only from isolated harmful outputs, but also from how agents update, store, and propagate epistemic commitments across retrieval, memory, tools, and peer communication. In this paper, we define belief as an engineering abstraction for evidence-based commitments that guide downstream action. Building on this view, we propose the Explicit Belief Multi-Agent System (EB-MAS), which externalizes belief states into a structured substrate, uses belief operators to propose candidate updates, and applies a Cognitive Firewall to bound or reject updates that are weakly evidenced but strongly driven by vulnerability cues. We also discuss the risk of group belief at the group level, including manufactured consensus, collusion, and cascading misinformation, and outline practical integration challenges around grounding, false positives, scalability, and ethical misuse. Therefore, scalable agent safety requires not only better output filtering or stronger base models, but also explicit interfaces for tracing, calibrating, and constraining belief revision at runtime.
Figures & tables
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Attack | Unsafe after defense | Benign false block |
|---|---|---|---|
| Direct Qwen3-VL response | 1,013 | 67.92 | 0.00 |
| Keyword/phrase guard | 1,013 | 38.01 | 11.00 |
| LLM belief-operator only | 1,013 | 3.65 | 25.00 |
| EB-MAS graph firewall | 1,013 | 8.19 | 1.00 |
| Method | Attack after defense | Safe allow | |
|---|---|---|---|
| Direct GPT-4o-mini agent | 400 | 6.50 | 100.00 |
| Prompt-only safety instruction | 400 | 4.25 | 100.00 |
| Keyword denylist guard | 400 | 4.25 | 45.19 |
| LLM self-check guard | 400 | 3.50 | 100.00 |
| Trusted-tool whitelist | 400 | 0.00 | 100.00 |
| Rule EB-MAS graph firewall | 400 | 0.00 | 100.00 |
| Method | Unsafe acceptance | Benign false block |
|---|---|---|
| Binary belief operator | 37/1,013 (3.65%) | 254/1,013 (25.07%) |
| Fixed EB-MAS rule | 83/1,013 (8.19%) | 25/1,013 (2.47%) |
| False-block budget | Calibration false block | Unsafe acceptance | Held-out false block |
|---|---|---|---|
| 1% | 0/506 (0.00%) | 688/1,013 (67.92%) | 0/507 (0.00%) |
| 5% | 20/506 (3.95%) | 68/1,013 (6.71%) | 15/507 (2.96%) |
| 10% | 34/506 (6.72%) | 56/1,013 (5.53%) | 22/507 (4.34%) |
| 25% | 93/506 (18.38%) | 18/1,013 (1.78%) | 95/507 (18.74%) |
| Method | Unsafe commits | 95% CI | Added benign false blocks |
|---|---|---|---|
| Direct GPT-4o-mini | 74/240 (30.83%) | [25.33, 36.94] | 0/219 (0.00%) |
| Verified-root whitelist | 24/240 (10.00%) | [6.81, 14.45] | 0/219 (0.00%) |
| Provenance classifier | 20/240 (8.33%) | [5.46, 12.52] | 10/219 (4.57%) |
| EB-MAS joint ablation | 74/240 (30.83%) | [25.33, 36.94] | 0/219 (0.00%) |
| Full EB-MAS | 0/240 (0.00%) | [0.00, 1.58] | 0/219 (0.00%) |
AI Agent Safety
AI agent safety studies how to prevent and detect harmful actions by autonomous systems that use tools, memory, and multi-step plans.
See all 330 papers