Multi-Agent System Security

Follow this topic Ask about this topic

Momentum

18 papers in the last four weeks, up 200% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 112

All topics

A Note on the Strategic Confinement Problem
Jun 7, 2026Christian Schroeder de WittMulti-Agent System Security
University of Oxford
Semantic Quorum Assurance: Collective Certification for Non-Deterministic AI Infrastructure
Jun 6, 2026Jun He, Deying YuAI Assurance Cybersecurity
Byzantine Cheap Talk: Adversarial Resilience and Topology Effects in LLM Coordination Games
Jun 5, 2026Aya El Mir, Martin Takáč, Salem LahlouMulti-Agent LLM Systems Multi-Agent Coordination
Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE
FORGE: Multi-Agent Graduated Exploitation and Detection Engineering
Jun 2, 2026Farooq ShaikhCybersecurity Automated Penetration Testing
Dynatrace, Vienna, Austria
SS-ZKR: Spatial-Semantic Zero-Knowledge Routing for Privacy-Preserving Multi-Agent Collaboration
May 31, 2026Hassan TouheedAgent Communication Protocols Multi-Agent System Security
Stateful Online Monitoring Catches Distributed Agent Attacks
May 29, 2026Davis Brown, Samarth Bhargav, Arav Santhanam +7LLM Agent Security AI Agent Monitoring
University of Pennsylvania · 2Carnegie Mellon University
The Best-Laid SCHEMEs: Coordinated Sabotage and Monitoring in Multi-Agent Systems
May 27, 2026Nikolay Radev, Lennart Haas, Benjamin Arnav +1AI Agent Security Benchmarks AI Agent Monitoring
The Importance of Out-of-Band Metadata for Safe Autonomous Agents: The Redpanda Agentic Data Plane
May 27, 2026Tyler Akidau, Tyler Rockwood, Johannes Brüderl +1AI Agent Security AI Agent Safety
Redpanda · USA / Germany
Defending LLM-based Multi-Agent Systems Against Cooperative Attacks with Sentence-Level Rectification
May 27, 2026Yaoyang Luo, Zhi Zheng, Ziwei Zhao +5Multi-Agent LLM Systems Fake News Detection
University of Science and Technology of China · North Automatic Control Technology Institute · Shenzhen Institute for Advanced Study, UESTC
Voluntary Collusion with Secret Tools in Competing LLM Agents
May 26, 2026Xijie Zeng, Frank RudziczLLM Agent Evaluation LLM Agent Safety
Dalhousie University · Vector Institute for Artificial Intelligence
HARP: Measuring Harm Amplification in Multi-Agent LLM Systems
May 26, 2026Md Hafizur Rahman, Zafaryab Haider, Tanzim Mahfuz +1Multi-Agent LLM Systems Adversarial Attacks on LLMs
Electrical and Computer Engineering University of Maine, ME, USA
Behind EvoMap: Characterizing a Self-Evolving Agent-to-Agent Collaboration Network
May 25, 2026Qiming Ye, Peixain Zhang, Yupeng He +2AI Agent Evaluation Multi-Agent Collaboration
The Hong Kong University of Science and Technology (Guangzhou) China
When Agents Control Robots: A Zero Trust Policy Model for Agentic Cyber-Physical Systems
May 25, 2026Tharindu Ranathunga, Kavishka Fernando, Susan ReaRobotic Control Cyber-Physical Systems
Nimbus Centre, Munster Technological University, Cork, Ireland
Security of OpenClaw Agents: Fundamentals, Attacks, and Countermeasures
May 25, 2026Yuntao Wang, Jianle Ba, Han Liu +5AI Agent Security LLM Agent Security
School of Cyber Science and Engineering, Xi’an Jiaotong University, Xi’an, China
Evo-Attacker: Memory-Augmented Reinforcement Learning for Long-Horizon Tool Attacks on LLM-MAS
May 25, 2026Bingyu Yan, Xiaoming Zhang, Jinyu Hou +4Adversarial Attacks on LLMs LLM Agent Security
1Beihang University · 2Beijing University of Posts and Telecommunications · 3China Academy of Information and Communications Technology
KYA: A Framework-Agnostic Trust Layer for Autonomous Systems with Verifiable Provenance and Hierarchical Policy Composition
May 25, 2026Kolawole QuadriAI Agent Security AI Agent Governance
Veldt Labs USA
When Agents Talk: Discourse, Manipulation, and Risk in an Agentic Social Network
May 20, 202610a Labs, :, Grace Cheong +22AI Agent Security Multi-Agent System Security
10a Labs1
Heartbeat-Bound Hierarchical Credentials: Cryptographic Revocation for AI Agent Swarms
May 20, 2026Saurabh DeochakeAI Agent Security LLM Agent Security
SentinelOne Inc. Mountain View, USA
CASPIAN: Online Detection and Attribution of Cascade Attacks in LLM Multi-Agent Systems via Cross-Channel Causal Monitoring
May 19, 2026Kavana Venkatesh, Jafar Isbarov, Saad Amin +2Causal Attribution AI Agent Monitoring
Virginia Tech, Blacksburg, VA
The Capability Paradox: How Smarter Auditors Make Multi-Agent Systems Less Secure
May 17, 2026Qiqi Liu, Thorsten Holz, Shilin Ye +1Multi-Agent LLM Systems Multi-Agent System Security
University of Chinese Academy of Sciences · Max Planck Institute for Security and Privacy · Henan Yinzhu Safety Technology Co., Ltd. +1
Propagating Unsafe Actions in LLM Controlled Multi-Robot Collaboration via Single Robot Compromise
May 15, 2026Zhen Huang, Zhihuang Liu, Mengxuan Luo +2Large Language Model-Based Robot Planning Adversarial Attacks on LLMs
College of Computer Science and Technology, National University of Defense Technology
Auditing Agent Harness Safety
May 14, 2026Chengzhi Liu, Yichen Guo, Yepeng Liu +8AI Agent Auditing LLM Auditing
University of California, Santa Barbara · University of California, Berkeley · Microsoft Research +2
Hierarchical Attacks for Multi-Modal Multi-Agent Reasoning
May 13, 2026Hao Zhou, Tiru Wu, Yan Jiang +3Multimodal Robustness Adversarial Attacks
Finding the Weakest Link: Adversarial Attack against Multi-Agent Communications
May 13, 2026Maxwell Standen, Junae Kim, Claudia SzaboAdversarial Attacks Adversarial Perturbations
The University of Adelaide · DST Group
Moltbook Moderation: Uncovering Hidden Intent Through Multi-Turn Dialogue
May 13, 2026Ali Al-Lawati, Nafis Tripto, Abolfazl Ansari +3Markov Chain Monte Carlo Intent Classification
The Pennsylvania State University, USA
The Misattribution Gap: When Memory Poisoning Looks Like Model Failure in Agentic AI Systems
May 12, 2026Tanzim Ahad, Ismail Hossain, Md Jahangir Alam +3AI Agent Security Benchmarks Agent Memory Poisoning
Department of Computer Science, University of Texas at El Paso, TX, USA 79902 · School of Computing, Southern Illinois University Carbondale, IL, USA 62901 · University of Illinois Urbana-Champaign, IL, USA
Control Charts for Multi-agent Systems
May 11, 2026Hayden Helm, Carey Priebe, Brandon DuderstadtMulti-Agent Systems Multi-Agent System Security
Helivan · Johns Hopkins University · Calcifer Computing
Agent Collectives Should Not Detect Their Own Imposters: A Chess Case Study
May 9, 2026Alexandre Le Mercier, Chris Develder, Thomas DemeesterAI Agent Security AI Agent Security Benchmarks
IDLab–T2K, Ghent University–imec
When Child Inherits: Modeling and Exploiting Subagent Spawn in Multi-Agent Networks
May 8, 2026Ziwen Cai, Yihe Zhang, Xiali HeiLLM Agent Security Multi-Agent System Security
University of Louisiana at Lafayette Lafayette, USA
PropGuard: Safeguarding LLM-MAS via Propagation-Aware Exploration and Remediation
May 8, 2026Bingyu Yan, Xiaoming Zhang, Jinyu Hou +4LLM Agent Security Prompt Injection Attacks on AI Agents
Beihang University · Beijing University of Posts and Telecommunications · City University of Hong Kong

Jun 7, 2026, cs.GTJ/K move · Enter open · S save

A Note on the Strategic Confinement Problem

Christian Schroeder de Witt

University of Oxford

Multi-Agent System Security

Open paper AskPDF arXiv

Lampson's confinement problem asks how to prevent a program that processes confidential information from leaking it to a third party. We introduce the strategic confinement problem, which arises when the communicating parties are strategic agents with shared coordination resources. In this setting, residual communication capacity can be concentrated on low-entropy, high-impact predicates of the confidential data. Consequently, bounds on information leakage need not induce corresponding bounds on worst-case harm: a channel with negligible capacity may still suffice to select damaging outcomes. We argue that systems of learnt strategic agents naturally instantiate this problem because they do not admit complete behavioural specifications, their learnt conventions generally cannot be predicted or reproduced by an external observer, and sufficiently capable agents can construct covert communication schemes that are difficult to detect or eliminate. Our contribution is therefore not a new theory of communication, but a reinterpretation of confinement in the presence of strategic agents. Classical confinement bounds what information may flow; strategic confinement highlights that this need not bound what strategic agents can jointly achieve.

Momentum

Related topics

Latest papers 112