Multi-Agent System Security

Overview

Multi-agent system security examines how agents can attack, mislead, or compromise one another, and how local failures can spread through communication, shared memory, delegated tools, or coordinated decisions. Work studies threats such as prompt injection, collusion, Byzantine behavior, memory poisoning, information leakage, and cascading errors, using settings from language-model workflows and debate to multi-agent reinforcement learning and robot swarms. Defenses include trust and reputation systems, provenance and authorization controls, runtime monitoring, semantic information-flow checks, and cryptographic protocols; benchmarks increasingly test different architectures, interaction paths, and long-horizon tasks. A central challenge is that safeguards effective for individual agents may not compose at system level, while stronger controls can reduce task performance or miss attacks that emerge only through multi-agent interaction.

Latest papers

CardsList

197 papers21 papers in the last four weeks, down 32% on the four weeks before. 0.2% of all new papers.

  1. Kaer: Security-Aware Replanning for Multi-Agent Systems

    Nov 18, 2026Tushin Mallick, Evan Rose, Matthew Laws +2Multi-Agent System SecurityDynamic Replanning

  2. Guarded Swarms in the Loop: A ROS 2/PX4 Digital Twin for Hybrid Digital-Analog Coordination of UAV/UGV Swarms

    Nov 17, 2026Uwe M. Borghoff, Paolo Bottoni, Luca D'Aurizio +1Swarm RoboticsRobot Safety

  3. Protecting the System, Stranding the User: The Limits of Multi-Agent Authorization

    Nov 14, 2026Gurpriya Bhatia, Clifford NeumanAI Agent SafetyAI Agent Governance

  4. Hardening Agentic Web Populations Through Multi-Criterion Competitive Co-Evolution: Lessons from Wargame Strategy Optimization

    Nov 14, 2026Shashank Raj, Kalyanmoy DebAI Agent SecurityAdversarial Attacks on LLMs

  5. Agent-ZTA: A chain-Aware Zero Trust Model for Bidirectional Security-State Propagation and Runtime Containment in Multi-Agent Delegation

    Nov 13, 2026Asadullah Abdullah Khan, Toqeer Ali SyedMulti-Agent System SecurityRuntime Enforcement for AI Agents

  6. Securing Multi-Agent Systems by Design

    Nov 13, 2026Xilong Wang, Xiaoxing Chen, Neil GongMulti-Agent System SecurityMulti-Agent Systems

  7. Only as Safe as the Weakest Agent: A Break That Appears Only When the System Is Multi-Agent

    Nov 12, 2026Keegan Wang, Anantika MannbyLLM Agent SafetyLLM Agent Security

  8. On Private Knowledge Retrieval and Private Inference for secure multi-agent systems

    Nov 10, 2026Vicenç Torra, Maria Bras-AmorósPrivacy Protection for LLM AgentsMulti-Agent System Security

  9. What Do Collusion Probes Read? Three Pitfalls in Evaluating Multi-Agent Collusion Monitors

    Nov 7, 2026Mainul Hasan Mohsin, Mohammad Shahidur RahmanAI Agent MonitoringMulti-Agent System Security

  10. From Emergence to Reversibility

    Nov 6, 2026Zhengye Han, Linda Ng BoyleMulti-Agent SystemsMulti-Agent Governance

  11. Signed but Not Safe: Requirement Integrity in Multi-Agent LLM Handoffs

    Nov 5, 2026Xiaobo Chen, Genliang Zhu, Ziyuan Wang +1Multi-Agent System SecurityRuntime Verification for AI Agents

  12. Authorization Propagation in Agent2Agent Systems: An Experimental Security Evaluation of Multi-Hop Delegation

    Nov 4, 2026Gabriele Donno, Kashif Mehmood, Katina KralevskaMulti-Agent System SecurityAI Agent Security

  13. Airlock: Bounding the Multi-Agent Blast Radius via Selective Online Containment

    Nov 4, 2026Zhonghao Zhan, Javad Forough, Yefan Zhang +3AI Agent SafetyMulti-Agent Systems

  14. Multi-Agent Collusion and the J-Space

    Nov 1, 2026Marco Molinari, Gabriele BettineschiMulti-Agent System SecurityMulti-Agent LLMs

  15. Illusion: Safeguarding Topology Confidentiality in LLM Multi-Agent Systems via Behavior-Preserving Obfuscation

    Oct 31, 2026Yiu-Fai Cheung, Hongzhi Guo, Miao Pan +2Multi-Agent System SecurityMulti-Agent Communication Topology

  16. Who Else Is In? Multi-Agent Collusion Initation Via Strategic Vagueness

    Oct 27, 2026Pramod Kaushik, Sarath Sivaprasad, Laura Ferrarotti +4Multi-Agent System SecurityMulti-Agent LLM Systems

  17. Securing Edge & Physical AI: Post-Quantum IoT Blockchain for Mission-Critical Cyber-Physical Agents

    Oct 24, 2026Kürşat Çakal, Suat ÖzdemirCPS SecurityMulti-Agent System Security

  18. Secure Agentic AI and Multimodal Intelligence in 6G Communication Systems

    Oct 21, 2026Satyam Gaba, Devanshu Motwani, Siva Sai +3AI Agent SecurityMultimodal Agents

  19. Black-Box Red-Teaming of Multi-Agent Systems via Reinforcement Learning

    Oct 20, 2026Yuqi Jia, Hangsheng Zhang, Chenxi Liu +2LLM Red TeamingBlack-Box Adversarial Attacks

  20. The Show-Up Attack: When Subagents Win Over Their Supervisor

    Oct 20, 2026Maosen Zhang, Jianshuo Dong, Yutong Zhang +3LLM Agent SecurityMulti-Agent System Security

  21. Vulnerability Analysis for Safe Multi-Agent Reinforcement Learning

    Oct 19, 2026Taozheng Zhu, Shixiong Jiang, Fanxin KongSafe MARLAdversarial Attacks

  22. Red-Teaming Multi-Agent Attacks for Loss-of-Control Risks

    Oct 16, 2026John Kitaoka, Thao Amelia Pham, Carlos Rafael Giudice +1AI Agent SafetyMulti-Agent System Security

  23. Cryptographically Secure Agent-to-Agent Communication in Multi-Agent Systems

    Oct 16, 2026Karol Budzyn, Adrian Brodzik, Mateusz SzczepkowskiMulti-Agent System SecurityMulti-Agent Communication

  24. StepSafe: Learning Timely Intervention with Context-Aware Safety Reasoning

    Oct 14, 2026Siyi Gu, Kunhan Gao, Chao Peter Yang +3AI Agent SafetyLLM Agent Safety

  25. Agent-Canary-Mas: End-to-End Evaluation of Protocol Risk in Long-Horizon Multi-Agent Systems

    Oct 11, 2026Xiuming Liu, Le Gai, Zhiyuan Chang +4Multi-Agent System SecurityAI Agent Security Benchmarks

  26. Where Rules End and Judges Begin: Measuring the Judgment Boundary in Multi-Agent Systems Security

    Oct 6, 2026Shaswata Mitra, Raj Patel, Subash Neupane +3Multi-Agent LLM SystemsMulti-Agent System Security