cs.MAAug 27, 2026

Risks and Controls for Multi-Agent Systems: an analytical framework for deployment of AI agents across organisational boundaries

Authors: Alistair Reid, Simon O'Callaghan, Dustin Venini, Liam Carroll, Tiberio Caetano

Organizations: Gradient Institute for the Department of Industry, Science and Resources

Abstract

This report presents a framework to help organisations, policymakers and researchers reason about the risks that emerge when AI agents interact with each other, how those risks change as interactions cross organisational boundaries, and the controls that may help address them. As organisations deploy AI agents, those agents will increasingly interact with each other: inside the organisation, with the agents of partners, customers and suppliers, and with unknown counterparties on the open internet. Failures can emerge from the interactions themselves, and once those interactions cross an organisation's perimeter, no single organisation can fully see, control or govern them. The report introduces three deployment tiers, defined by the minimum common governance binding any two interacting agents: singular governance, where one organisation governs every agent; federated governance, where multiple organisations deploy into a shared environment under agreed rules; and open environments, where agents operate with no central authority and shared standards are adopted voluntarily if at all. Within each tier, the report examines risk factors, failure modes and available controls. It identifies who is positioned to apply the controls, and where no actor is positioned to act, it characterises the gap and the collective action required to close it.

Explore similar work

CardsList
  1. The CASE Framework: A Multi-Disciplinary Control Architecture for Governing Enterprise Agentic AI

    Aug 10, 2026Srinivas Telukunta, Georgios Nektarios Lilis, Lucio BaronAI Agent EvaluationAI Agent Governance

  2. The Three-Ring Architecture: Governing Agents in the Era of On-Platform Organisations

    Jun 5, 2026Sergio Alvarez-Telena, Marta Diez-FernandezAI Risk ManagementLLM Agent Orchestration

  3. Emergent Risks in Generative Multi-Agent Systems

    Mar 29, 2026Yue Huang, Yu Jiang, Wenjie Wang +12Multi-Agent LLM SystemsMulti-Agent Systems