cs.MASep 29, 2026

PANDA: A Decentralized Architecture with Flexible Orchestration for Scalable, Fault-Tolerant Multi-Agent Systems

Authors: Matthew D. Laws, Cristina Nita-Rotaru

Organizations: Khoury College of Computer Sciences Northeastern University

Abstract

Existing architectures for LLM-based multi-agent systems (MAS) cannot reliably and efficiently solve multi-step tasks at scale: they struggle to support large numbers of agents and concurrent tasks, tolerate failures, govern agent interactions, and accommodate the diverse planning and execution patterns different tasks require. We present PANDA, a decentralized architecture that connects a large collective of heterogeneous, independently administered agents, letting them discover each other's capabilities and self-organize into small specialized teams per task. PANDA scales by decoupling collective communication from team communication, allowing agents to participate in multiple teams simultaneously, load-balancing tasks across the collective, and scheduling concurrent work within each agent. PANDA further separates the underlying architecture from the orchestration strategy, supporting three planning and execution patterns (star, chain, and mesh) that can be selected according to the structure and requirements of each task. PANDA detects infrastructure and orchestration failures and recovers affected tasks by dynamically replanning around failed components. Finally, to provide governance without a centralized service that would limit scalability, PANDA uses a web-of-trust model to constrain agent interactions to established trust relationships. We evaluate PANDA on the HotPotQA benchmark, demonstrating that it scales to thousands of agents, assembles teams in milliseconds, matches state-of-the-art accuracy at up to 8x the efficiency, and sustains 100% task completion under faults where existing systems fail.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. APWA: A Distributed Architecture for Parallelizable Agentic Workflows

    May 14, 2026Evan Rose, Tushin Mallick, Matthew D. Laws +2Multi-Agent WorkflowsAgentic Workflows

  2. CONCAT: Consensus- and Confidence-Driven Ad Hoc Teaming for Efficient LLM-Based Multi-Agent Systems

    May 28, 2026Ziyang Ma, Dingyi Zhang, Sichu Liang +4Mixture-Of-AgentsMulti-Agent Communication

  3. Fetch.ai: An Architecture for Modern Multi-Agent Systems

    Oct 21, 2025Michael J. Wooldridge, Attila Bagoly, Jonathan J. Ward +2Model-Based Multi-Agent SystemsDecentralized Autonomous Organization