Multi-Agent LLM Systems

LLM: Large Language Model

Overview

Multi-agent large language model systems study how multiple language-model agents can divide work, share information, and combine decisions on tasks such as reasoning, coding, research, and planning. Common designs use specialized roles, debate or review loops, retrieval-augmented generation, shared memory, and orchestrators that route tasks or choose communication links; some systems also learn prompts, workflows, or policies through reinforcement learning. Researchers evaluate these approaches on benchmarks for math, question answering, software, and tool use, as well as in longer-running simulations and domain applications. A central open tension is that collaboration can improve accuracy and verification, but may also add latency and token costs or spread errors, bias, and unsafe instructions, so gains depend on the task, architecture, and quality of coordination.

Latest papers

CardsList

1,119 papers91 papers in the last four weeks, down 35% on the four weeks before. 0.7% of all new papers.

  1. StackPlanner: A Centralized Hierarchical Multi-Agent System with Task-Experience Memory Management

    Jan 9, 2026Ruizhe Zhang, Xinke Jiang, Zhibang Yang +12Multi-Agent LLM SystemsMulti-Agent Collaboration

  2. An Agentic AI System for Multi-Framework Communication Coding

    Dec 9, 2025Bohao Yang, Rui Yang, Joshua M. Biro +14HealthcareClinical Information Extraction

  3. MAS-Shield: A Defense Framework for Secure and Efficient LLM MAS

    Nov 28, 2025Kaixiang Wang, Zhaojiacheng Zhou, Bunyod Suvonov +8Multi-Agent LLM SystemsLLM Auditing

  4. A Layered Protocol Architecture for the Internet of Agents

    Nov 24, 2025Charles Fleming, Luca Muscariello, Vijoy Pandey +1Agent Communication ProtocolsAI Agent Interoperability

  5. MASTEST: A LLM-Based Multi-Agent System For Testing RESTful APIs

    Nov 22, 2025Xiaoke Han, Hong ZhuMulti-Agent LLM SystemsAutomated Software Testing

  6. Multi-agent Undercover Gaming: Hallucination Removal via Counterfactual Test for Multimodal Reasoning

    Nov 14, 2025Dayong Liang, Xiao-Yong Wei, Linhui Xiao +1Multi-Agent LLM SystemsMultimodal Reasoning

  7. Who Gets the Reward & Who Gets the Blame? Evaluation-Aligned Training Signals for Multi-LLM Agents

    Nov 11, 2025Chih-Hsuan, Yang, Tanwi Mallick +5Multi-Agent LLM SystemsCooperative Game Theory

  8. Designing LLM-based Multi-Agent Systems for Software Engineering Tasks: Quality Attributes, Design Patterns and Rationale

    Nov 11, 2025Yangxiao Cai, Ruiyin Li, Peng Liang +4Multi-Agent LLM SystemsSoftware Engineering Agents

  9. Communication and Verification in LLM Agents towards Collaboration under Information Asymmetry

    Oct 29, 2025Run Peng, Ziqiao Ma, Amy Pang +5Multi-Agent LLM SystemsLLM Agent Verification

  10. MASPRM: Multi-Agent System Process Reward Model

    Oct 28, 2025Milad Yazdani, Mahdi Mostajabdaveh, Zirui Zhou +1Multi-Agent LLM SystemsInference-Time Search

  11. Ax-Prover: A Deep Reasoning Agentic Framework for Theorem Proving in Mathematics and Quantum Physics

    Oct 14, 2025Benjamin Breen, Marco Del Tredici, Jacob McCarran +6Automated Theorem ProvingLarge Language Model-Guided Theorem Proving

  12. Multi-Agent Design Assistant for the Simulation of Inertial Fusion Energy

    Oct 2, 2025Meir H. Shachar, Dane M. Sterbentz, Harshitha Menon +10Multiphysics SimulationMulti-Agent LLM Systems

  13. Sentinel Agents for Secure and Trustworthy Agentic AI in Multi-Agent Systems

    Sep 18, 2025Diego Gosmar, Deborah A. DahlLLM Agent SecurityAI Agent Monitoring

  14. Towards using Large Language Models for Risk Negotiation and Consensus-building in One Health contexts

    Sep 12, 2025Alexandra Fetsch, Iurii Savvateev, Racem Ben Romdhane +12Multi-Agent NegotiationAutomated Negotiation

  15. RCR-Router: Efficient Role-Aware Context Routing for Multi-Agent LLM Systems with Structured Memory

    Aug 6, 2025Jun Liu, Zhenglun Kong, Changdi Yang +12LLM Context ManagementMulti-Agent LLM Systems

  16. MASCA: LLM based-Multi Agents System for Credit Assessment

    Jul 30, 2025Gautam Jajoo, Atharva Pandey, Pranjal A Chitale +1Financial ServicesMulti-Agent LLM Systems

  17. Building verifiable databases at scale from the chemical literature via a multi-agent system

    Jul 27, 2025Yufan Chen, Ching Ting Leung, Bowen Yu +6Document Information ExtractionMulti-Agent LLM Systems

  18. DrugMCTS: a drug repurposing framework combining multi-agent, RAG and Monte Carlo Tree Search

    Jul 10, 2025Zerui Yang, Yuwei Wan, Siyu Yan +3Drug DiscoveryAgentic RAG

  19. A Mathematical Theory of Discursive Networks

    Jul 9, 2025Juan B. GutiérrezLLM ReliabilityMulti-Agent LLM Systems

  20. SheetMind: Actions Set Accuracy, Agents Set the Failure Mode

    Jun 14, 2025Lyuhao Chen, Xi Cheng, Yanming Kang +11Multi-Agent LLM SystemsLLM Agent Evaluation

  21. Seven Security Challenges in Cross-domain Multi-agent LLM Systems

    May 28, 2025Ronny Ko, Jiseong Jeong, Shuyuan Zheng +4Multi-Agent LLM SystemsLLM Agent Security

  22. Divide by Question, Conquer by Agent: SPLIT-RAG with Question-Driven Graph Partitioning

    May 20, 2025Ruiyi Yang, Hao Xue, Imran Razzak +3Multi-Hop QAMulti-Agent LLM Systems

  23. Prompt Stability Matters: Evaluating and Optimizing Auto-Generated Prompt in General-Purpose Systems

    May 19, 2025Ke Chen, Xucheng Yu, Yufei Zhou +1LLM PromptingAutomatic Prompt Optimization