Multi-Agent LLM Systems

LLM: Large Language Model

Overview

Multi-agent large language model systems study how multiple language-model agents can divide work, share information, and combine decisions on tasks such as reasoning, coding, research, and planning. Common designs use specialized roles, debate or review loops, retrieval-augmented generation, shared memory, and orchestrators that route tasks or choose communication links; some systems also learn prompts, workflows, or policies through reinforcement learning. Researchers evaluate these approaches on benchmarks for math, question answering, software, and tool use, as well as in longer-running simulations and domain applications. A central open tension is that collaboration can improve accuracy and verification, but may also add latency and token costs or spread errors, bias, and unsafe instructions, so gains depend on the task, architecture, and quality of coordination.

Latest papers

CardsList

1,050 papers142 papers in the last four weeks, up 35% on the four weeks before. 0.8% of all new papers.

  1. Auditing Cascading Risks in Multi-Agent Systems via Semantic-Geometric Co-evolution

    Mar 4, 2026Zixun Luo, Yuhang Fan, Hengyu Lin +2Ollivier-Ricci CurvatureMulti-Agent LLM Systems

  2. From Spark to Fire: Modeling and Mitigating Error Cascades in LLM-Based Multi-Agent Collaboration

    Mar 4, 2026Yizhe Xie, Congcong Zhu, Xinyue Zhang +5Multi-Agent LLM SystemsMulti-Agent Systems

  3. MACC: Multi-Agent Collaborative Competition for Scientific Exploration

    Mar 4, 2026Satoshi Oyama, Yuko Sakurai, Hisashi KashimaMulti-Agent LLM SystemsAI Agents for Scientific Discovery

  4. Learning to Generate and Extract: A Multi-Agent Collaboration Framework For Zero-shot Document-level Event Arguments Extraction

    Mar 3, 2026Guangjun Zhang, Hu Zhang, Yazhou Han +4Document Information ExtractionZero-Shot Learning

  5. MASPOB: Bandit-Based Prompt Optimization for Multi-Agent Systems with Graph Neural Networks

    Mar 3, 2026Zhi Hong, Qian Zhang, Jiahang Sun +5Multi-Agent LLM SystemsMulti-Agent System Optimization

  6. Exploring Plan Space through Conversation: An Agentic Framework for LLM-Mediated Explanations in Planning

    Mar 2, 2026Guilhem Fouilhé, Rebecca Eifler, Antonin Poché +2Multi-Agent LLM SystemsExplainable Artificial Intelligence

  7. Demonstrating ViviDoc: Generating Interactive Documents through Human-Agent Collaboration

    Mar 2, 2026Yinghao Tang, Yupeng Xie, Yingchaojie Feng +2Human-AI CollaborationGenerative AI in Education

  8. CeProAgents: A Hierarchical Agents System for Automated Chemical Process Development

    Mar 2, 2026Yuhang Yang, Ruikang Li, Jifei Ma +8Multi-Agent LLM SystemsLLM Agent Orchestration

  9. SciDER: Scientific Data-centric End-to-end Researcher

    Mar 2, 2026Ke Lin, Owais Aijaz, Yilin Lu +3AI Agents for Scientific DiscoveryScientific Workflow Automation

  10. MedCollab: IBIS-Guided Multi-Agent Collaboration with Hierarchical Disease Relation Chains for Clinical Diagnosis

    Mar 1, 2026Yuqi Zhan, Xinyue Wu, Tianyu Lin +6Multi-Agent LLM SystemsMedical Report Generation

  11. HVR-Met: A Hypothesis-Verification-Replanning Agentic System for Extreme Weather Diagnosis

    Mar 1, 2026Shuo Tang, Jiadong Zhang, Gengxian Zhou +11Multi-Agent LLM SystemsAI Agent Benchmarks

  12. CARD: Towards Conditional Design of Multi-agent Topological Structures

    Mar 1, 2026Tongtong Wu, Yanming Li, Ziye Tang +5Multi-Agent LLM SystemsMulti-Agent Communication

  13. Silo-Bench: A Scalable Environment for Evaluating Distributed Coordination in Multi-Agent LLM Systems

    Mar 1, 2026Yuzhe Zhang, Feiran Liu, Yi Shan +8Multi-Agent LLM SystemsMulti-Agent Coordination

  14. TraceSIR: A Multi-Agent Framework for Structured Analysis and Reporting of Agentic Execution Traces

    Feb 28, 2026Shu-Xun Yang, Cunxiang Wang, Haoke Zhang +12Agent Failure AnalysisReasoning Trace Analysis

  15. A Novel Hierarchical Multi-Agent System for Payments Using LLMs

    Feb 27, 2026Joon Kiat Chua, Donghao Huang, Zhaoxia WangMulti-Agent LLM SystemsMulti-Agent Systems

  16. ProductResearch: Training E-Commerce Deep Research Agents via Multi-Agent Synthetic Trajectory Distillation

    Feb 27, 2026Jiangyuan Wang, Kejun Xiao, Huaipeng Zhao +2LLM Agent TrainingLLM Agent Trajectory Synthesis

  17. From Flat Logs to Causal Graphs: Hierarchical Failure Attribution for LLM-based Multi-Agent Systems

    Feb 27, 2026Yawen Wang, Wenjie Wu, Junjie Wang +1Agent Failure AnalysisMulti-Agent LLM Systems

  18. Toward Expert Investment Teams:A Multi-Agent LLM System with Fine-Grained Trading Tasks

    Feb 26, 2026Kunihiro Miyazaki, Takanobu Kawahara, Stephen Roberts +1Multi-Agent LLM SystemsAlgorithmic Trading

  19. Three AI-agents walk into a bar . . . . `Lord of the Flies' tribalism emerges among smart AI-Agents

    Feb 26, 2026Dhwanil M. Mori, Neil F. JohnsonMulti-Agent Resource AllocationEmergent Behavior in Multi-Agent Systems

  20. Cognitive Models and AI Algorithms Provide Templates for Designing Language Agents

    Feb 26, 2026Ryan Liu, Dilip Arumugam, Cedegao E. Zhang +3LLM AgentsMulti-Agent LLM Systems

  21. Hierarchical LLM-Based Multi-Agent Framework with Prompt Optimization for Multi-Robot Task Planning

    Feb 25, 2026Tomoya Kawabe, Rin TakanoLarge Language Model-Based Robot PlanningMulti-Agent LLM Systems

  22. Power and Limitations of Aggregation in Compound AI Systems

    Feb 25, 2026Nivasini Ananthakrishnan, Meena JagadeesanMulti-Agent LLM SystemsPrincipal-Agent Theory

  23. An Agentic System for Schema Aware NL2SQL Generation

    Feb 25, 2026David Onyango, Naseef MansoorText-to-SQLCost-Aware Inference

  24. Pancake: Hierarchical Memory System for Multi-Agent LLM Serving

    Feb 25, 2026Zhengding Hu, Zaifeng Pan, Prabhleen Kaur +6Memory Management for LLM AgentsAgent Memory Management