Multi-Agent LLM Systems
LLM: Large Language Model
Overview
Multi-agent large language model systems study how multiple language-model agents can divide work, share information, and combine decisions on tasks such as reasoning, coding, research, and planning. Common designs use specialized roles, debate or review loops, retrieval-augmented generation, shared memory, and orchestrators that route tasks or choose communication links; some systems also learn prompts, workflows, or policies through reinforcement learning. Researchers evaluate these approaches on benchmarks for math, question answering, software, and tool use, as well as in longer-running simulations and domain applications. A central open tension is that collaboration can improve accuracy and verification, but may also add latency and token costs or spread errors, bias, and unsafe instructions, so gains depend on the task, architecture, and quality of coordination.
Latest papers
1,119 papers91 papers in the last four weeks, down 35% on the four weeks before. 0.7% of all new papers.
MARFT: Multi-Agent Reinforcement Fine-Tuning
AgentDynEx: Nudging the Mechanics and Dynamics of Multi-Agent Simulations
Accelerating scientific discovery with Co-Scientist
Dynamic Optimizations of LLM Ensembles with Two-Stage Reinforcement Learning Agents
RL-Focal, a two-stage RL agent framework that routes and ensembles LLMs. First, we develop the Decider RL-agent, which learns to dynamically select an ensemble of small size () among LLMs () for incoming queries from a user-defined downstream task , by maximizing both error-diversity and reasoning-performance of the selected ensemble through iterative updates of task-adaptive rewards and policy. Second, to enable effective fusion of dynamically selected LLMs, we develop the stage-2 Fusion RL-agent, which learns to resolve reasoning conflicts from different LLMs and dynamically adapt to different ensemble teams composed by the Decider Agent for different downstream tasks. {\em Third}, we introduce the focal diversity metric to better model the error correlations among multiple LLMs further improving the generalization performance of the Decider Agent, which actively prunes the ensemble combinations. By focal diversity, we enhance performance across tasks by effectively promoting reward-aware and policy-adaptive ensemble selection and inference fusion. Extensive evaluations on five benchmarks show that RL-Focal achieves the performance improvement of 8.48% with an ensemble of small size compared to the best individual LLM in a pool and offers stronger robustness. Code is available here.