Overview

Multi-LLM collaboration studies how multiple language models can work together, and when their combined capabilities are more useful than a single model’s. Common approaches assign agents different roles, route difficult questions to stronger or specialized models, and combine answers through voting, verification, debate, or iterative refinement; some systems also exchange hidden states instead of text. Researchers evaluate these methods on reasoning, coding, question answering, long-horizon tasks, and specialized settings such as medicine, while developing ways to select complementary teammates and measure their contribution. A central tension is that collaboration can improve accuracy or lower cost, but communication and coordination add overhead and can amplify errors, agreement, or adversarial influence; reliable gains depend on the task, team, and quality of information exchange.

Latest papers

CardsList

92 papers7 papers in the last four weeks, down 65% on the four weeks before. 0.1% of all new papers.

  1. A Survey on Collaborative Mechanisms Between Large and Small Language Models

    May 12, 2025Yi Chen, Haiquan Wang, JiaHao Zhao +1Small Language ModelsMulti-LLM Collaboration

  2. Towards Harnessing the Collaborative Power of Large and Small Models for Domain Tasks

    Apr 24, 2025Yang Liu, Kejia Zhang, Bingjie Yan +11Privacy-Preserving Language ModelsLLM Fine-Tuning