Overview

Multi-LLM collaboration studies how multiple language models can work together, and when their combined capabilities are more useful than a single model’s. Common approaches assign agents different roles, route difficult questions to stronger or specialized models, and combine answers through voting, verification, debate, or iterative refinement; some systems also exchange hidden states instead of text. Researchers evaluate these methods on reasoning, coding, question answering, long-horizon tasks, and specialized settings such as medicine, while developing ways to select complementary teammates and measure their contribution. A central tension is that collaboration can improve accuracy or lower cost, but communication and coordination add overhead and can amplify errors, agreement, or adversarial influence; reliable gains depend on the task, team, and quality of information exchange.

Latest papers

CardsList

92 papers7 papers in the last four weeks, down 65% on the four weeks before. 0.1% of all new papers.

  1. Coordinated Use of Large Language Models in Academic Research

    Nov 19, 2026Vladislav MarinovMulti-LLM CollaborationLLM Reliability

  2. Latent Bridge: Asking for Help Without Words

    Nov 16, 2026Qichao Wang, Tingyu Qu, Pengcheng Wu +5Multi-LLM CollaborationLLM Inference Acceleration

  3. RE-PRESENT: Evidence Triangulation across Alternative Candidate-Space Views for Efficient LLM Ensemble Inference

    Nov 10, 2026Juming Xiong, Weixin Liu, Kevin Guo +7Language Model EnsemblesMulti-LLM Collaboration

  4. On the Opportunities and Challenges of Prefill-to-Autoregressive Cross-Model Transfer

    Nov 4, 2026Zhenyi Shen, Junru Lu, Wei Liu +8Multi-LLM CollaborationTransfer Learning

  5. Planning-Coding Separation in LLM-Based Code Generation: An Empirical Study

    Nov 3, 2026Wentao Wang, Zeyu Sun, Ruwei Pan +3Code GenerationLLM Code Generation

  6. J-Comm: Jacobian-Guided Latent Communication between LLM Agents

    Oct 23, 2026Xiangwei Wang, Wei Wang, Sachith Seneviratne +4Multi-Agent CommunicationMulti-LLM Collaboration

  7. The Butterfly Defects: Tracing Cooperation in LLM Agent Networks

    Oct 23, 2026Maria Sampani, Maria Lymperaiou, Angeliki Dimitriou +3Multi-LLM CollaborationMulti-Agent Coordination

  8. Learning Who Talks to Whom: Role-Aware Communication Topology Scheduling for Efficient LLM Multi-Agent Collaboration

    Oct 19, 2026Haibin Li, Wenya Yu, Xuefeng Jiang +4Multi-Agent Communication TopologyMulti-Agent LLMs

  9. Does Unlearning Survive Collaboration? Robust Unlearning for Shared-Model LLM Teams

    Oct 19, 2026Hengsong Liu, Liangyu Teng, Jingnan Cai +5LLM UnlearningMachine Unlearning Evaluation

  10. The Weight of Teamwork: Does Communication Structure Help LLM Scientists Search for Scientific Laws?

    Oct 16, 2026Jianing Shi, Zaibin Zhang, Shijun Lei +1Multi-LLM CollaborationMulti-Agent Communication

  11. Cooperation Without Adaptation: LLM Agents in a Collective-Risk Dilemma

    Oct 16, 2026Trung-Kiet Huynh, Dao-Sy Duy-Minh, Chi-Nguyen Tran +4Multi-Agent LLM SystemsStrategic Reasoning Risks in Language Models

  12. New Model, Old Habits: Behavior Transfer under Model Swapping in Multi-Session LLM Agents

    Oct 14, 2026Youngbin Choi, Sehyun Hwang, Suhyeon Jun +4LLM AgentsMulti-LLM Collaboration

  13. Share the Symbol, Not the Vector: Training-Free Fact Communication Across Language Models

    Oct 14, 2026Xin Li, Mengbing Liu, Hao Jiang +5Multi-LLM CollaborationMulti-Agent LLM Systems

  14. Training LLMs for Multi-Agent Collaboration with Verifiable Information Rewards

    Oct 13, 2026Keru Chen, Sen Lin, Yingbin Liang +2LLM Agent TrainingMulti-Agent Collaboration

  15. Compositional RL: Evaluating and Training LLMs for Collaborative Reasoning

    Oct 12, 2026Shangbin Feng, Yulia Tsvetkov, Jan Kautz +1Multi-LLM CollaborationRL for Language Models

  16. Collaborative Learning and Reasoning over Model Slices

    Oct 9, 2026Yuheng Wang, Runde Yang, Zhuohan Bao +9Multi-LLM CollaborationMulti-Agent Reasoning

  17. Verifier-Mediated Multi-LLM Coordination for Multi-Robot Path Planning

    Oct 8, 2026Vivek Khatana, Zijian Song, Naira Hovakimyan +1Multi-Robot CoordinationLarge Language Model-Based Robot Planning

  18. Sibyl: An Efficient Small-large Model Collaboration Framework for Long-horizon Tasks

    Oct 4, 2026Zhewei Fang, Yuxin Zhang, Zhenwei Shao +8LLM Agent TrainingLong-Horizon LLM Agents

  19. Learning to Ask: Information Acquisition for SLM-LLM Collaboration, under a budget

    Oct 1, 2026Yongjun Kim, Xiaoxiao Li, Jaeho LeeRL for Language Model ReasoningEfficient Language Model Reasoning

  20. Multi-LLM Collaborative Alignment via Stackelberg Games

    Sep 30, 2026Christina Hahn, Shangbin Feng, Dean Light +3RL for Language ModelsLLM Alignment

  21. You're Hired: Strategic Model Selection for LLM Collaboration

    Sep 30, 2026Zongwan Cao, Ziyuan Yang, Shangbin Feng +5Multi-Agent LLM SystemsMulti-LLM Collaboration

  22. Which Models Work Well Together? Measuring Heterogeneity for LLM Team Selection

    Sep 29, 2026Liangyu Teng, Hengsong Liu, Juncen Guo +4Language Model EnsemblesEnsemble Diversity

  23. Draft-KV: Learning Useful Latent Communication Between Language Models

    Sep 28, 2026Linquan Wu, Shichang Meng, Tianxiang Jiang +7Knowledge Augmentation for Language ModelsMulti-LLM Collaboration

  24. One Model Is Not a Crowd: Multi-LLM and Aspect-Conditioned Diverse Comment Generation

    Sep 27, 2026Nafis Irtiza Tripto, Delvin Ce Zhang, Mahjabin Nahar +1LLM EvaluationControllable Text Generation

  25. MedRouter: Demystifying Knowledge Differences Across Medical LLMs for Routing-Based Reasoning

    Sep 27, 2026Lang Cao, Binghang Lu, Yuhao Shen +1LLM RoutingMedical QA

  26. Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

    Sep 26, 2026Vincent-Daniel Yun, Woosang Lim, Haneul Yoo +3Multi-Agent LLM SystemsLLM Inference Acceleration