cs.AIMay 12, 2025

A Survey on Collaborative Mechanisms Between Large and Small Language Models

Authors: Yi Chen, Haiquan Wang, JiaHao Zhao, HaoHao Han

Organizations: Chengdu Institute of Computer Applications, Chinese Academy of Sciences, Chengdu, China · University of Chinese Academy of Sciences, Beijing, China

Abstract

Large Language Models (LLMs) deliver powerful AI capabilities but face deployment challenges due to high resource costs and latency, whereas Small Language Models (SLMs) offer efficiency and deployability at the cost of reduced performance. Collaboration between LLMs and SLMs emerges as a crucial paradigm to synergistically balance these trade-offs, enabling advanced AI applications, especially on resource-constrained edge devices. This survey provides a comprehensive overview of LLM-SLM collaboration, detailing various interaction mechanisms (pipeline, routing, auxiliary, distillation, fusion), key enabling technologies, and diverse application scenarios driven by on-device needs like low latency, privacy, personalization, and offline operation. While highlighting the significant potential for creating more efficient, adaptable, and accessible AI, we also discuss persistent challenges including system overhead, inter-model consistency, robust task allocation, evaluation complexity, and security/privacy concerns. Future directions point towards more intelligent adaptive frameworks, deeper model fusion, and expansion into multimodal and embodied AI, positioning LLM-SLM collaboration as a key driver for the next generation of practical and ubiquitous artificial intelligence.

Figures & tables

Explore similar work

CardsList
  1. Large Language Models over Networks: Collaborative Intelligence under Resource Constraints

    May 9, 2026Liangqi Yuan, Wenzhi Fang, Shiqiang Wang +2LLM Inference EfficiencyOn-Device Language Model Inference

  2. Local-First Intelligence via Proactive SLM Collaborating with Feedback-Providing LLM

    Apr 20, 2026Hang Zeng, Xiangyu Liu, Yong Hu +5LLM Inference EfficiencySmall Language Models