cs.LGAug 14, 2026

Federated Prompt Learning: A Unified Framework, Empirical Analysis, and Future Directions

Authors: Qinglin Yang, Chen Qiu, Hongyuan Zhang, Pengdeng Li, Yuan Liu, Zhihong Tian

Organizations: Cyberspace Institute of Advanced Technology, Guangzhou University; Guangdong Key Laboratory of Industrial Control System Security; Huangpu Research School of Guangzhou University, Guangzhou, Guangdong, China · Iwate Biotechnology Research Center, Iwate, Japan · Nanjing University of Posts and Telecommunications, Nanjing, Jiangsu, China

Abstract

Large language models (LLMs) have become core components of cloud-based intelligent services in academia and industry, yet their training and deployment are hindered by high computational costs, data centralization, and privacy concerns. Federated learning (FL) offers a decentralized training paradigm that enables clients to collaboratively train a learning model without sharing raw data, making it a promising solution for privacy-preserving LLM training and reasoning. This paper presents a comprehensive survey of federated prompt learning (FPL) to review recent advances in integrating the federated learning paradigm and large language models, answering the following research questions: RQ1: The fundamental motivations, characteristics, and enabling technologies of FPL, and how it differs from conventional FL and full-model federated fine-tuning; RQ2: The trade-offs FPL approaches exhibit in performance, communication efficiency, computational overhead, scalability, personalization, and heterogeneity handling; RQ3: The remaining security, privacy, robustness, and system challenges, along with key future research directions. To this end, we systematically examine existing FPL methods across the full model lifecycle: pre-training, fine-tuning, and practical applications, while discussing security, privacy, and robustness issues and summarizing existing defense mechanisms. Finally, we highlight open challenges and future directions, aiming to help readers understand how the insights drive research in FPL.

Figures & tables

Explore similar work

CardsList
  1. Privacy-Preserving Split Learning for Federated LLM Fine-Tuning

    Sep 9, 2026Heng Jin, Chaoyu Zhang, Hexuan Yu +2Privacy-Preserving Language ModelsSplit Federated Learning

  2. FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion

    Apr 21, 2026Tao Fan, Guoqiang Ma, Yuanfeng Song +3Privacy-Preserving Language ModelsLLM Fine-Tuning

  3. FedPDPO: Federated Personalized Direct Preference Optimization for Large Language Model Alignment

    Mar 20, 2026Kewen Zhu, Liping Yi, Zhiming Zhao +3Personalized Language Model AlignmentDirect Preference Optimization