Overview

Federated fine-tuning studies how multiple data holders can adapt a shared pretrained model while keeping examples local, enabling collaboration in healthcare, finance, language, vision, and edge settings. Common approaches include parameter-efficient methods such as LoRA, QLoRA, and prompt tuning; client-server aggregation or split learning; and distillation when model updates are costly or architectures differ. Since clients have different data, tasks, and hardware, methods use personalized adapters, clustering or task-aware routing, update alignment, and compression, often evaluated on non-IID language, vision, and multimodal benchmarks. Keeping raw data local does not prevent gradient leakage, membership inference, poisoning, or unequal outcomes for weaker clients; differential privacy and stronger security can reduce utility and add cost, making realistic measurements of communication, memory, energy, and latency important.

Latest papers

CardsList

128 papers12 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. FLoRG: Federated Fine-tuning with Low-rank Gram Matrices and Procrustes Alignment

    Feb 19, 2026Chuiyang Meng, Ming Tang, Vincent W. S. WongLLM Fine-TuningFederated Fine-Tuning

  2. Federated learning for unpaired multimodal data

    Jan 25, 2026Anders EklundCentered Kernel AlignmentMultimodal Federated Learning

  3. ELSA: Efficient LLM-Centric Split Aggregation for Privacy-Aware Hierarchical Federated Learning over the Network Edge

    Jan 20, 2026Xiaohong Yang, Tong Xie, Minghui Liwang +6Federated Fine-TuningFederated Learning

  4. Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning

    Jan 10, 2026Quan Minh Nguyen, Min-Seon Kim, Hoang M. Ngo +3Membership Inference AttacksFederated Fine-Tuning

  5. How (Mis)calibrated is your Federated CLIP and what to do about it?

    Dec 3, 2025Mainak Singha, Masih Aminbeidokhti, Paolo Casari +3Vision-Language ModelsVLM Adaptation

  6. FediLoRA: Practical Federated Fine-Tuning of Foundation Models Under Missing-Modality Constraints

    Sep 1, 2025Lishan Yang, Wei Emma Zhang, Nam Kha Nguygen +4Federated Fine-TuningFederated Learning Aggregation

  7. FlexP-SFT: A Flexible Aggregation-Free Framework for On-Device Personalized Split Federated Fine-Tuning of LLMs

    Aug 14, 2025Jiaxiang Geng, Tianjun Yuan, Pengchao Han +3Communication-Efficient Distributed TrainingLLM Fine-Tuning

  8. Efficient Collaborative LLM Fine-Tuning over Heterogeneous Mobile Devices via Many Backbones to One Side-Network Tuning

    Aug 9, 2025Xingke Yang, Liang Li, Sicong Li +6LLM Fine-TuningFederated Fine-Tuning