Overview

Federated fine-tuning studies how multiple data holders can adapt a shared pretrained model while keeping examples local, enabling collaboration in healthcare, finance, language, vision, and edge settings. Common approaches include parameter-efficient methods such as LoRA, QLoRA, and prompt tuning; client-server aggregation or split learning; and distillation when model updates are costly or architectures differ. Since clients have different data, tasks, and hardware, methods use personalized adapters, clustering or task-aware routing, update alignment, and compression, often evaluated on non-IID language, vision, and multimodal benchmarks. Keeping raw data local does not prevent gradient leakage, membership inference, poisoning, or unequal outcomes for weaker clients; differential privacy and stronger security can reduce utility and add cost, making realistic measurements of communication, memory, energy, and latency important.

Latest papers

CardsList

128 papers12 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. Perplexity Predicts Protection: Choosing Pretrained Backbones for Worst-Client Fairness in Federated Parameter-Efficient Fine-Tuning

    Sep 20, 2026Kiran Naseer, Samreen Azhar, Umar Shoaib +2Federated Fine-TuningFederated Learning

  2. Co-VLA: Consensus-based Federated Training for Vision-Language-Action Models

    Sep 17, 2026Haolong Li, Guner Dilsad Er, Michael Muehlebach +1Vision-Language-Action ModelsFederated Fine-Tuning

  3. FLoKD: Adaptive Knowledge Distillation for Federated Low-Rank LLM over Wireless Networks

    Sep 11, 2026Xinlu Zhang, Na Yan, Yang Su +2LLM Fine-TuningFederated Knowledge Distillation

  4. Task-Aware Federated Fine-Tuning for MoE-based Large Language Models

    Sep 11, 2026Tingqi Wang, Hongyu Ke, Haoxin Wang +2Federated Fine-TuningNon-IID Federated Learning

  5. Privacy-Preserving Split Learning for Federated LLM Fine-Tuning

    Sep 9, 2026Heng Jin, Chaoyu Zhang, Hexuan Yu +2Privacy-Preserving Language ModelsSplit Federated Learning

  6. FedSubMuon: Communication-Efficient Federated LLM Fine-Tuning via Structured Subspace Muon

    Sep 5, 2026Shaolong Chen, Youming Tao, Shuzhen Chen +3Subspace OptimizationFederated Fine-Tuning

  7. Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts

    Sep 2, 2026Sanjaya Poudel, Nirajan Kunwor, Manish Dhakal +2Federated Fine-TuningFederated Learning

  8. Breaking the Structural Identity: Personalized Federated LoRA Fine-tuning under Rank Heterogeneity

    Sep 1, 2026Lei Wang, Jieming Bian, Letian Zhang +1Non-IID Federated LearningLow-Rank Adaptation

  9. SplitLite: Low-Rank Residual Compression for Split Learning

    Aug 24, 2026Tao Li, Yulin Tang, Qi Guo +1Split Federated LearningCommunication-Efficient Distributed Training

  10. Unveiling the Depth-Performance Dilemma in Split-Federated Fine-tuning of LLMs

    Aug 23, 2026Hariharan Ramesh, Someshwaran Murugaiyan, Jyotikrishna DassSplit Federated LearningFederated Fine-Tuning

  11. Thermo-FL: Thermal-Aware Robust Federated Fine-Tuning of Large Language Models for Edge AI

    Aug 21, 2026Shiva Shrestha, Kazi Shaharair Sharif, Zongxing Xie +3Federated Fine-TuningFederated Learning

  12. When Adaptation Hurts: Split Sensitivity and Person-Level Negative Transfer in Federated Wearable Onboarding

    Aug 18, 2026Rahil Aftab, Vineet Kumar Rakesh, Soumya Mazumdar +1Federated LearningFederated Fine-Tuning

  13. FedPref: Federated Preference Learning for Structured Radiology Report Extraction

    Aug 17, 2026Flint Xiaofeng Fan, Cheston Tan, Yew-Soon Ong +1Clinical Information ExtractionFederated Learning

  14. When Is Shallow Enough? Adaptive Split Federated Learning with Client-Specific Sufficiency Estimation

    Aug 16, 2026Wenhao Yuan, Chenchen Lin, Wentao Hu +4Split Federated LearningHeterogeneous Federated Learning

  15. FedPA-LoRA: Product-Aligned Framework for Mitigating Aggregation and Initialization Errors in Heterogeneous Federated LoRA

    Aug 15, 2026Juseok Jeon, Ramy E. Ali, Doyun Kwon +3Federated Fine-TuningFederated Learning

  16. Global Federated Learning Strategies for Building Efficient Personalized Models

    Aug 15, 2026Seongyoon KimFederated LearningHeterogeneous Federated Learning

  17. Federated Prompt Learning: A Unified Framework, Empirical Analysis, and Future Directions

    Aug 14, 2026Qinglin Yang, Chen Qiu, Hongyuan Zhang +3Federated LearningPrivacy-Preserving Language Models

  18. SeFoRA: Sketch-Aggregated Federated Low-Rank Adaptation with Heterogeneous Client Ranks

    Aug 10, 2026Yue Xia, Tayyebeh Jahani-Nezhad, Mayank Bakshi +1Federated Learning AggregationLow-Rank Adaptation

  19. Rethinking Factor Sharing in Federated LoRA: A Rank-Aware Adaptive Approach

    Aug 10, 2026Xinyi Xu, Bingnan Xiao, Shuang Qin +2LLM Fine-TuningLow-Rank Adaptation

  20. Label Granularity Skew in Federated Learning with Hierarchical Image Classification

    Aug 10, 2026Jaeheon Kim, Hokeun Kim, Bong Jun ChoiHierarchical ClassificationFederated Fine-Tuning

  21. EFFEKT: Efficient Federated Knowledge Transfer to Foundation Models

    Aug 8, 2026Matteo Caligiuri, Francesco Barbato, Pietro Zanuttigh +1Federated Knowledge DistillationCross-Architecture Knowledge Distillation

  22. On the Effectiveness of Adaptation Strategies for VLM-Based Federated Learning in Remote Sensing

    Aug 5, 2026Simon Lösche, Barış Büyüktaş, Mathis Adler +3Remote Sensing Image UnderstandingPrompt Learning

  23. Personalized Federated Sparse Adaptation of Time-Series Foundation Models

    Aug 5, 2026Priyanka Nihalchandani, Naman Srivastava, Varun Ojha +1Mixture of ExpertsTime Series Forecasting

  24. FraQ: Efficient Coordinate-Space Recompression for Federated Low-Rank Adaptation

    Aug 4, 2026Shenghui Li, Thiemo VoigtFederated Learning AggregationCommunication-Efficient Distributed Training

  25. MineGrad: Gradient Inversion Attacks on LoRA Fine-Tuning

    Aug 2, 2026Hasin Us Sami, Swapneel Sen, Basak GulerGradient Inversion AttacksPrivacy Leakage in Language Models

  26. FedChronos: Federated Fine-Tuning of Time-Series Foundation Models for Privacy-Preserving Commodity Price Forecasting

    Aug 2, 2026Amit Sharma, Nitin Auluck, Akramul AzimTime Series ForecastingFederated Fine-Tuning

  27. Federated Foundation Models Fine-Tuning with Heterogeneous Compressed Clients

    Jul 31, 2026Shengkun Zhu, Jinshan Zeng, Zhihua Allen-Zhao +5Federated Learning AggregationFederated Fine-Tuning