Overview

Federated fine-tuning studies how multiple data holders can adapt a shared pretrained model while keeping examples local, enabling collaboration in healthcare, finance, language, vision, and edge settings. Common approaches include parameter-efficient methods such as LoRA, QLoRA, and prompt tuning; client-server aggregation or split learning; and distillation when model updates are costly or architectures differ. Since clients have different data, tasks, and hardware, methods use personalized adapters, clustering or task-aware routing, update alignment, and compression, often evaluated on non-IID language, vision, and multimodal benchmarks. Keeping raw data local does not prevent gradient leakage, membership inference, poisoning, or unequal outcomes for weaker clients; differential privacy and stronger security can reduce utility and add cost, making realistic measurements of communication, memory, energy, and latency important.

Latest papers

CardsList

128 papers12 papers in the last four weeks, down 33% on the four weeks before. 0.1% of all new papers.

  1. SMELL: Sparsity-aware Memory Efficient Federated Fine-tuning for Long-context LLMs

    Nov 14, 2026Yin Xu, Yongbo Yang, He Sun +2Federated Fine-TuningMemory-Efficient Fine-Tuning

  2. Sustainable Federated Fine-Tuning with LoRA: Environmental Impact and Performance Footprint

    Nov 12, 2026Pedro Augusto Londe Ribeiro, Rodrigo Moreira, Larissa Ferreira Rodrigues Moreira +3Energy-Efficient MLFederated Fine-Tuning

  3. Stochastic Projections and Rank-Aware Learning Rates for Federated LoRA

    Nov 9, 2026Saber Malekmohammadi, Kevin Kuo, Virginia Smith +1Federated Fine-TuningFederated Learning

  4. FedLoVA: Value-Only Aggregation for Federated LoRA Fine-Tuning of Large Language Models

    Nov 6, 2026Ensieh Khazaei, Baturalp Buyukates, Dimitrios HatzinakosLLM Fine-TuningFederated Fine-Tuning

  5. Align Before Aggregation: Basis-Consistent Federated LoRA under Heterogeneous Ranks

    Nov 5, 2026Pengpeng Qiao, Yang Cao, Lingling Zhang +5Federated Fine-TuningFederated Learning Aggregation

  6. Federated Transfer Learning for Medical Image Classification under Mixed Skew

    Nov 3, 2026Alexandre G. Leclercq, Sébastien Bougleux, Aurélien Corroyer-Dulmont +1Federated LearningNon-IID Federated Learning

  7. DICE: Decentralized Incentive-driven Federated Learning for Efficient & Scalable Customization of Pretrained Models in Web3

    Oct 29, 2026Hong Lin, Zhongle Xie, Lidan Shou +2Blockchain-Based Federated LearningFederated Fine-Tuning

  8. Communication-Efficient Federated Domain Generalization in Edge Networks via Dynamic Prototype Regulation

    Oct 19, 2026Yuankun Xia, Hui Wang, Ling Yuan +3Federated LearningFederated Domain Generalization

  9. PFedQFT: Personalized Federated Quantum-Inspired Fine-Tuning for Medical Large Language Models

    Oct 19, 2026Qihan Huang, Lingxia Zhang, Guye Zhang +2Federated Fine-TuningFederated Learning

  10. Optimal Hydra: Model Heterogeneous Federated Learning for LLMs using Data-Informed Hydra-Nets

    Oct 14, 2026Gwen Legate, Rahaf Aljundi, Eugene BelilovskyFederated LearningHeterogeneous Federated Learning

  11. BLEND: Balancing Personalization vs. Generalization in Federated Vision-Language Models

    Oct 9, 2026Payam Abdisarabshali, Fardis Nadimi, Kasra Borazjani +3VLM AdaptationFederated Fine-Tuning

  12. Personalized Federated Direct Preference Optimization via LoRA Adapters

    Oct 9, 2026Zhanhong Jiang, Soumik SarkarPersonalized Language Model AlignmentDirect Preference Optimization

  13. HE-OFT: Privacy-Preserving One-Shot Federated Fine-Tuning under Homomorphic Encryption

    Oct 6, 2026Halil İbrahim Kanpak, Sinem Sav, Alptekin KüpçüPrivacy-Preserving MLFederated Fine-Tuning

  14. Collaborative Personalized Preference Alignment for LLMs under Data Deficiency

    Oct 5, 2026Liyan Yang, Yige Yuan, Zhiqin YangPersonalized Language ModelsPersonalized Language Model Alignment

  15. FedFit: Federated Fine-Tuning of LLMs via Vector-Bank Parameterization and Quantization

    Oct 1, 2026Hang Zou, Chao Zhang, Yuzhi Yang +3Federated Learning AggregationLow-Rank Adaptation

  16. Federated Learning for LLMs over Mobile Networks: Issues and Solutions in the RAN Transport

    Oct 1, 2026Emilio Paolini, Andrea Pinto, Flavio Esposito +1Federated Learning AggregationAsynchronous Federated Learning

  17. From Task Mixtures to Specialized Experts

    Sep 30, 2026Hojat Allah Salehi, Mehrdad Mahdavi, Andrew Arash Mahyari +1Multi-Task LearningMixture-of-Experts Models

  18. Unapologetically Distributed: A Call for Decentralized Document Analysis

    Sep 30, 2026Adrià Molina, Oriol Ramos Terrades, Josep LladósOOD GeneralizationDecentralized Learning

  19. FedLAFP: Low-Rank Aggregation Meets Full-Rank Personalization in Federated Fine-Tuning

    Sep 29, 2026Mengjun Yi, Huaian Gu, Yinghao Ai +2Low-Rank AdaptationFederated Fine-Tuning

  20. CF-LoRA: Decoupled Factor Aggregation and Adaptation-Aware Client Clustering for Federated LoRA Fine-Tuning

    Sep 29, 2026Mengjun Yi, Langxing Yang, Suhan Guo +2Federated Learning AggregationFederated Fine-Tuning

  21. RoboFL: Federated Expert Assembly for World Action Models

    Sep 28, 2026Rongyu Zhang, Ruizhi Fan, Yunfan Lou +8Mixture of ExpertsWorld Action Models

  22. CFLoRA: Federated Fine-tuning of LLMs with Complementary Factors for Error-free Aggregation

    Sep 27, 2026Yanan Ma, Qiyuan Chen, Zihan Fang +2Federated Fine-TuningFederated Learning

  23. FAVoR: Measuring and Mitigating Author-Style Homogenization in Federated Personalized Generation

    Sep 25, 2026Lu Han, Jingyao Zhang, Katy Ilonka Gero +1Personalized Language ModelsPersonalized Text Generation

  24. Coupling Perception and Reasoning in Federated Multimodal Graph Foundation Models

    Sep 24, 2026Zekai Chen, Xun Wu, Hailin Zhang +7Multimodal Federated LearningGraph Foundation Models