Federated Fine-Tuning

Ask about this topic

Momentum

12 papers in the last four weeks, up 140% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 62

All topics
CardsList

  1. HE-OFT: Privacy-Preserving One-Shot Federated Fine-Tuning under Homomorphic Encryption

    Oct 6, 2026Halil İbrahim Kanpak, Sinem Sav, Alptekin KüpçüPrivacy-Preserving MLFederated Fine-Tuning

    Department of Computer Engineering, Kocı University, İstanbul, Türkiye · Department of Computer Engineering, Bilkent University, Ankara, Türkiye

  2. Collaborative Personalized Preference Alignment for LLMs under Data Deficiency

    Oct 5, 2026Liyan Yang, Yige Yuan, Zhiqin YangPersonalized Language ModelsPersonalized Language Model Alignment

    City University of Hong Kong · University of Washington · The Hong Kong University of Science and Technology

  3. Beyond Domain-Level Adaptation: Margin-Oriented Semantic-Appearance Interaction Correction for Personalized Federated Vision-Language Models

    Oct 1, 2026Wentao Yue, Qingyu Mao, Tianyou Lai +2VLM AdaptationFederated Fine-Tuning

  4. FedFit: Federated Fine-Tuning of LLMs via Vector-Bank Parameterization and Quantization

    Oct 1, 2026Hang Zou, Chao Zhang, Yuzhi Yang +3Federated Learning AggregationLow-Rank Adaptation

    6G Research Center, Khalifa University, 127788 Abu Dhabi, UAE · Department of Computer Science, Central South University, 410083, Changsha, China · Université de Lorraine, CNRS, CRAN, F-54000 Nancy, France

  5. Federated Learning for LLMs over Mobile Networks: Issues and Solutions in the RAN Transport

    Oct 1, 2026Emilio Paolini, Andrea Pinto, Flavio Esposito +1Federated Learning AggregationAsynchronous Federated Learning

    Tecip Institute, Scuola Superiore Sant’Anna, Pisa, Italy · Computer Science Department, Saint Louis University, St. Louis, USA

  6. From Task Mixtures to Specialized Experts

    Sep 30, 2026Hojat Allah Salehi, Mehrdad Mahdavi, Andrew Arash Mahyari +1Multi-Task LearningMixture-of-Experts Models

    Florida International University, Miami, FL, USA · Security, Optimization, and Learning for InterDependent networks laboratory (solid lab), Miami, FL, USA · The Pennsylvania State University, University Park, PA, USA +1

  7. Unapologetically Distributed: A Call for Decentralized Document Analysis

    Sep 30, 2026Adrià Molina, Oriol Ramos Terrades, Josep LladósOOD GeneralizationDecentralized Learning

    Centre de Visió per Computador Universitat Autònoma de Barcelona Bellaterra, Catalonia · Computer Science Department Universitat Autònoma de Barcelona, Bellaterra, Catalonia

  8. FedLAFP: Low-Rank Aggregation Meets Full-Rank Personalization in Federated Fine-Tuning

    Sep 29, 2026Mengjun Yi, Huaian Gu, Yinghao Ai +2Low-Rank AdaptationFederated Fine-Tuning

    State Key Laboratory for Novel Software Technology · School of Artificial Intelligence · School of Computer Science +1

  9. CF-LoRA: Decoupled Factor Aggregation and Adaptation-Aware Client Clustering for Federated LoRA Fine-Tuning

    Sep 29, 2026Mengjun Yi, Langxing Yang, Suhan Guo +2Federated Learning AggregationFederated Fine-Tuning

    State Key Laboratory for Novel Software Technology · School of Artificial Intelligence School of Electronic Science and Engineering Nanjing University

  10. RoboFL: Federated Expert Assembly for World Action Models

    Sep 28, 2026Rongyu Zhang, Ruizhi Fan, Yunfan Lou +8Mixture of ExpertsWorld Action Models

    Nanjing University · Hong Kong University of Science and Technology · State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University

  11. Perplexity Predicts Protection: Choosing Pretrained Backbones for Worst-Client Fairness in Federated Parameter-Efficient Fine-Tuning

    Sep 20, 2026Kiran Naseer, Samreen Azhar, Umar Shoaib +2Federated Fine-TuningFederated Learning

    Department of Computer Science, University of Gujrat, Gujrat, Pakistan · Department of Cybersecurity, College of Engineering, Al Ain University, Al Ain, UAE · Department of Computer Science, College of Computer, Qassim University, Qassim 52571, Saudi Arabia

  12. Co-VLA: Consensus-based Federated Training for Vision-Language-Action Models

    Sep 17, 2026Haolong Li, Guner Dilsad Er, Michael Muehlebach +1Vision-Language-Action ModelsFederated Fine-Tuning

    Intelligent Perception in Technical Systems, University of Augsburg, Germany · Max Planck Institute for Intelligent Systems, Germany

  13. CIDERS: Cloud-Edge LLM Collaborative Learning via Accelerating Personalized Bilevel Optimization

    Sep 14, 2026Victor H. Chen, Hairui Yu, Stella K. Chung +1Bilevel OptimizationFederated Fine-Tuning

  14. Privacy-Preserving Split Learning for Federated LLM Fine-Tuning

    Sep 9, 2026Heng Jin, Chaoyu Zhang, Hexuan Yu +2Privacy-Preserving Language ModelsSplit Federated Learning

    Virginia Tech, Arlington, VA, USA

  15. Federated LoRA Adaptation of BiomedCLIP Across Four International Chest X-Ray Cohorts

    Sep 2, 2026Sanjaya Poudel, Nirajan Kunwor, Manish Dhakal +2Federated Fine-TuningFederated Learning

    North Carolina A&T State University · Tribhuvan University · University of Tennessee-Knoxville +1

  16. Breaking the Structural Identity: Personalized Federated LoRA Fine-tuning under Rank Heterogeneity

    Sep 1, 2026Lei Wang, Jieming Bian, Letian Zhang +1Non-IID Federated LearningLow-Rank Adaptation

    University of Florida · Gainesville, FL 32611 · Middle Tennessee State University +1

  17. SeFoRA: Sketch-Aggregated Federated Low-Rank Adaptation with Heterogeneous Client Ranks

    Aug 10, 2026Yue Xia, Tayyebeh Jahani-Nezhad, Mayank Bakshi +1Federated Learning AggregationLow-Rank Adaptation

    Technical University of Munich Munich, 80333 Germany · Technische Universität Berlin Berlin, 10587 Germany · Northern Arizona University Flagstaff, AZ 86011 USA

  18. Rethinking Factor Sharing in Federated LoRA: A Rank-Aware Adaptive Approach

    Aug 10, 2026Xinyi Xu, Bingnan Xiao, Shuang Qin +2LLM Fine-TuningLow-Rank Adaptation

    University of Electronic Science and Technology of China · Fudan University · Singapore University of Technology and Design

  19. Label Granularity Skew in Federated Learning with Hierarchical Image Classification

    Aug 10, 2026Jaeheon Kim, Hokeun Kim, Bong Jun ChoiHierarchical ClassificationFederated Fine-Tuning

    School of Computer Science and Engineering, Soongsil University, Seoul, Republic of Korea · School of Computing and Augmented Intelligence, Arizona State University, Tempe, United States

  20. EFFEKT: Efficient Federated Knowledge Transfer to Foundation Models

    Aug 8, 2026Matteo Caligiuri, Francesco Barbato, Pietro Zanuttigh +1Federated Knowledge DistillationCross-Architecture Knowledge Distillation

    Department of Electrical & Computer Engineering, Northeastern University, Boston (MA), United States · Department of Information Engineering, University of Padua, Padua, Italy

  21. On the Effectiveness of Adaptation Strategies for VLM-Based Federated Learning in Remote Sensing

    Aug 5, 2026Simon Lösche, Barış Büyüktaş, Mathis Adler +3Remote Sensing Image UnderstandingPrompt Learning

    BIFOLD - Berlin Institute for the Foundations of Learning and Data, 10587 Berlin, Germany · Technische Universität Berlin, 10623 Berlin, Germany · Orion Lab, School of Rural, Surveying and Geoinformatics Engineering, National Technical University of Athens, 15772 Athens, Greece +2

  22. Personalized Federated Sparse Adaptation of Time-Series Foundation Models

    Aug 5, 2026Priyanka Nihalchandani, Naman Srivastava, Varun Ojha +1Mixture of ExpertsTime Series Forecasting

    Robert Bosch Centre for Cyber-Physical Systems, Indian Institute of Science, Bengaluru, India · School of Computing, Newcastle University, Newcastle upon Tyne, United Kingdom

  23. FraQ: Efficient Coordinate-Space Recompression for Federated Low-Rank Adaptation

    Aug 4, 2026Shenghui Li, Thiemo VoigtFederated Learning AggregationCommunication-Efficient Distributed Training

    Uppsala University, Uppsala, Sweden · Research Institutes of Sweden, Stockholm, Sweden

  24. MineGrad: Gradient Inversion Attacks on LoRA Fine-Tuning

    Aug 2, 2026Hasin Us Sami, Swapneel Sen, Basak GulerGradient Inversion AttacksPrivacy Leakage in Language Models

    University of California, Riverside, CA

  25. FedChronos: Federated Fine-Tuning of Time-Series Foundation Models for Privacy-Preserving Commodity Price Forecasting

    Aug 2, 2026Amit Sharma, Nitin Auluck, Akramul AzimTime Series ForecastingFederated Fine-Tuning

    Indian Institute of Technology Ropar, Punjab, India · Ontario Tech University, Oshawa, Canada

  26. Federated Foundation Models Fine-Tuning with Heterogeneous Compressed Clients

    Jul 31, 2026Shengkun Zhu, Jinshan Zeng, Zhihua Allen-Zhao +5Federated Learning AggregationFederated Fine-Tuning

    The Hong Kong Polytechnic University · OceanBase, Ant Group · School of Management, Xi’an Jiaotong University +3

  27. TriShield: Zero-Utility-Loss Defense Against Privacy Backdoors in Federated Language Model Fine-Tuning via Orthogonal Gradient Projection and Optimizer State Entanglement

    Jul 30, 2026Cheng WeiBackdoor AttacksBackdoor Attacks in Federated Learning

    Honor Device Co., Ltd., Shenzhen, China

  28. FedWeave: Rethinking the Unit of Specialization in Heterogeneous Federated MoE-LoRA

    Jul 29, 2026Donghang Duan, Xu Zheng, Lizong Zhang +2Federated Learning AggregationLLM Routing

    University of Electronic Science and Technology of China · 2Zhejiang University

  29. Three-Pronged Spectral Control for Federated Parameter Efficient Fine Tuning

    Jul 23, 2026Shiva Raj Pokhrel, Dipsan Bhattarai, Anwar WalidFederated Learning AggregationNuclear Norm Minimization

    School of IT, Deakin University, Australia · Columbia University, USA

  30. Federated Lightweight Fine-Tuning

    Jul 20, 2026Radhakrishna Achanta, Will ReedFederated Learning AggregationFederated Fine-Tuning

    Cisco Systems Inc., USA

  31. Dysco: Dynamic Subspace Boosting to Mitigate LoRA Interference in Federated Learning

    Jul 15, 2026Haobo Zhang, Jiankun Wang, Suraj Rajendran +5Federated Learning AggregationLow-Rank Adaptation

    University of Michigan · Cornell University · University of Pennsylvania

  32. Continual Learning with Elastic Regularization and Synthetic Replay for Federated MLLM Fine-Tuning

    Jul 13, 2026Jing Liu, Chenxuanyin Zou, Jiayang Ren +5Multimodal Federated LearningGenerative Replay

    Department of Electrical and Computer Engineering, The University of British Columbia, Vancouver, BC V6T 1Z4, Canada · College of Future Information Technology, Fudan University, Shanghai 200433, China · Department of Chemical and Biological Engineering, The University of British Columbia, Vancouver, BC V6T 1Z4, Canada +3

  33. PFAdapter: Hierarchical LoRA Decomposition for Personalized Federated MLLMs

    Jul 13, 2026Jing Liu, Kun Yang, Yan Wang +5Multimodal Federated LearningFederated Learning Aggregation

    College of Future Information Technology, Fudan University, Shanghai 200433, China · Division of Natural and Applied Sciences, Duke Kunshan University, Suzhou 215316, China · Department of Electrical and Computer Engineering, The University of British Columbia, BC V6T 1Z4, Canada +8

  34. Subspace-Constrained Federated Learning with Low-Rank Adaptation

    Jun 21, 2026Neranjan Senarath, Rohit Muralitharan, Sadia AsifFederated Learning AggregationNon-IID Federated Learning

    Department of ECSE Rensselaer Polytechnic Institute Troy, NY 12180, USA · Department of Computer Science Rensselaer Polytechnic Institute Troy, NY 12180, USA

  35. PreLort: Prefix-Nested LoRA for Federated Fine-Tuning under Rank Heterogeneity

    Jun 14, 2026Muhammad Waseem, Nurbek Tastan, Andrej Jovanovic +4Federated Learning AggregationLLM Fine-Tuning

    1MBZUAI, UAE · University of Cambridge, UK · 3Flower Labs, UK +1

  36. Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts

    Jun 14, 2026Yijun Lu, Zihan Fang, Pengpeng Qiao +6Federated Learning AggregationLLM Fine-Tuning

    Waseda University, Tokyo, Japan · City University of Hong Kong, China · Institute of Science Tokyo, Tokyo, Japan +4

  37. Shift-Dependent Asymmetry: Orthogonal Inverse Low-Rank Adaptation for Federated Medical Segmentation

    Jun 7, 2026Xingyue Zhao, Wenke Huang, Linghao Zhuang +7Vision Foundation Model AdaptationNon-IID Federated Learning

    Department of Neurosurgery, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences · College of Computing and Data Science, Nanyang Technological University, Singapore +4

  38. Amortizing Federated Adaptation: Hypernetwork Driven LoRA for Personalized Foundation Models

    Jun 4, 2026Sunny Gupta, Shambhavi Shanker, Amit SethiFederated Learning AggregationNon-IID Federated Learning

    Indian Institute of Technology, Bombay

  39. GuidaPA: Privacy-Preserving Chatbot for Public Administration via Federated Learning

    May 31, 2026Daniel M. Jimenez-Gutierrez, Albenzio Cirillo, Raffaele Nicolussi +2Privacy-Preserving Language ModelsConversational Agents

    Sapienza University of Rome, Via Ariosto 25, 00185 Rome, Italy · Fondazione Ugo Bordoni, Viale del Policlinico 147, 00161 Rome, Italy

  40. FedSmoothLoRA: Toward Smoother and Faster Convergence in Federated Low-Rank Adaptation

    May 28, 2026Zehao Wang, Guanglei Yang, Yihan Zeng +4Low-Rank AdaptationFederated Fine-Tuning

    1Harbin Institute of Technology · 2Huawei Noah’s Ark Lab · University College Dublin

  41. Decoupled Training with Local Reinforcement Fine-Tuning in Federated Learning

    May 27, 2026Yuting Ma, Lechao Cheng, Xiaohua XuVLM AdaptationVision-Language Alignment

    School of Computer Science and Technology, University of Science and Technology of China, Hefei, Anhui, China · School of Computer Science and Information Engineering, Hefei University of Technology, Hefei, Anhui, China.

  42. Federated LoRA Fine-Tuning for LLMs via Collaborative Alignment

    May 20, 2026Shuaida He, Liwen Chen, Long FengLLM Fine-TuningLow-Rank Adaptation

    School of Computing & Data Science, The University of Hong Kong

  43. FedSDR: Federated Self-Distillation with Rectification

    May 18, 2026Ziheng Ren, Zhanming Shen, Hao Wang +2LLM Fine-TuningHallucination in Language Models

    Beijing University of Aeronautics and Astronautics · Zhejiang University · Stevens Institute of Technology +1

  44. TSFLora: Token-Compressed Split Fine-Tuning for Wireless Edge Networks

    May 17, 2026Xianke Qiang, Zheng Chang, Li Wang +1Communication-Efficient Distributed TrainingEdge Computing

    School of Computer Science and Engineering, UESTC, 611731 Chengdu, China · School of Computer Science, Beijing University of Posts and Telecommunications, Beijing, 100876, China. · Center for Intelligent Networking and Communications, UESTC, 611731 Chengdu, China.

  45. UB-SMoE: Universally Balanced Sparse Mixture-of-Experts for Resource-adaptive Federated Fine-tuning of Foundation Models

    May 15, 2026Van-Tuan Tran, Hong-Hanh Nguyen-Le, Marco Ruffini +1Expert Load BalancingSparse Mixture-of-Experts

    School of Computer Science and Statistics, Trinity College Dublin, Ireland · School of Computer Science, University College Dublin, Ireland

  46. Towards the Next Frontier of LLMs, Training on Private Data: A Cross-Domain Benchmark for Federated Fine-Tuning

    May 13, 2026Daniel M. Jimenez-Gutierrez, Enrique Zuazua, Georgios Kellaris +3LLM Fine-TuningNon-IID Federated Learning

  47. Beyond Parameter Aggregation: Semantic Consensus for Federated Fine-Tuning of LLMs

    May 12, 2026Amr Abourayya, Jens Kleesiek, Michael KampLLM Fine-TuningFederated Knowledge Distillation

    Lamarr Institute for ML and AI, Technical University Dortmund · Institute for AI in medicine (IKIM),University Hospital Essen

  48. DP-LAC: Lightweight Adaptive Clipping for Differentially Private Federated Fine-tuning of Language Models

    May 11, 2026Haaris Mehmood, Jie Xu, Karthikeyan Saravanan +2Privacy-Preserving Language ModelsDifferentially Private Stochastic Gradient Descent

    Samsung R&D Institute UK (SRUK) · Samsung AI Centre Cambridge

  49. Concordia: Self-Improving Synthetic Tables for Federated LLMs

    May 11, 2026Jimin Huang, Duanyu Feng, Nuo Chen +8LLM Fine-TuningSynthetic Data Generation

    University of Manchester · The Fin AI · National University of Singapore +5

  50. When More Parameters Hurt: Foundation Model Priors Amplify Worst-Client Disparity Under Extreme Federated Heterogeneity

    May 9, 2026Kiran Naseer, Umar ShoaibNon-IID Federated LearningFederated Fine-Tuning

    University of Gujrat, Pakistan

  51. EdgeFlowerTune: Evaluating Federated LLM Fine-Tuning Under Realistic Edge System Constraints

    May 9, 2026Jiaxiang Geng, Yiyi Lu, Lunyu Zhao +3LLM EvaluationLLM Fine-Tuning

    Duke Kunshan University · Flower Labs · University of Cambridge

  52. Self-Play Enhancement via Advantage-Weighted Refinement in Online Federated LLM Fine-Tuning

    May 8, 2026Seohyun Lee, Wenzhi Fang, Dong-Jun Han +2LLM Fine-TuningLanguage Model Self-Improvement

    Purdue University · Yonsei University · University at Buffalo-SUNY

  53. Graph Representation Learning Augmented Model Manipulation on Federated Fine-Tuning of LLMs

    May 8, 2026Hanlin Cai, Kai Li, Houtianfu Wang +4LLM Fine-TuningLLM Security

    Centre for neXt Communications (CXC), Department of Engineering, University of Cambridge, CB3 0FA Cambridge, U.K. · Interdisciplinary Centre for Security, Reliability and Trust (SnT), University of Luxembourg, L-1855, Luxembourg · Telecommunication Networks group (TKN) at the School of Electrical Engineering and Computer Science, TU Berlin, Germany +1

  54. FedAttr: Towards Privacy-preserving Client-Level Attribution in Federated LLM Fine-tuning

    May 7, 2026Su Zhang, Junfeng Guo, Heng HuangPrivacy-Preserving Language ModelsLLM Fine-Tuning

    Department of Computer Science, University of Maryland, College Park

  55. Beyond Factor Aggregation: Gauge-Aware Low-Rank Server Representations for Federated LoRA

    May 7, 2026Jinqian Chen, Chang Liu, Jihua ZhuFederated Learning AggregationLow-Rank Adaptation

    School of Software Engineering Xi’an Jiaotong University Xi’an, China 710000

  56. Adaptive Selection of LoRA Components in Privacy-Preserving Federated Learning

    May 7, 2026Myoungjun Kim, Sangwoo Park, Yoseob Han +1Federated Learning AggregationLow-Rank Adaptation

    Myongji University · King’s College London · Soongsil University

  57. SplitFT: An Adaptive Federated Split Learning System For LLMs Fine-Tuning

    Apr 29, 2026Yimeng Shan, Zhaorui Zhang, Sheng Di +3Communication-Efficient Distributed TrainingLLM Fine-Tuning

    Hong Kong Polytechnic University Hong Kong · Argonne National Labratory USA · University of California, Merced USA +1

  58. FED-FSTQ: Fisher-Guided Token Quantization for Communication-Efficient Federated Fine-Tuning of LLMs on Edge Devices

    Apr 28, 2026Changyu Li, Shuanghong Huang, Jiashen Liu +5Federated Fine-TuningFederated Learning

    School of Computing and Information Technology, Great Bay University, Dongguan, China · Beijing Institute of Technology, Beijing, China · University of Warwick, Coventry, U.K. +3

  59. FedProxy: Federated Fine-Tuning of LLMs via Proxy SLMs and Heterogeneity-Aware Fusion

    Apr 21, 2026Tao Fan, Guoqiang Ma, Yuanfeng Song +3Privacy-Preserving Language ModelsLLM Fine-Tuning

    Hong Kong University of Science and Technology, Hong Kong, China · WeBank Co., Ltd, Shenzhen, China · Hong Kong Polytechnic University, Hong Kong, China

  60. Leveraging Soft Prompts for Privacy Attacks in Federated Prompt Tuning

    Jan 10, 2026Quan Minh Nguyen, Min-Seon Kim, Hoang M. Ngo +3Membership Inference AttacksFederated Fine-Tuning

    CISE, University of Florida, FL, USA · North Carolina State University, NC, USA · Washington State University, WA, USA +1