Federated Prompt Cooperation

Federated prompt cooperation explores collaborative machine learning across decentralized datasets, aiming to train shared models while preserving data privacy and addressing data heterogeneity. Current research focuses on adapting various model architectures, including variational autoencoders, transformers, and reinforcement learning algorithms, to this federated setting, often employing techniques like low-rank adaptation and prompt engineering to manage communication overhead and improve model personalization. This approach holds significant promise for applications requiring distributed data analysis, such as healthcare, industrial IoT, and social network analysis, by enabling the development of more accurate and robust models while respecting data privacy constraints.

Papers

August 30, 2024

FissionVAE: Federated Non-IID Image Generation with Latent Space and Decoder Decomposition
Chen Hu, Jingjing Deng, Xianghua Xie, Xiaoke Ma
Generative Adversarial Network Latent Space Image Generation Variational Autoencoders Federated Prompt Cooperation Single Decoder

August 19, 2024

Federated Frank-Wolfe Algorithm
Ali Dadras, Sourasekhar Banerjee, Karthik Prakhya, Alp Yurtsever
Federated Learning Privacy Preserving Federated Prompt Cooperation Frank Wolfe Algorithm Convex Objective

August 15, 2024

Random Gradient Masking as a Defensive Measure to Deep Leakage in Federated Learning
Joon Kim, Sejin Park
Natural Gradient Federated Prompt Cooperation Defense Method Robust Defense Deep Leakage Gradient Masking

August 7, 2024

SocFedGPT: Federated GPT-based Adaptive Content Filtering System Leveraging User Interactions in Social Networks
Sai Puppala, Ismail Hossain, Md Jahangir Alam, Sajedul Talukder
Social Network Federated Prompt Cooperation Social Medium Data LLM in Context Content Filtering User Interaction Content Quality User Persona

August 6, 2024

FLASH: Federated Learning-Based LLMs for Advanced Query Processing in Social Networks through RAG
Sai Puppala, Ismail Hossain, Md Jahangir Alam, Sajedul Talukder
Federated Learning Social Medium LLM Based Social Network Federated Prompt Cooperation Kg Rag Query Processing

July 31, 2024

A Federated Learning-Friendly Approach for Parameter-Efficient Fine-Tuning of SAM in 3D Segmentation
Mothilal Asokan, Joseph Geo Benjamin, Mohammad Yaqub, Karthik Nandakumar
Foundation Model Segment Anything Model Parameter Efficient Fine Tuning Federated Prompt Cooperation 3D Segmentation

July 29, 2024

F-KANs: Federated Kolmogorov-Arnold Networks
Engin Zeydan, Cristian J. Vaca-Rubio, Luis Blanco, Roberto Pereira, Marius Caus, Abdullah Aydeger
Kolmogorov Arnold Network Federated Prompt Cooperation Federated Gaussian Process

July 13, 2024

Overcoming Catastrophic Forgetting in Federated Class-Incremental Learning via Federated Global Twin Generator
Thinh Nguyen, Khoa D Doan, Binh T. Nguyen, Danh Le-Phuoc, Kok-Seng Wong
Generative Model Federated Learning Catastrophic Forgetting Class Incremental Learning Federated Prompt Cooperation Generative Training

July 6, 2024

Personalized Federated Domain-Incremental Learning based on Adaptive Knowledge Matching
Yichen Li, Wenchao Xu, Haozhao Wang, Ruixuan Li, Yining Qi, Jingcai Guo
Federated Prompt Cooperation Incremental Task Domain Incremental Learning Dynamic Knowledge Personalized Federated

June 25, 2024

Towards Federated Low-Rank Adaptation of Language Models with Rank Heterogeneity
Yuji Byun, Jaeho Lee
Adaptation Concern Federated Prompt Cooperation Low Rank Adaptation Zero Padding Decentralized Aggregation Communication Heterogeneity

June 20, 2024

FLoCoRA: Federated learning compression with low-rank adaptation
Lucas Grativol Ribeiro, Mathieu Leonardon, Guillaume Muller, Virginie Fresse, Matthieu Arzel
Linear Compression Federated Prompt Cooperation Low Rank Adaptation

June 18, 2024

Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharing
Viet Vo, Thusitha Dayaratne, Blake Haydon, Xingliang Yuan, Shangqi Lai, Sharif Abuadbba, Hajime Suzuki, Carsten Rudolph
Privacy Policy Security Related Federated Prompt Cooperation Spectrum Sharing Structure Spectrum Relationship

June 4, 2024

Federated Class-Incremental Learning with Hierarchical Generative Prototypes
Riccardo Salami, Pietro Buzzega, Matteo Mosconi, Mattia Verasani, Simone Calderara
Continual LEArning Class Incremental Learning Federated Prompt Cooperation Federated Continual Learning

June 3, 2024

Efficient Data Distribution Estimation for Accelerated Federated Learning
Yuanli Wang, Lei Huang
Federated Learning Federated Prompt Cooperation Client Selection DIstribution Estimation Client Heterogeneity Device Selection

May 30, 2024

Federated and Transfer Learning for Cancer Detection Based on Image Analysis
Amine Bechar, Youssef Elmir, Yassine Himeur, Rafik Medjoudj, Abbes Amira
Machine Learning Transfer Learning Image Processing Federated Prompt Cooperation Cancer Detection

May 29, 2024

Federated Q-Learning with Reference-Advantage Decomposition: Almost Optimal Regret and Logarithmic Communication Cost
Zhong Zheng, Haochen Zhang, Lingzhou Xue
Q Learning Federated Prompt Cooperation Federated Reinforcement Learning Episodic Markov Decision Process

May 23, 2024

Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data
Haoran Li, Xinyuan Zhao, Dadi Guo, Hanlin Gu, Ziqian Zeng, Yuxing Han, Yangqiu Song, Lixin Fan, Qiang Yang
Language Model Synthetic Data Domain Specific Knowledge Transfer Federated Prompt Cooperation Domain Knowledge Transfer

May 21, 2024

FedASTA: Federated adaptive spatial-temporal attention for traffic flow prediction
Kaiyuan Li, Yihan Zhang, Huandong Wang, Yan Zhuo, Xinlei Chen
Temporal Graph Federated Prompt Cooperation Traffic Flow Prediction Federated Online Adaptation

May 3, 2024

FastLloyd: Federated, Accurate, Secure, and Tunable $k$-Means Clustering with Differential Privacy
Abdulrahman Diaa, Thomas Humphries, Florian Kerschbaum
Differential Privacy Federated Prompt Cooperation Secure Aggregation K$ Mean Secure Computation Tunable Slack Mechanism

April 22, 2024

Poisoning Attacks on Federated Learning-based Wireless Traffic Prediction
Zifan Zhang, Minghong Fang, Jiayuan Huang, Yuchen Liu
Poisoning Attack Traffic Prediction Federated Prompt Cooperation

Federated Prompt Cooperation

Papers

FissionVAE: Federated Non-IID Image Generation with Latent Space and Decoder Decomposition

Federated Frank-Wolfe Algorithm

Random Gradient Masking as a Defensive Measure to Deep Leakage in Federated Learning

SocFedGPT: Federated GPT-based Adaptive Content Filtering System Leveraging User Interactions in Social Networks

FLASH: Federated Learning-Based LLMs for Advanced Query Processing in Social Networks through RAG

A Federated Learning-Friendly Approach for Parameter-Efficient Fine-Tuning of SAM in 3D Segmentation

F-KANs: Federated Kolmogorov-Arnold Networks

Overcoming Catastrophic Forgetting in Federated Class-Incremental Learning via Federated Global Twin Generator

Personalized Federated Domain-Incremental Learning based on Adaptive Knowledge Matching

Towards Federated Low-Rank Adaptation of Language Models with Rank Heterogeneity

FLoCoRA: Federated learning compression with low-rank adaptation

Security and Privacy of 6G Federated Learning-enabled Dynamic Spectrum Sharing

Federated Class-Incremental Learning with Hierarchical Generative Prototypes

Efficient Data Distribution Estimation for Accelerated Federated Learning

Federated and Transfer Learning for Cancer Detection Based on Image Analysis

Federated Q-Learning with Reference-Advantage Decomposition: Almost Optimal Regret and Logarithmic Communication Cost

Federated Domain-Specific Knowledge Transfer on Large Language Models Using Synthetic Data

FedASTA: Federated adaptive spatial-temporal attention for traffic flow prediction

FastLloyd: Federated, Accurate, Secure, and Tunable $k$-Means Clustering with Differential Privacy

Poisoning Attacks on Federated Learning-based Wireless Traffic Prediction