Communication-Efficient Federated Domain Generalization in Edge Networks via Dynamic Prototype Regulation
Organizations: School of Computer Science and Technology, Zhejiang Normal University, Jinhua 321004, China
Abstract
Federated learning (FL) is a distributed paradigm for Internet of Things (IoT) edge networks. However, deploying Vision-Language Models (VLMs) over wireless edge networks presents distinct challenges: large model parameters increase uplink transmission latency over bandwidth-constrained fading channels, and non-independent and identically distributed (Non-IID) data exacerbates client drift. Existing feature alignment solutions often introduce auxiliary computations that consume time slots allocated for wireless parameter transmission, increasing the likelihood of straggler dropouts under system delay constraints. To address these issues, we propose DPGR-GCAM, a communication-efficient federated domain generalization framework. By employing a dual-parameter-efficient fine-tuning (PEFT) architecture, we design a channel-aware tiered transmission mechanism that adaptively truncates payloads to maximize node survival rates under fading conditions. To mitigate client drift, we introduce the Gradient-Conflict Aware Modulation (GCAM) mechanism. GCAM operates within the low-dimensional feature manifold to dynamically resolve multi-objective optimization conflicts with minimal edge computation latency, thereby reducing computation-induced network outages. Experiments demonstrate that DPGR-GCAM improves cross-domain generalization and sustains convergence under network fading scenarios with a 10% client participation rate.
Figures & tables
| Methods | DomainNet | Office-Caltech10 | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| c | i | p | q | r | s | avg | a | w | d | c | avg | ||
| 0.01 | FedAvg [ 17 ] | 81.37 | 59.28 | 77.32 | 26.69 | 89.29 | 75.53 | 68.25 | 93.75 | 89.66 | 93.55 | 93.78 | 92.69 |
| FedProto [ 18 ] | 83.68 | 65.54 | 76.79 | 26.86 | 88.38 | 76.50 | 69.63 | 94.79 | 93.10 | 93.55 | 95.33 | 94.19 | |
| FedCLIP [ 9 ] | 82.99 | 58.60 | 76.53 | 25.83 | 89.26 | 75.16 | 68.06 | 95.83 | 93.10 | 93.55 | 93.33 | 93.95 | |
| PromptFL [ 8 ] | 85.94 | 38.36 | 62.79 | 21.71 | 79.96 | 67.39 | 59.36 | 96.35 | 97.56 | 98.98 | 94.22 | 96.78 | |
| FedAPT [ 19 ] | 82.69 | 39.69 | 59.31 | 21.60 | 77.34 | 65.59 | 57.70 | 97.91 | 98.28 | 100.00 | 96.44 | 98.16 | |
| Method | Trainable | Comm. Payload | Peak Memory |
|---|---|---|---|
| Params (M) | (MB) | (MB) | |
| Full Fine-tuning | 127.68 | 487.04 | 10,968 |
| PromptFL [ 8 ] | 2.83 | 10.78 | 6,124 |
| FedAPT [ 19 ] | 3.09 | 11.78 | 6,127 |
| FedOTP [ 20 ] | 5.65 | 10.78 | 6,147 |
| Ours | 3.35 | 12.78 | 6,125 |
| Components | DomainNet | Office-Caltech10 |
|---|---|---|
| PEFT only | 71.45 | 95.23 |
| PEFT + | 72.84 | 96.43 |
| w/o Adapter | 74.16 | 97.21 |
| DPGR-GCAM (Full) | 76.04 | 98.93 |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 921 papers