Dynamic Free-Rider Detection in Cross-Silo Federated Learning via Simulated Attack Patterns
Organizations: Fujitsu Limited, Kanagawa, Japan
Abstract
Federated learning (FL) enables multiple clients to collaboratively train a global model by aggregating local updates without sharing private data. In this work, we focus on cross-silo FL, where each client typically represents an independent organization. However, cross-silo FL can face the challenge of free-riders, clients who submit fake model parameters without performing actual training to obtain the global model without contributing. Chen et al. proposed a free-rider detection method based on the weight evolving frequency (WEF) of model parameters. This detection approach is practical because it requires neither a proxy dataset nor pre-training. Nevertheless, it struggles to detect ``dynamic'' free-riders who behave honestly in early rounds and later switch to free-riding, particularly under global-model-mimicking attacks such as the delta weight attack and our newly proposed adaptive WEF-camouflage attack. In this paper, we propose a novel detection method S2-WEF that simulates the WEF patterns of potential global-model-mimicking attacks on the server side using previously broadcast global models, and identifies clients whose submitted WEF patterns resemble the simulated ones. To handle a variety of free-rider attack strategies, S2-WEF further combines this simulation-based similarity score with a deviation score computed from mutual comparisons among submitted WEFs, and separates benign and free-rider clients by two-dimensional clustering and per-score classification. This method enables dynamic detection of clients that transition into free-riders during training without proxy datasets or pre-training. We conduct extensive experiments across four datasets and five attack types, demonstrating that S2-WEF provides robust dynamic free-rider detection across diverse settings.
Figures & tables
| Algorithm | STD-DAGMM [ 6 ] | FRAD [ 7 ] | ZeTFRi [ 4 ] | CFFL [ 8 ] | RFFL [ 14 ] | WEF-Defense [ 9 ] | S2-WEF (ours) |
|---|---|---|---|---|---|---|---|
| No pre-training | |||||||
| No proxy datasets | |||||||
| Dynamic FR detection |
| Dataset | Dist. | Attack | WEF-Defense | WEF-na |
|---|---|---|---|---|
| MNIST | IID | RWA | ||
| SPA | ||||
| DWA | ||||
| ADWA | ||||
| Non-IID | RWA | |||
| SPA |
| Dataset | Dist. | WEF-Defense | WEF-na |
|---|---|---|---|
| MNIST | IID | ||
| Non-IID | |||
| Adult | IID | ||
| Non-IID | |||
| CIFAR-10 | IID | ||
| Non-IID |
| Dataset | Samples | Dimensions | Classes | Model | Learning rate | Momentum | Global rounds | Batch size |
|---|---|---|---|---|---|---|---|---|
| MNIST | 70,000 | 10 | LeNet | 0.005 | 0.0001 | 50 | 32 | |
| Adult | 23,374 | 14 | 2 | MLP | 0.0001 | 0.0001 | 50 | 32 |
| CIFAR-10 | 60,000 | 10 | ResNet | 0.01 | 0.9 | 80 | 32 | |
| CIFAR-100 | 60,000 | 100 | ResNet | 0.01 | 0.9 | 100 | 32 |
| Dataset | Dist. | Attack | STD-DAGMM | WEF-na | S2-WEF |
|---|---|---|---|---|---|
| MNIST | IID | RWA | |||
| SPA | |||||
| DWA | |||||
| ADWA | |||||
| AWCA | |||||
| Non-IID | RWA |
| Dataset | Dist. | Attack | STD-DAGMM | WEF-na | S2-WEF |
|---|---|---|---|---|---|
| CIFAR-10 | IID | RWA | |||
| SPA | |||||
| DWA | |||||
| ADWA | |||||
| AWCA | |||||
| Non-IID | RWA |
| Dataset | Attack | Variant | Precision | Recall | FPR |
|---|---|---|---|---|---|
| Adult | AWCA | only | |||
| only (cos) | |||||
| only (cos/ ) | |||||
| Clustering only | |||||
| Full pipeline | |||||
| SPA | only |
| Dataset | Clustering only | Full pipeline |
|---|---|---|
| Adult | ||
| CIFAR-10 |
| only | Full pipeline | |||||||
|---|---|---|---|---|---|---|---|---|
| Dataset | FR | Precision | Recall | F1 | Precision | Recall | F1 | |
| Adult | 10% | 1 | 0.399 | 1.000 | 0.567 | 0.913 | 1.000 | 0.953 |
| 2 | 0.481 | 1.000 | 0.649 | 0.913 | 1.000 | 0.953 | ||
| 3 | 0.556 | 1.000 | 0.713 | 0.913 | 1.000 | 0.953 | ||
| 4 | 0.694 | 0.993 | 0.805 | 0.913 | 1.000 | 0.953 | ||
| 5 | 0.777 | 0.993 | 0.865 | 0.913 | 1.000 | 0.953 | ||
| Dataset | FR ratio | Precision | Recall | F1 |
|---|---|---|---|---|
| Adult | 10% | 0.913 | 1.000 | 0.953 |
| 20% | 0.976 | 1.000 | 0.988 | |
| 30% | 0.971 | 1.000 | 0.985 | |
| 40% | 0.982 | 0.972 | 0.977 | |
| CIFAR-10 | 10% | 0.964 | 1.000 | 0.981 |
| 20% | 0.979 | 1.000 | 0.989 |
| Dataset | Clients | FRs | FR ratio | Precision | Recall | F1 |
|---|---|---|---|---|---|---|
| CIFAR-10 | 5 | 1 | 20% | 0.959 | 1.000 | 0.979 |
| 10 | 1 | 10% | 0.964 | 1.000 | 0.981 | |
| 20 | 2 | 10% | 0.983 | 1.000 | 0.992 | |
| 50 | 5 | 10% | 0.994 | 1.000 | 0.997 | |
| CIFAR-100 | 5 | 1 | 20% | 0.987 | 1.000 | 0.994 |
| 10 | 1 | 10% | 0.971 | 1.000 | 0.985 |
| Dataset | Setting | Accuracy (%) |
|---|---|---|
| Adult | No attack, no defense | |
| No attack, S2-WEF | ||
| 10% attackers, S2-WEF | ||
| CIFAR-10 | No attack, no defense | |
| No attack, S2-WEF | ||
| 10% attackers, S2-WEF |
Federated Learning
Federated learning trains shared models across data holders without requiring them to pool their raw data.
See all 943 papers