Federated Learning (FL), as a popular distributed learning paradigm, has shown outstanding performance in improving computational efficiency and protecting data privacy, and is widely applied in industrial image classification. However, due to its distributed nature, FL is vulnerable to threats from malicious clients, with poisoning attacks being a common threat. A major limitation of existing poisoning attack methods is their difficulty in bypassing model performance tests and defense mechanisms based on model anomaly detection. This often results in the detection and removal of poisoned models, which undermines their practical utility. To ensure both the performance of industrial image classification and attacks, we propose a targeted poisoning attack, PoiCGAN, based on feature-label collaborative perturbation. Our method modifies the inputs of the discriminator and generator in the Conditional Generative Adversarial Network (CGAN) to influence the training process, generating an ideal poison generator. This generator not only produces specific poisoned samples but also automatically performs label flipping. Experiments across various datasets show that our method achieves an attack success rate 83.97% higher than baseline methods, with a less than 8.87% reduction in the main task's accuracy. Moreover, the poisoned samples and malicious models exhibit high stealthiness.
Figures & tables
Figure 1: Workflow of PoiCGAN and core module PSG. The left side of the figure shows PoiCGAN’s workflow, comprising four steps: (1) poisoned sample generation, (2) local model training, (3) infection of the global model, and (4) model inference. In step (1), PSG generates poisoned samples by incorporating the target label as conditional input into both the discriminator and generator, as shown on the right side. The discriminator training includes: (a) “real source images + target label" to output real, (b) “real images from other classes" to output real, and (c) “fake images + target label" to output fake. The goal of (a) is to mislead the discriminator, guiding the generator to flip the label and produce source class images when conditioned on the target label.
Datasets
Labels
Size
Training
Testing
Models
Clean ACC
InsPLAD-fault
4
1281283
2250
146
ResNet-18
88.4%
NEU-CLS
6
1281281
1260
540
LeNet-5
94.4%
Kylberg
6
1281281
3920
560
ResNet-34
99.2%
Table 1: Datasets and models.
Defect types
Training samples
Testing samples
Missing-cap
270
30
Corrosion
740
33
Bird-nest
350
20
Rust (three types of assets)
310/290/290
20/23/20
Table 2: Data splitting details on InsPLAD-fault.
Generator
Discriminator
Name
Type
Filters
Size/stride
Name
Type
Filters
Size/stride
D1
deconv
512
4*4/1
C1
conv
128
4*4/2
B1
BN
-
-
B1
BN
-
-
D2
deconv
256
4*4/2
C2
conv
128
4*4/2
B2
BN
-
-
B2
BN
-
-
D3
deconv
256
4*4/2
C3
conv
256
4*4/2
Table 3: Network architecture of the generator and discriminator.
Table 4: Visualization of real samples and generated poisoned samples on various datasets.
Figure 2: Comparison of attack performance and main task performance across different methods on various datasets.
Figure 3: Visualization of the 2D local model on InsPLAD.
TDP
TMP
ADA
PoiCGAN
MIS
67.494881
58.172310
66.266571
375.224762
Table 5: Comparison of poisoned model stealthiness for different attacks on InsPLAD.
Figure 4: Effect of poisoned model rate on attack and main task performance.
Figure 5: Effect of training rounds on attack and main task performance.
Figure 6: Effect of scaling factor on attack and main task performance.
Datasets: Defenses
InsPLAD: FLAME
NEU-CLS: RLR
Kylberg: Krum
Attacks
TDP
TMP
ADA
PoiCGAN
TDP
TMP
ADA
PoiCGAN
TDP
TMP
ADA
PoiCGAN
ASR
8.7%
13.0%
8.7%
56.5%
25.0%
40.0%
55.0%
70.0%
15.0%
10.0%
25.0%
75.0%
ACC
88.6%
87.8%
86.2%
86.2%
88.0%
82.0%
85.0%
77.3%
86.9%
91.8%
86.3%
87.8%
Table 6: Performance of different attack methods under various defense mechanisms.
In a federated learning setup for GANs, several adversarial attacks are possible. One such attack is label flipping, in which malicious clients deliberately alter label information during local training in order to manipulate the global generator. The objective of this attack is to skew the learned generation distribution so that samples conditioned on a target label are instead mapped to a source class. In this work, we investigate the effectiveness of label flipping attacks in federated GANs through both theoretical analysis and empirical evaluation. We further consider an oversampling based variant, in which malicious clients upweight poisoned samples during local training to amplify their influence on the aggregated global model. We quantify the resulting distributional shift by computing the Kullback Leibler divergence between the clean and poisoned class conditional distributions, and show both analytically and on FEMNIST, MNIST, and CIFAR10 that the semantic damage of the attack grows linearly in the effective poisoning strength while deviation from the true target distribution grows only quadratically, making the attack effective yet difficult to detect from label agnostic metrics.
Panav Shah, Avishek Ghosh
Indian Institute of Technology, Bombay Mumbai, India
Model poisoning attacks pose a significant security threat to Federated Learning (FL). Most existing model poisoning attacks rely on collusion, requiring adversarial clients to coordinate by exchanging local benign models and synchronizing the generation of their poisoned updates. However, sustaining such coordination is increasingly impractical in real-world FL deployments, as it effectively requires botnet-like control over many devices. This approach is costly to maintain and highly vulnerable to detection. This context raises a fundamental question: Can model poisoning attacks remain effective without any communication between attackers? To address this challenge, we introduce and formalize the non-collusive attack model, in which all compromised clients share a common adversarial objective but operate independently. Under this model, each attacker generates its malicious update without communicating with other adversaries, accessing other clients' updates, or relying on any knowledge of server-side defenses. To demonstrate the feasibility of this threat model, we propose XFED, the first aggregation-agnostic, non-collusive model poisoning attack. Our empirical evaluation across six benchmark datasets shows that XFED bypasses eight state-of-the-art defenses and outperforms six existing model poisoning attacks. These findings indicate that FL systems are substantially less secure than previously believed and underscore the urgent need for more robust and practical defense mechanisms.
Israt Jahan Mouri, Muhammad Ridowan, Muhammad Abdullah Adnan
Bangladesh University of Engineering and Technology (BUET), Dhaka, Bangladesh · TigerIT Bangladesh Ltd., Dhaka, Bangladesh
Data poisoning attacks pose serious security threats to Federated Learning (FL) systems in Computer Vision. Despite growing research attention, two key challenges remain for existing defense techniques: (1) accurately distinguishing between benign and malicious model updates and (2) effectively mitigating the influence of poisoned model updates during model aggregation. To address these challenges, we propose a novel defense framework against targeted poisoning attacks with Spatial-Temporal Analysis and Robust aggregation for FL (STAR-FL). First, we employ spatial-temporal clustering to identify and remove potentially malicious updates from the FL training process. Second, we adjust the learning rate during aggregation to mitigate the impact of any malicious updates that evade detection. Third, we conduct extensive experiments across multiple benchmark datasets to evaluate the spatial-temporal analysis and robust aggregation in STAR-FL. Experimental results demonstrate their synergistic effect in enabling STAR-FL to effectively protect FL and consistently outperform state-of-the-art defenses against targeted poisoning attacks, significantly reducing Attack Success Rates (ASRs). The source code is available at https://github.com/mlsysx/STAR-FL.
Nawrin Tabassum, Yanzhao Wu
Department of Computer Science and Engineering Ahsanullah University of Science and Technology Dhaka, Bangladesh · Knight Foundation School of Computing and Information Sciences Florida International University Miami, FL, USA