Federated Learning (FL), as a popular distributed learning paradigm, has shown outstanding performance in improving computational efficiency and protecting data privacy, and is widely applied in industrial image classification. However, due to its distributed nature, FL is vulnerable to threats from malicious clients, with poisoning attacks being a common threat. A major limitation of existing poisoning attack methods is their difficulty in bypassing model performance tests and defense mechanisms based on model anomaly detection. This often results in the detection and removal of poisoned models, which undermines their practical utility. To ensure both the performance of industrial image classification and attacks, we propose a targeted poisoning attack, PoiCGAN, based on feature-label collaborative perturbation. Our method modifies the inputs of the discriminator and generator in the Conditional Generative Adversarial Network (CGAN) to influence the training process, generating an ideal poison generator. This generator not only produces specific poisoned samples but also automatically performs label flipping. Experiments across various datasets show that our method achieves an attack success rate 83.97% higher than baseline methods, with a less than 8.87% reduction in the main task's accuracy. Moreover, the poisoned samples and malicious models exhibit high stealthiness.
Figures & tables
Figure 1: Workflow of PoiCGAN and core module PSG. The left side of the figure shows PoiCGAN’s workflow, comprising four steps: (1) poisoned sample generation, (2) local model training, (3) infection of the global model, and (4) model inference. In step (1), PSG generates poisoned samples by incorporating the target label as conditional input into both the discriminator and generator, as shown on the right side. The discriminator training includes: (a) “real source images + target label" to output real, (b) “real images from other classes" to output real, and (c) “fake images + target label" to output fake. The goal of (a) is to mislead the discriminator, guiding the generator to flip the label and produce source class images when conditioned on the target label.
Datasets
Labels
Size
Training
Testing
Models
Clean ACC
InsPLAD-fault
4
1281283
2250
146
ResNet-18
88.4%
NEU-CLS
6
1281281
1260
540
LeNet-5
94.4%
Kylberg
6
1281281
3920
560
ResNet-34
99.2%
Table 1: Datasets and models.
Defect types
Training samples
Testing samples
Missing-cap
270
30
Corrosion
740
33
Bird-nest
350
20
Rust (three types of assets)
310/290/290
20/23/20
Table 2: Data splitting details on InsPLAD-fault.
Generator
Discriminator
Name
Type
Filters
Size/stride
Name
Type
Filters
Size/stride
D1
deconv
512
4*4/1
C1
conv
128
4*4/2
B1
BN
-
-
B1
BN
-
-
D2
deconv
256
4*4/2
C2
conv
128
4*4/2
B2
BN
-
-
B2
BN
-
-
D3
deconv
256
4*4/2
C3
conv
256
4*4/2
Table 3: Network architecture of the generator and discriminator.
Table 4: Visualization of real samples and generated poisoned samples on various datasets.
Figure 2: Comparison of attack performance and main task performance across different methods on various datasets.
Figure 3: Visualization of the 2D local model on InsPLAD.
TDP
TMP
ADA
PoiCGAN
MIS
67.494881
58.172310
66.266571
375.224762
Table 5: Comparison of poisoned model stealthiness for different attacks on InsPLAD.
Figure 4: Effect of poisoned model rate on attack and main task performance.
Figure 5: Effect of training rounds on attack and main task performance.
Figure 6: Effect of scaling factor on attack and main task performance.
Datasets: Defenses
InsPLAD: FLAME
NEU-CLS: RLR
Kylberg: Krum
Attacks
TDP
TMP
ADA
PoiCGAN
TDP
TMP
ADA
PoiCGAN
TDP
TMP
ADA
PoiCGAN
ASR
8.7%
13.0%
8.7%
56.5%
25.0%
40.0%
55.0%
70.0%
15.0%
10.0%
25.0%
75.0%
ACC
88.6%
87.8%
86.2%
86.2%
88.0%
82.0%
85.0%
77.3%
86.9%
91.8%
86.3%
87.8%
Table 6: Performance of different attack methods under various defense mechanisms.
Department of Computer Science and Engineering Ahsanullah University of Science and Technology Dhaka, Bangladesh · Knight Foundation School of Computing and Information Sciences Florida International University Miami, FL, USA