STAR-FL: Secure Federated Learning with Spatial-Temporal Analysis and Robust Aggregation
Authors: Nawrin Tabassum, Yanzhao Wu
Organizations: Department of Computer Science and Engineering Ahsanullah University of Science and Technology Dhaka, Bangladesh · Knight Foundation School of Computing and Information Sciences Florida International University Miami, FL, USA
Data poisoning attacks pose serious security threats to Federated Learning (FL) systems in Computer Vision. Despite growing research attention, two key challenges remain for existing defense techniques: (1) accurately distinguishing between benign and malicious model updates and (2) effectively mitigating the influence of poisoned model updates during model aggregation. To address these challenges, we propose a novel defense framework against targeted poisoning attacks with Spatial-Temporal Analysis and Robust aggregation for FL (STAR-FL). First, we employ spatial-temporal clustering to identify and remove potentially malicious updates from the FL training process. Second, we adjust the learning rate during aggregation to mitigate the impact of any malicious updates that evade detection. Third, we conduct extensive experiments across multiple benchmark datasets to evaluate the spatial-temporal analysis and robust aggregation in STAR-FL. Experimental results demonstrate their synergistic effect in enabling STAR-FL to effectively protect FL and consistently outperform state-of-the-art defenses against targeted poisoning attacks, significantly reducing Attack Success Rates (ASRs). The source code is available at https://github.com/mlsysx/STAR-FL.
Figures & tables
Fig. 1 : Poisoned image examples from FMNIST (top) and CIFAR-10 (bottom) datasets. A plus pattern is inserted as a trigger in the top left of the images.
Mtk=∑i∈htsign(ΔWtki)
Algorithm 1 STAR-FL Framework
SCp=avg∥Vi∥∥Vj∥Vi⋅Vj;∀i,j∈Cp,i=j
Algorithm 2 DetectMaliciousClients
Fig. 2 : PCA visualization of benign (green) and malicious (red) updates over all communication rounds with m =10%.
Fig. 3 : Kernel Density Estimation plots at round 30 and 15 for the FMNIST dataset (top), and at round 90 and 45 for the CIFAR-10 dataset (bottom).
Dataset
% of Malicious Clients
MA (%)( ↑ )
BA (%)( ↑ )
ASR (%)( ↓ )
FMNIST
10
91.49
97.50
2.30
20
90.94
97.10
2.90
30
89.96
96.80
3.60
CIFAR-10
10
74.63
57.70
3.20
20
74.61
59.40
3.90
30
72.58
52.60
4.10
TABLE I : Main task accuracy, base class accuracy, and attack success rate with different percentages of malicious clients. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
FMNIST
CIFAR-10
CIFAR-100
Defense
Main Task Accuracy (%)( ↑ )
Attack Success Rate (%)( ↓ )
Main Task Accuracy (%)( ↑ )
Attack Success Rate (%)( ↓ )
Main Task Accuracy (%)( ↑ )
Attack Success Rate (%)( ↓ )
No Attack
92.52
N/A
78.63
N/A
59.31
N/A
FedAvg [ 1 ]
92.33
100.0
78.11
77.50
59.25
52.00
RFA [ 17 ]
92.41
100.0
78.40
78.80
55.68
47.00
Trimmed Mean [ 19 ]
92.29
99.50
77.02
68.90
57.90
44.00
Median [ 19 ]
91.31
77.40
72.38
66.00
42.81
34.00
TABLE II : Effectiveness of our proposed defense compared to existing defenses. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
Dataset
Defense
MA (%)( ↑ )
BA (%)( ↑ )
ASR (%)( ↓ )
FMNIST
Spatial
92.10
98.29
2.00
Temporal
92.18
98.79
1.90
Spat.+Temp.
92.19
98.19
2.60
CIFAR-10
Spatial
78.22
69.20
4.60
Temporal
78.26
67.69
6.50
Spat.+Temp.
78.01
63.80
4.20
TABLE III : Main task accuracy, base class accuracy, and attack success rate under different combinations of spatial and temporal filtering. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
Dataset
Defense
MA (%)( ↑ )
BA (%)( ↑ )
ASR (%)( ↓ )
FMNIST
Spat.+Robust
91.34
97.60
2.80
Temp.+Robust
91.29
97.89
2.70
Robust
91.32
96.79
1.30
CIFAR-10
Spat.+Robust
73.95
53.10
4.60
Temp.+Robust
73.97
58.99
6.10
Robust
75.32
57.40
4.70
TABLE IV : Main task accuracy, base class accuracy, and attack success rate under different combinations of spatial-temporal filtering and robust aggregation. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
α
% of malicious clients
FMNIST
CIFAR-10
Main Task Accuracy (%)( ↑ )
Attack Success Rate (%)( ↓ )
Main Task Accuracy (%)( ↑ )
Attack Success Rate (%)( ↓ )
0.5
10
79.32
2.50
46.15
3.20
20
78.16
6.10
42.19
7.80
30
79.24
20.10
42.68
13.00
1.0
10
88.91
2.10
58.05
8.40
20
86.56
4.10
52.43
11.60
TABLE V : Main task accuracy and attack success rate under various data heterogeneity. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
Attack
Dataset
MA (%)( ↑ )
BA (%)( ↑ )
ASR (%)( ↓ )
MRA
FMNIST
89.32
96.10
3.60
CIFAR-10
74.40
58.89
3.30
DBA
FMNIST
89.62
96.70
3.20
CIFAR-10
73.43
55.10
5.10
MRA+DBA
FMNIST
89.39
95.49
3.63
CIFAR-10
75.54
58.79
4.30
TABLE VI : Main task accuracy, base class accuracy, and attack success rate under different attacks. ↑ denotes better performance with higher values, and ↓ denotes better performance with lower values.
Fig. 4 : Training time and GPU usage overhead of STAR-FL compared to baseline methods on CIFAR-10.
Split Federated Learning (SFL) facilitates privacy-preserving collaborative training with reduced client-side overhead. However, its split architecture introduces unique attack surfaces, rendering it vulnerable to diverse poisoning attacks. Most existing defenses fail to exploit the split paradigm, limiting their ability to detect and contain malicious behaviors at an early stage. To bridge this gap, we propose Target-Oriented Feature Decoupling (TOFD), a unified framework that jointly enables proactive detection and robust optimization against a wide range of poisoning attacks. TOFD operates in three stages: (1) Target Inference, which identifies potential attack targets by refining class-wise safe zones via class-specific Margin Perturbation (MP); (2) Sample Purification, which adaptively filters poisoned smashed data using thresholds calibrated through cross-class min-max normalization of MP; and (3) Decoupling Optimization, which leverages an adversarial guidance model to capture attack-induced patterns and decouple their influence during optimization, thereby suppressing residual adversarial effects. We provide theoretical guarantees for the convergence of TOFD. Extensive experiments on five datasets demonstrate that TOFD consistently outperforms state-of-the-art defenses under diverse attack scenarios, achieving superior robustness with low computational overhead suitable for practical deployment.
Yuhan Xie, Jingrong Huang, Chen Lyu
Shanghai University of Finance and Economics MoE Key Laboratory of Interdisciplinary Research of Computation and Economics Shanghai, China
Federated Learning (FL), as a popular distributed learning paradigm, has shown outstanding performance in improving computational efficiency and protecting data privacy, and is widely applied in industrial image classification. However, due to its distributed nature, FL is vulnerable to threats from malicious clients, with poisoning attacks being a common threat. A major limitation of existing poisoning attack methods is their difficulty in bypassing model performance tests and defense mechanisms based on model anomaly detection. This often results in the detection and removal of poisoned models, which undermines their practical utility. To ensure both the performance of industrial image classification and attacks, we propose a targeted poisoning attack, PoiCGAN, based on feature-label collaborative perturbation. Our method modifies the inputs of the discriminator and generator in the Conditional Generative Adversarial Network (CGAN) to influence the training process, generating an ideal poison generator. This generator not only produces specific poisoned samples but also automatically performs label flipping. Experiments across various datasets show that our method achieves an attack success rate 83.97% higher than baseline methods, with a less than 8.87% reduction in the main task's accuracy. Moreover, the poisoned samples and malicious models exhibit high stealthiness.
Tao Liu, Jiguang Lv, Dapeng Man +7
College of Computer Science and Technology, Harbin Engineering University, Harbin, 150001, China
Federated learning systems are increasingly threatened by data poisoning attacks, where malicious clients compromise global models by contributing tampered updates. Existing defenses often rely on impractical assumptions, such as access to a central test dataset, or fail to generalize across diverse attack types, particularly those involving multiple malicious clients working collaboratively. To address this, we propose Federated Noise-Induced Activation Analysis (FedNIA), a novel defense framework to identify and exclude adversarial clients without relying on any central test dataset. FedNIA injects random noise inputs to analyze the layerwise activation patterns in client models leveraging an autoencoder that detects abnormal behaviors indicative of data poisoning. FedNIA can defend against diverse attack types, including sample poisoning, label flipping, and backdoors, even in scenarios with multiple attacking nodes. Experimental results on non-iid federated datasets demonstrate its effectiveness and robustness, underscoring its potential as a foundational approach for enhancing the security of federated learning systems.
Ehsan Hallaji, Roozbeh Razavi-Far, Mehrdad Saif
Department of Electrical and Computer Engineering, University of Windsor, Windsor ON, Canada · Faculty of Computer Science, University of New Brunswick, Fredericton NB, Canada