Organizations: Department of Computer and Software Engineering, Polytechnique Montréal, Montreal, Quebec, Canada · Department of Computer Science, Khalifa University, Abu Dhabi, UAE · Artificial Intelligence & Cyber Systems Research Center, Department of CSM, Lebanese American University · KU 6G Research Center, Department of Computer Science, Khalifa University, Abu Dhabi, UAE · Concordia Institute for Information Systems Engineering, Concordia University, Montreal, Quebec, Canada
Backdoor attacks pose a significant threat to the integrity and reliability of Artificial Intelligence (AI) models, enabling adversaries to manipulate model behavior by injecting poisoned data with hidden triggers. These attacks can lead to severe consequences, especially in critical applications such as autonomous driving, healthcare, and finance. Detecting and mitigating backdoor attacks is crucial across the lifespan of model's phases, including pre-training, in-training, and post-training. In this paper, we propose Pre-Training Backdoor Mitigation for Federated Learning (FL-PBM), a novel defense mechanism that proactively filters poisoned data on the client side before model training in a federated learning (FL) environment. The approach consists of three stages: (1) inserting a benign trigger into the data to establish a controlled baseline, (2) applying Principal Component Analysis (PCA) to extract discriminative features and assess the separability of the data, (3) performing Gaussian Mixture Model (GMM) clustering to identify potentially malicious data samples based on their distribution in the PCA-transformed space, and (4) applying a targeted blurring technique to disrupt potential backdoor triggers. Together, these steps ensure that suspicious data is detected early and sanitized effectively, thereby minimizing the influence of backdoor triggers on the global model. Experimental evaluations on image-based datasets demonstrate that FL-PBM reduces attack success rates by up to 95% compared to baseline federated learning (FedAvg) and by 30 to 80% relative to state-of-the-art defenses (RDFL and LPSF). At the same time, it maintains over 90% clean model accuracy in most experiments, achieving better mitigation without degrading model performance.
Figures & tables
Symbol
Description
N
Number of participating clients
Di
Local dataset of client i
Gt
Global model at communication round t
Λit
Local model of client i at round t
L(⋅)
Local loss function
η
Local learning rate
TABLE I: List of key symbols used in problem formulation.
Fig. 1: Overview of the proposed client-side preprocessing pipeline for backdoor mitigation in federated learning. The main components include dataset preprocessing, benign trigger augmentation, dimensionality reduction, clustering, and selective sanitization.
Fig. 2: Model accuracy of different approaches over the normal task across datasets and distributions over 200 rounds. The color mapping for defense strategies is AVG (orange), LPSF (red), RDFL (green), FL-PBM (blue)
Fig. 3: Model accuracy of different approaches over the malicious task across datasets and distributions for 200 rounds. The color mapping for defense strategies is AVG (orange), LPSF (red), RDFL (green), FL-PBM (blue)
Osama Wehbi is a Ph.D. candidate in the Department of Computer and Software Engineering at Polytechnique Montreal, Canada. His primary research areas include cybersecurity, federated learning, and game theory.
Table 5
Sarhad Arisdakessian is a PhD candidate in the Department of Computer and Software Engineering at Polytechnique Montreal, Canada. His primary research interests lie in the fields of Federated Learning and Game Theory.
Table 6
Omar Abdel Wahab holds an assistant professor position with the Department of Computer and Software Engineering, Polytechnique Montreal, Canada. His current research activities are in the areas of cybersecurity, Internet of Things and artificial intelligence.
Table 7
Azzam Mourad is a professor of Computer Science with Khalifa University Abu Dhabi, UAE. His research interests include the domains of cloud computing, Artificial intelligence, and Cybersecurity.
Table 8
Hadi Otrok is a professor and chair of the Department of EECS at Khalifa University, Abu Dhabi, UAE. His research interests include the domains of computer and network security, crowd sensing and sourcing, ad hoc networks, and cloud security.
Table 9
Jamal Bentahar is a professor of Computer Science with Khalifa University Abu Dhabi, UAE. His research interests include reinforcement and deep learning, multi-agent systems, computational logics, and service computing
Department of Computer and Software Engineering, Polytechnique Montréal, Montreal, Quebec, Canada · Institut national de la recherche scientifique (INRS-EMT), Montréal, Canada · Department of Computer Science, Khalifa University, Abu Dhabi, UAE +1
Department of Computer and Software Engineering, Polytechnique Montréal, Montreal, Quebec, Canada · Department of Computer Science, Khalifa University, Abu Dhabi, UAE
School of Electrical and Computer Engineering, University of Tehran, Tehran, Iran. · School of Computer Science, Institute for Research in Fundamental Sciences (IPM), Tehran, Iran. · School of Electrical and Computer Engineering, Shiraz University, Shiraz, Iran. +1