Detecting and Eliminating Neural Network Backdoors Through Active Paths with Application to Intrusion Detection
Organizations: Norwegian Defence Research Establishment (FFI) Lillestrøm, Norway · Norwegian Defence Research Establishment (FFI) University of Oslo Lillestrøm, Norway · University of Edinburgh, UK University of Oslo, Norway · School of Informatics University of Edinburgh (UoE) Edinburgh, United Kingdom
Abstract
Machine learning backdoors have the property that the machine learning model should work as expected on normal inputs, but when the input contains a specific , it behaves as the attacker desires. Detecting such triggers has been proven to be extremely difficult. In this paper, we present a novel and explainable approach to detect and eliminate such backdoor triggers based on active paths found in neural networks. We present promising experimental evidence of our approach, which involves injecting backdoors into a machine learning model used for intrusion detection.
Figures & tables
| Value | Cluster 0 | Cluster 1 |
|---|---|---|
| 62 | 2’363 | 0 |
| 63 | 19’710 | 0 |
| 64 | 16’566 | 0 |
| 66 | 3 | 3233 |
| Backdoored model | Model after elimination | |||||
|---|---|---|---|---|---|---|
| Clean | Poisoned | Clean | Poisoned | |||
| 1 feature | All data | 99.29% | 97.79% | 99.30% | 98.72% | |
| Benign | 99.48% | 99.98% | 99.50% | 98.90% | ||
| Malicious | 91.34% | 5.19% | 90.91% | 90.91% | ||
| 2 features | All data | 99.37% | 97.68% | 99.51% | 99.74% | |
| Benign | 99.57% | 99.99% | 99.71% | 99.96% | ||
| TTL_min | TTL_max | |||
| Cluster 0 | Cluster 1 | Cluster 0 | Cluster 1 | |
| 61 | 430 | 3’143 | 0 | 0 |
| 62 | 2’089 | 0 | 2’089 | 0 |
| 63 | 19’314 | 0 | 19’314 | 0 |
| 64 | 16’424 | 0 | 16’424 | 0 |
| 66 | 0 | 0 | 430 | 3’143 |
Backdoor Detection
Backdoor detection finds hidden triggers or poisoned behavior in trained models before they can secretly redirect predictions or actions.
See all 53 papers