Quiet Triggers, Loud Footprints: A Tri-Space Measurement Study of Backdoor Stealthiness
Organizations: Radboud University, Nijmegen, The Netherlands · University of Zagreb Faculty of Electrical Engineering and Computing, Zagreb, Croatia
Abstract
Backdoor attacks on deep neural networks are commonly evaluated by attack success rate and benign accuracy, yet their stealthiness remains inconsistently defined and measured. Existing work often studies only one observable aspect of stealthiness, such as trigger imperceptibility, feature-space separability, parameter-space concentration, or evasion of particular defenses. This creates a fragmented picture: an attack may appear stealthy under one metric while leaving conspicuous footprints elsewhere. This paper presents a tri-space measurement study of backdoor stealthiness in image classification. We distinguish latent stealthiness---the ideal but unobservable difficulty of distinguishing a backdoored system from a benign one---from measurable footprints in three spaces: input, feature, and parameter space. Under this framework, we evaluate representative backdoor attacks across four datasets and three model architectures using a broad suite of footprint metrics. Our results show that stealthiness is not monolithic: attacks that are quiet in one space are often loud in another, and existing attacks rarely achieve consistently small footprints across all three spaces. We further analyze agreement and disagreement among stealthiness metrics and study how footprint measurements interact with attack success rate. Based on observed blind spots in existing measurements, we introduce two diagnostic metrics: Class-Specific Davies--Bouldin Index (CDBI), which captures class-conditional feature overlap, and TAC--UCLC Product (TUP), which identifies channels that are both trigger-responsive and downstream influential. These metrics are intended to augment, not replace, the broader measurement suite. Finally, we provide practical guidance for future stealthiness evaluations.
Figures & tables
| Space | Metrics | Captures |
|---|---|---|
| Input | , , , MSE, PSNR | Pixel-level distortion |
| Input | SSIM, LPIPS, pHash, IS, SAM | Structural/perceptual/semantic change |
| Feature | SS, DSWD | Cluster separability and distribution shift |
| Feature | CDBI | Class-conditional feature overlap |
| Parameter | UCLC, TAC | Channel influence and trigger response |
| Parameter | TUP | Joint trigger response and influence |
| Attack | PR (%) | C10 | C100 | Tiny | Imagenette | ||||
|---|---|---|---|---|---|---|---|---|---|
| BA | ASR | BA | ASR | BA | ASR | BA | ASR | ||
| Benign | - | 94.7 | - | 73.3 | - | 59.21 | - | 87.7 | - |
| BadNets | 5 | 94.5 | 100 | 72.9 | 100 | 58.37 | 99.97 | 88.3 | 100 |
| 0.3 | 94.7 | 100 | 73.5 | 99.8 | 59.12 | 94.04 | 88.1 | 86.7 | |
| Blend | 5 | 94.3 | 99.8 | 72.4 | 99.7 | 58.24 | 99.38 | 88.6 | 98.9 |
| 0.3 | 94.8 | 94.8 | 73.6 | 88.6 | 58.74 | 84.22 | 88.6 | 73.5 | |
| Attack family | Input | Feature | Parameter |
|---|---|---|---|
| Patch/blend | Low–mixed | High | High |
| Imperceptible | Low | Mixed | Mixed–high |
| Adaptive | Mixed | Low | Mixed |
| Clean-label | High | Low–mixed | Low |
| Supply-chain | Mixed | High | Mixed–high |
| Dataset | Metric | MSE | PSNR | SSIM | LPIPS | IS | pHash | SAM | |||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Ideal value | 0 | 0 | 0 | 0 | 1 | 0 | 0 | 100 | 0 | ||
| CIFAR-10 | BadNets | 13.2 | 2.84 | 0.811 | 2.64e-3 | 25.8 | 0.956 | 4.41e-3 | 0.170 | 95.2 | 1.44e-3 |
| Blend | 230 | 4.92 | 0.191 | 8.01e-3 | 21.0 | 0.784 | 0.0483 | 2.37 | 89.8 | 0.0830 | |
| WaNet | 46.5 | 1.42 | 0.173 | 7.17e-4 | 31.5 | 0.978 | 4.32e-3 | 0.270 | 96.1 | 0.0119 | |
| BppAttack | 24.6 | 0.525 | 0.0196 | 8.97e-5 | 40.5 | 0.992 | 1.94e-4 | 0.150 | 99.2 | 0.0239 | |
| Adap-Patch (train) | 22.5 | 2.06 | 0.315 | 1.53e-3 | 28.7 | 0.972 | 4.78e-3 | 0.296 | 95.2 | 9.43e-3 |
| Model | PR (%) | C10 | C100 | Tiny | Imagenette | ||||
|---|---|---|---|---|---|---|---|---|---|
| SS | DSWD | SS | DSWD | SS | DSWD | SS | DSWD | ||
| BadNets | 5 | 0.507 | 2.01 | 0.511 | 1.27 | 0.295 | 1.067 | 0.588 | 1.78 |
| 0.3 | 0.355 | 2.54 | 0.462 | 1.29 | 0.463 | 1.145 | 0.260 | 1.49 | |
| Blend | 5 | 0.473 | 2.05 | 0.435 | 1.27 | 0.339 | 1.339 | 0.022 | 1.60 |
| 0.3 | 0.276 | 2.08 | 0.379 | 1.32 | 0.423 | 1.236 | 0.097 | 1.27 | |
| WaNet | 5 | 0.382 | 1.83 | 0.492 | 1.21 | 0.342 | 1.301 | 0.557 | 1.73 |
| Model | PR (%) | C10 | C100 | Tiny | Imagenette | ||||
|---|---|---|---|---|---|---|---|---|---|
| UCLC | TAC | UCLC | TAC | UCLC | TAC | UCLC | TAC | ||
| Benign | - | 6.09 | - | 4.92 | - | 4.19 | - | 5.31 | - |
| BadNets | 5 | 6.59 | 3.90 | 4.64 | 7.32 | 4.52 | 21.34 | 6.22 | 15.3 |
| 0.3 | 7.99 | 8.03 | 5.86 | 9.17 | 4.57 | 38.89 | 5.39 | 18.4 | |
| Blend | 5 | 6.49 | 3.05 | 4.73 | 6.46 | 4.54 | 23.87 | 4.99 | 6.24 |
| 0.3 | 5.76 | 4.30 | 4.92 | 9.69 | 4.85 | 25.31 | 5.37 | 6.04 | |
| Attack | ResNet18 | VGG16 | ViT-Small | |||
|---|---|---|---|---|---|---|
| BA | ASR | BA | ASR | BA | ASR | |
| Benign | 94.7 | – | 93.50 | – | 80.62 | – |
| BadNets | 94.5 | 100 | 93.45 | 100 | 80.94 | 100 |
| Blend | 94.3 | 99.8 | 93.43 | 99.66 | 81.10 | 98.96 |
| WaNet | 93.4 | 98.5 | 88.94 | 99.40 | 79.00 | 22.12 |
| BppAttack | 94.4 | 99.8 | 93.08 | 59.52 | 79.29 | 3.47 |
| Attack | VGG16 | ViT-Small | ||
|---|---|---|---|---|
| SS | DSWD | SS | DSWD | |
| Badnet | .515 | 2.784 | .263 | 2.719 |
| Blended | .524 | 2.712 | .433 | 2.637 |
| Wanet | .398 | 1.978 | .195 | .290 |
| Bpp | .330 | 1.171 | .174 | .022 |
| Adap-P | .257 | .742 | .220 | .609 |
| Model | PR | CIFAR-10 | CIFAR-100 | Imagenette | |||
|---|---|---|---|---|---|---|---|
| UCLC | TAC | UCLC | TAC | UCLC | TAC | ||
| Benign | – | 7.75 | – | 4.63 | – | 4.66 | – |
| Narcissus | 5/0.7/5 ∗ | 13.5 | 1.39 | 4.74 | 1.98 | 6.67 | 1.89 |
| Grond | 5/0.7/5 ∗ | 4.12 | .608 | 4.77 | 1.74 | 3.78 | 1.04 |
| DFBA | – | 20.7 | 5.67 | 15.7 | 13.0 | 19.1 | 58.3 |
| Model | PR (%) | C10 | C100 | Tiny | Imagenette | ||||
|---|---|---|---|---|---|---|---|---|---|
| CDBI | TUP | CDBI | TUP | CDBI | TUP | CDBI | TUP | ||
| BadNets | 5 | 0.574 | 16.2 | 0.424 | 27.7 | 0.646 | 10.227 | 0.418 | 18.4 |
| 0.3 | 0.627 | 23.1 | 0.534 | 29.6 | 0.624 | 3.895 | 0.871 | 19.3 | |
| Blend | 5 | 0.738 | 3.68 | 0.620 | 10.2 | 0.53 | 3.885 | 3.07 | 3.30 |
| 0.3 | 0.796 | 3.94 | 0.911 | 10.8 | 0.576 | 3.407 | 2.20 | 2.77 | |
| WaNet | 5 | 0.641 | 9.30 | 0.409 | 25.4 | 0.523 | 7.078 | 0.571 | 8.85 |
| Case | Observation | Interpretation |
|---|---|---|
| WaNet vs. SS | Poisoned samples split by source class | CDBI checks class-conditional overlap |
| DFBA vs. TUP | High UCLC/TAC but layer-dependent TUP | TUP depends on analyzed layer |
| Low-ASR attacks | Small footprints can coincide with failed backdoors | Interpret with ASR |
| Metric group | Within-dataset | Pooled |
|---|---|---|
| Input–Input | +0.69 | +0.66 |
| Feature–Feature | +0.61 | +0.57 |
| Parameter–Parameter | +0.50 | +0.27 |
| Input–Feature | ||
| Input–Parameter | ||
| Feature–Parameter | +0.42 | +0.35 |
| Conclusion | All configs | ASR 60% | ASR 80% |
|---|---|---|---|
| Smallest input-space footprint | BppAttack | BppAttack | BppAttack |
| Smallest feature-space footprint | Adap-Patch | Adap-Patch | Adap-Patch |
| Smallest parameter-space footprint | Grond | Grond | Grond |
| Same attack best in all three spaces? | No | No | No |
| Most balanced attack (min worst space) | Grond ( ) | Grond ( ) | Grond ( ) |
| CDBI top-ranked attack | Narcissus | Narcissus | Narcissus |
| Defense type | Defenses | Output | Main use |
|---|---|---|---|
| Input-trigger reconstruction | Neural Cleanse [ 11 ] , TABOR [ 12 ] , BAN [ 13 ] | Reversed trigger norm / anomaly | Input-footprint check |
| Feature/sample detection | SPECTRE [ 14 ] , Spectral Signatures [ 15 ] , STRIP [ 16 ] , BTI-DBF [ 17 ] | F1 or detected samples | Feature/input-footprint check |
| Model repair/mitigation | CLP [ 18 ] , FeatureRE [ 19 ] , I-BAU [ 20 ] | Post-defense ASR | Parameter/behavioral check |
| Component | Purpose |
|---|---|
| Attack wrapper | Normalizes trigger generation, poisoned data, and attack metadata |
| Model wrapper | Standardizes prediction, feature extraction, and parameter access |
| Metric API | Computes input-, feature-, and parameter-space footprint values |
| Run schema | Stores BA, ASR, metrics, configurations, and reproducibility metadata |
| Aggregation scripts | Produce benchmark tables and derived analyses from saved runs |
| Extension hooks | Allow new attacks or metrics to be added under the same protocol |
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Family | Attack | Access | Trigger | Input | Feature | Param. |
|---|---|---|---|---|---|---|
| Patch/blend | BadNets | data | patch | 0.37 | 0.70 | 0.69 |
| Blend | data | blended image | 0.62 | 0.59 | 0.45 | |
| Imperceptible | WaNet | training | warping | 0.31 | 0.56 | 0.69 |
| BppAttack | training | quantization | 0.15 | 0.67 | 0.70 | |
| Adaptive | Adap-Patch | data | patches | 0.57 | 0.23 | 0.52 |
| Adap-Blend | data | blended image | 0.69 | 0.34 | 0.40 |
| Metrics | Clean data | Trigger | Poisoned samples | Model | Benign model |
|---|---|---|---|---|---|
| , , , MSE, PSNR, SSIM, pHash, SAM | ✓ | ✓ | – | – | – |
| LPIPS, IS | ✓ | ✓ | – | R | – |
| SS, CDBI | ✓ | – | ✓ | A | – |
| DSWD | ✓ | ✓ | – | A, W | – |
| UCLC | – | – | – | W | – |
| TAC | ✓ | ✓ | – | A | – |
| Metric | CV (seeds) | (seeds) | (targets) |
|---|---|---|---|
| SS | 2.9% | 0.60 | 1.00 |
| CDBI | 6.0% | 0.27 | 0.78 |
| DSWD | 1.4% | 0.33 | 1.00 |
| UCLC | 16.6% | 0.33 | |
| TAC | 16.5% | 0.67 | 0.78 |
| TUP | 6.9% | 1.00 | 1.00 |
| Metric group | All ( ) | ASR ( ) |
|---|---|---|
| Input–Input | [ ] | [ ] |
| Feature–Feature | [ ] | [ ] |
| Parameter–Parameter | [ ] | [ ] |
| Input–Feature | [ ] | [ ] |
| Input–Parameter | [ ] | [ ] |
| Feature–Parameter | [ ] | [ ] |
| Attack | 60% | 80% | Attack | 60% | 80% |
|---|---|---|---|---|---|
| BadNets | 8 | 8 | Adap-Blend | 6 | 6 |
| Blend | 8 | 7 | DFST | 8 | 8 |
| WaNet | 8 | 7 | Narcissus | 6 | 5 |
| BppAttack | 6 | 4 | Grond | 5 | 1 |
| Adap-Patch | 2 | 1 | DFBA | 4 | 4 |
| Metric | Attack | Runs (range) | Others (best) |
|---|---|---|---|
| SS | Adap-Patch | 0.02–0.20 | 0.37 |
| CDBI | Adap-Patch | 1.42–10.76 | 0.73 |
| UCLC | Grond | 3.44–4.60 | 6.04 |
| TUP | Grond | 1.68–1.87 | 3.61 |
| C10 | C100 | Imagenette | |
|---|---|---|---|
| t-SNE seeds (lowest mean) | 0.98 | 0.93 | 0.97 |
| All representations vs. Table X | 0.92 | 0.89 | 0.93 |
| t-SNE vs. raw features | 0.52 | 0.53 | 0.84 |
| Variation of values | 12% | 14% | 12% |
Backdoor Attacks
Backdoor attacks implant hidden, trigger-dependent behaviors in models while aiming to preserve normal performance.
See all 135 papers