Poisoned Acoustics
Organizations: CTO and Partner, Hack VC
Abstract
Training-data poisoning attacks can induce targeted, undetectable failure in deep neural networks by corrupting a vanishingly small fraction of training labels. We demonstrate this on acoustic vehicle classification using the MELAUDIS urban intersection dataset (approx. 9,600 audio clips, 6 classes): a compact 2-D convolutional neural network (CNN) trained on log-mel spectrograms achieves 95.7% Attack Success Rate (ASR) -- the fraction of target-class test samples misclassified under the attack -- on a Truck-to-Car label-flipping attack at just p=0.5% corruption (48 records), with zero detectable change in aggregate accuracy (87.6% baseline; 95% CI: 88-100%, n=3 seeds). We prove this stealth is structural: the maximum accuracy drop from a complete targeted attack is bounded above by the minority class fraction (beta). For real-world class imbalances (Truck approx. 3%), this bound falls below training-run noise, making aggregate accuracy monitoring provably insufficient regardless of architecture or attack method. A companion backdoor trigger attack reveals a novel trigger-dominance collapse: when the target class is a dataset minority, the spectrogram patch trigger becomes functionally redundant--clean ASR equals triggered ASR, and the attack degenerates to pure label flipping. We formalize the ML training pipeline as an attack surface and propose a trust-minimized defense combining content-addressed artifact hashing, Merkle-tree dataset commitment, and post-quantum digital signatures (ML-DSA-65/CRYSTALS-Dilithium3, NIST FIPS 204) for cryptographically verifiable data provenance.
Figures & tables
| Class | Count | Fraction |
|---|---|---|
| Car | 8,100 | 84.4% |
| Tram | 600 | 6.3% |
| Truck | 260 | 2.7% |
| Bus | 260 | 2.7% |
| Motorcycle | 250 | 2.6% |
| Bicycle | 220 | 2.3% |
| Rate | Flipped | Accuracy | ASR (95% CI) |
|---|---|---|---|
| 0 (clean) | 0 | 87.6% | 0% |
| 0.5% | 48 | 87.6% | 95.7% [88.4, 100] |
| 1.0% | 96 | 87.4% | 94.9% [83.8, 100] |
| 2.0% | 192 | 86.4% | 95.7% [92.0, 99.4] |
| Metric | Value |
|---|---|
| Overall test accuracy | 87.44% |
| Clean ASR (unpatched Truck) | 94.87% |
| Triggered ASR (patched Truck) | 94.87% |
| Stage | Label Flip | Backdoor |
|---|---|---|
| Raw WAV files | Low | High |
| Annotation CSVs | High | Low |
| Feature manifest | High | High |
| Spectrogram generation | Low | High |
| Train/val/test splits | High | Medium |
| Model checkpoint | N/A | High |
| Control | Label Flip | Backdoor |
|---|---|---|
| Overall accuracy monitoring | No | No |
| Per-class F1 / confusion matrix | Yes | No |
| Hash on label manifests | Yes | Partial |
| Hash on spectrogram files | Yes | Yes |
| Signed pipeline artifacts | Yes | Yes |
| Feature distribution anomaly det. | Partial | Yes |
Adversarial Attacks
Adversarial attacks exploit crafted inputs, poisoned data, or system interactions to manipulate AI predictions, behavior, privacy, or reliability.
See all 447 papers