Adversarial Machine Learning research is currently centered on the search for the epsilon-ball: minimal perturbations designed to fool models while remaining imperceptible to humans. We argue that this fixation on ℓp norms is a metrological trap that communicates a distorted perception of risk to defenders, one that is unaligned with real-world system vulnerabilities. This paradigm misleads defenders into optimizing for narrow, mathematical robustness at the expense of systemic security, while simultaneously incentivizing attackers to exploit non-overlapping alternative adversarial pathways. Ultimately, we argue that the dominance of the ℓp ball does not just fail to reduce harm---it may actively facilitate it by communicating a false sense of security against the wrong threats.
Figures & tables
Category
ϵ
Pois.
Jail.
Sem.
Patch
Def
Audio
11
18
25
9
2
1
General
293
118
98
114
13
28
Graph
27
30
20
14
5
9
Image
334
153
143
110
31
51
Multim.
60
38
43
23
4
5
RL
46
27
51
43
11
20
Table 1: Threat frequency from 4311 Adversarial ML papers from ICML/ICLR/NeurIPS over 2022–2025, categorized by primary threat model (all entries are distinct) following Appendix D . Abbreviations: ϵ : small metric perturbations, Pois.: Poisoning, Jail.: Jailbreak, Sem.: Semantic, Def.: Defense. Note: the majority of Poisoning, Jailbreaking, Patch, and Defense papers employ an ϵ threat model (see Section 2 and Appendix D ).
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
Conference
2023
2024
2025
Total
ICLR
605
316
498
1419
ICML
251
341
470
1062
NeurIPS
453
569
808
1830
Total
1309
1226
1776
4311
Appendix
Table 2: Distribution of Analyzed Papers by Venue and Year.
Mathematical Constraint
Count
Unconstrained Content (Dirty Label)
270
Spatially Constrained (L0 / Mask)
202
Semantically Constrained (Clean Label)
134
Magnitude Constrained (Lp-Norm)
112
Appendix
Table 3: Data Poisoning by Mathematical Constraint Type.
Mathematical Constraint
Count
Distributional (Wasserstein/EMD)
220
General Semantic / Unspecified
184
Discrete Distance (Levenshtein)
26
Geometric (Rotation/Spatial)
7
Appendix
Table 4: Breakdown of Semantic/Transformation Constraints.