Neuroevolution automates the complex task of neural network design but often ignores the inherent adversarial fragility of evolved models which is a barrier to adoption in safety-critical scenarios. While robust training methods have received significant attention, the design of architectures exhibiting intrinsic robustness remains largely unexplored. In this paper, we propose NERO-Net, a neuroevolutionary approach to design convolutional neural networks better equipped to resist adversarial attacks. Our search strategy isolates architectural influence on robustness by avoiding adversarial training during the evolutionary loop. As such, our fitness function promotes candidates that, even trained with standard (non-robust) methods, achieve high post-attack accuracy without sacrificing the accuracy on clean samples. We assess NERO-Net on CIFAR-10 with a specific focus on L∞-robustness. In particular, the fittest individual emerged from evolutionary search with 33% accuracy against FGSM, used as an efficient estimator for robustness during the search phase, while maintaining 87% clean accuracy. Further standard training of this individual boosted these metrics to 47% adversarial and 93% clean accuracy, suggesting inherent architectural robustness. Adversarial training brings the overall accuracy of the model up to 40% against AutoAttack.
Figure 1. Snippet of a grammar with new rules for the convblock layer type.
Figure 2. An illustration of the connections between layers, assuming the number of levels back is 2. The original implementation does not allow layer 3 to have layer 1 as its only input (red connection). Layer 2 would always have to be an input of layer 3 (dashed red connection).
⟨stem⟩
::=
layer:convblock act-pos:postconv act:linear
bn:none [num-filters,int,1,16,256]
filter-shape:3stride:1⟨padding⟩bias:False
⟨features⟩
::=
⟨macro-node⟩∣⟨macro-node⟩∣⟨transition-block⟩
⟨macro-node⟩
::=
layer:macro-node⟨node-activation⟩
[num-filters,int,1,16,256] filters-mult:4
⟨node-activation⟩
::=
act:relu∣act:swish
Figure 3. Grammar used in NERO-Net.
Parameter
Value
Number of runs
5
Number of generations
100
Number of offspring ( λ )
4
Add layer mutation rate
25%
Replicate layer mutation rate
35%
Remove layer mutation rate
25%
Table 1. NERO-Net experimental parameters.
Figure 4. Evolution of the best individual per generation. The red dotted lines mark the transition based on the τ threshold.
Norm
Attack
Standard Training
Adversarial Training
NSGA-Net
NERO-Net
NSGA-Net
NERO-Net
-
None
95.55 ± 0.11
93.47 ± 0.15
84.89 ± 0.22
84.08 ± 0.40
L∞
FGSM
39.73 ± 1.20
47.88 ± 1.11
64.93 ± 0.59
60.09 ± 0.62
PGD20
00.00 ± 0.00
00.13 ± 0.07
50.75 ± 0.74
44.69 ± 0.64
AA
-
-
47.13 ± 0.86
40.40 ± 0.66
L2
FGM
54.99 ± 0.83
58.35 ± 0.72
76.25 ± 0.52
77.88 ± 0.39
Table 2. Clean and adversarial accuracy on CIFAR-10, with ϵ=8/255 in L∞ and ϵ=0.5 in L2 . Best results for standard and adversarial training are underlined and in bold , respectively.