Conv-Reluplex: A Verification Framework For Convolution Neural Networks
Authors: Jin Xu, Zishan Li, Miaomiao Zhang, Bowen Du
Organizations: School of Software Engineering, Tongji University, Shanghai, China · Department of Computer Science, University of Warwick, Coventry, United Kingdom
In recent years, machine learning has demonstrated impressive performance in many real-world tasks, especially in computer vision and natural language processing. However, to apply them in safety-critical systems one needs formal guarantees on the neural network outputs. The Reluplex tool is proposed to verify the safety of deep neural networks (DNNs), and in case the DNN fails to give a correct output, can generate adversarial examples. Since the tool can only handle DNNs, it is necessary to extend the tool to process image data. Therefore, in this paper, we propose the Conv-Reluplex framework, which is designed to verify the convolutional layer and pooling layer in convolutional neural networks (CNNs), and generate adversarial examples when classification is misguided. We conduct several experiments on MNIST to evaluate our approaches. The results show that the original CNN is improved using the adversarial examples generated by our tool, and the precision of classification can be increased significantly.
Figures & tables
Fig. 1: Main steps of the Conv-Reluplex framework
Fig. 2: Max-pooling calculation
Fig. 3: Unpooling calculation of Max-pooling
Fig. 4: Convolution calculation
Fig. 5: Deconvolution calculation
Fig. 6: The structure of the CNN model in the experiment
TABLE I: Verification results of a test sample of number 6 in different perturbation neighborhoods
Fig. 7: Original picture and adversarial example of number 6
Fig. 8: Different adversarial examples
accuracy of original sample
accuracy of adversarial sample
Original model
94.98%
0%
Adversaria training
94.89%
99.65%
TABLE II: Accuracy comparison before and after adversarial training
classification
0
1
2
3
4
5
6
7
8
9
Original model
√
\
√
Fail
Fail
√
√
Fail
Fail
Fail
Adversaria training
√
\
√
√
√
√
√
Fail
√
Fail
TABLE III: Verification results of number 1’s test sample (δ=0.6)
classification
0
1
2
3
4
5
6
7
8
9
Original model
√
√
√
\
√
Fail
√
√
Fail
√
Adversaria training
√
√
√
\
√
√
√
√
√
√
TABLE IV: Verification results of number 3’s test sample (δ=0.6)
classification
0
1
2
3
4
5
6
7
8
9
Original model
√
√
√
√
√
Fail
\
√
Fail
√
Adversaria training
√
√
√
√
√
√
\
√
√
√
TABLE V: Verification results of number 6’s test sample (δ=0.6)
Foundation for Research and Technology – Hellas, Heraklion, Greece · University of Crete, Heraklion, Greece · Catalan Institution for Research and Advanced Studies, Barcelona, Spain +1