Inverting Neural Networks: New Methods to Generate Neural Network Inputs from Prescribed Outputs
Authors: Rebecca Pattichis, Sebastian Janampa, Constantinos S. Pattichis, Marios S. Pattichis
Organizations: Department of Electrical Engineering, University of California, Los Angeles, Los Angeles CA, USA · Department of Electrical and Computer Engineering, University of New Mexico, Albuquerque, NM, USA · Department of Computer Science, University of Cyprus, Cyprus
Neural network systems describe complex mappings that can be very difficult to understand. In this paper, we study the inverse problem of determining the input images that get mapped to specific neural network classes. Ultimately, we expect that these images contain recognizable features that are associated with their corresponding class classifications. We introduce two general methods for solving the inverse problem. In our forward pass method, we develop an inverse method based on a root-finding algorithm and the Jacobian with respect to the input image. In our backward pass method, we iteratively invert each layer, at the top. During the inversion process, we add random vectors sampled from the null-space of each linear layer. We demonstrate our new methods on both transformer architectures and sequential networks based on linear layers. Unlike previous methods, we show that our new methods are able to produce random-like input images that yield near perfect classification scores in all cases, revealing vulnerabilities in the underlying networks. Hence, we conclude that the proposed methods provide a more comprehensive coverage of the input image spaces that solve the inverse mapping problem.
Figures & tables
ViT-tiny
DINOv3-Base
patch size
4×4
4×4
input channels
1
1
hidden dim
192
768
num. of layers
12
12
epochs
32
32
batch size
32
32
TABLE I: Model parameters, training hyper-parameters
Fig. 3: Generated ideal input images using different algorithms. train-data row: reference images given in the MNIST training data for each class. [ 1 ] -1layer row: ideal images generated in [ 1 ] . 1layerNN, 2layerNN, and 6layer NN rows: ideal images generated BackPassInv algorithm on FCNNs, with null-space noise added ( Std=0.1 ). ViT-tiny and DINOV3 rows: generated images using ForwardPassInv (.). All generated images from new methods produce a probability score ≥0.9 for each digit class and ≤ 0.1 for the other ones.