The Weight of a Bit: EMFI Sensitivity Analysis of Embedded Deep Learning Models
Organizations: TTControl GmbH, Vienna, Austria. · the Faculty of Informatics and Information Technologies, Slovak University of Technology, Slovakia. · the State Key Laboratory of Blockchain and Data Security , Zhejiang University.
Abstract
Fault injection attacks on embedded neural network models have been shown as a potent threat. Numerous works studied resilience of models from various points of view. As of now, there is no comprehensive study that would evaluate the influence of number representations used for model parameters against electromagnetic fault injection (EMFI) attacks. In this paper, we investigate how four different number representations influence the success of an EMFI attack on embedded neural network models. We chose two common floating-point representations (32-bit, and 16-bit), and two integer representations (8-bit, and 4-bit). We deployed four common image classifiers, ResNet-18, ResNet-34, ResNet-50, and VGG-11, on an embedded memory chip, and utilized a low-cost EMFI platform to trigger faults. Beyond accuracy evaluation, we characterize the injected fault pattern by analyzing the bit error rate, the spatial distribution of corrupted bytes, and the prevalence of 0xFE/0xFF byte values across formats, identifying the mechanisms responsible for the observed differences in resilience. Our results show that while floating-point representations exhibit almost a complete degradation in accuracy (Top-1 and Top-5) after a single fault injection, integer representations offer better resistance overall. In particular, the 8-bit representation on a relatively large network (VGG-11) retains Top-1 accuracy of around 70% and Top-5 at around 90%.
Figures & tables
| Prior work | Attack type | Target model & platform | Weight format | Main findings |
|---|---|---|---|---|
| Hong et al. [ 9 ] | Bit-flip attack (memory fault via Rowhammer) | 19 Deep CNN classifiers; simulated attack | 32-bit floating point | Flipping a specific single bit can cause an accuracy loss of over 90%. |
| Rakin et al. [ 13 ] | Bit-flip attack (memory fault via Rowhammer) | Deep CNN classifiers; simulated attack | 8/6/4-bit integer | Flipping 13 weight bits can degrade a network’s accuracy to 0% (misclassification of virtually all inputs). |
| Breier et al. [ 14 ] | Fault injection for model extraction (sign-bit flips) | Deep feature-extractor network; simulated attack | 32/64-bit floating point | By flipping sign bits of activations, achieved error in recovered weights, effectively stealing the DNN model. |
| Libano et al. [ 15 ] | Radiation-induced soft errors (fault injection & accelerated radiation tests) | Small CNN on FPGA (MNIST digit recognition) | 1-bit binary vs. 32-bit float | Binary-weight network showed 39% fewer erroneous outputs under faults, but 12% more of its errors were catastrophic (misclassifications) compared to full-precision. |
| Guillemé et al. [ 8 ] | Statistical fault injection (simulated bit flips) | AlexNet-like CNN, software simulation; evaluated pruning and quantisation | 8-bit integer (with varying pruning levels) | Pruning increases fault sensitivity (less redundancy). Proposed selective redundancy (hardware voting) improved fault tolerance by 96% vs. no protection. |
| Gaine et al. [ 16 ] | Electromagnetic & laser fault injection (instruction skip) | CNN (2-layer ConvNet) on ARM Cortex-M4 microcontroller (embedded device) | 8-bit integer (CMSIS-NN quantized) | First demonstrated EMFI/LFI on a real CNN inference: single-glitch instruction skips in convolution or activation routines caused targeted mispredictions and persistent erroneous states. |
| Format | Total bits | Range | Decimal digits |
|---|---|---|---|
| FP32 | 32 | 7 | |
| FP16 | 16 | 3–4 | |
| INT8 | 8 | Exact | |
| INT4 | 4 | Exact |
| Model | Type | Top-1 (%) | Top-5 (%) |
|---|---|---|---|
| ResNet18 | FP32 | 68.750 | 88.379 |
| FP16 | 68.774 | 88.379 | |
| INT8 | 68.774 | 88.452 | |
| INT4 | 67.236 | 87.549 | |
| ResNet34 | FP32 | 72.778 | 90.991 |
| FP16 | 72.803 | 90.967 |
| Format | Mean BER (%) | Std BER (%) |
|---|---|---|
| FP32 | 5.97 | 0.36 |
| FP16 | 6.07 | 0.72 |
| INT8 | 7.51 | 0.51 |
| INT4 | 6.15 | 1.30 |
| Format | NaN (%) | Inf (%) | Range expansion |
|---|---|---|---|
| FP32 | |||
| FP16 |
| Model | Type | # Chunks | Front | Middle | Back |
|---|---|---|---|---|---|
| ResNet18 | INT8 | 3 | 0.07% | 0.68% | 6.37% |
| ResNet34 | INT8 | 6 | 0.10% | 0.12% | 53.05% |
| ResNet50 | INT8 | 7 | 0.15% | 5.20% | 49.10% |
| ResNet50 | INT4 | 4 | 0.12% | 0.17% | 22.19% |
| VGG11 | FP32 | 127 | 0.05% | 0.05% | 0.12% |
| VGG11 | FP16 | 64 | 0.05% | 0.05% | 62.84% |
Neural Network Robustness
Neural network robustness studies how models withstand adversarial inputs, data shifts, noise, and hardware faults while maintaining reliable predictions.
See all 237 papers