Quantization of Spiking Neural Networks Beyond Accuracy
Organizations: Worcester Polytechnic Institute Worcester, Massachusetts, USA
Abstract
Quantization is a natural complement to the sparse, event-driven computation of Spiking Neural Networks, reducing memory bandwidth and arithmetic cost for deployment on resource-constrained hardware. However, existing SNN quantization evaluation focuses almost exclusively on accuracy, overlooking whether a quantized network preserves the firing behavior of its full-precision counterpart. We demonstrate that quantization method, clipping range, and bit-width can produce substantially different firing distributions at equivalent accuracy, differences invisible to standard metrics but relevant to deployment, where firing activity governs effective sparsity, state storage, and event-processing load. To capture this gap, we propose Earth Mover's Distance as a diagnostic metric for firing distribution divergence, and apply it systematically across weight and membrane quantization on SEW-ResNet architectures trained on CIFAR-10 and CIFAR-100. We find that uniform quantization induces distributional drift even when accuracy is preserved, while LQ-Net style learned quantization maintains firing behavior close to the full-precision baseline. Our results suggest that behavior preservation should be treated as an evaluation criterion alongside accuracy, and that EMD provides a principled tool for assessing it.
Figures & tables
| ResNet18 | ResNet8 | ||||||||
| Range | Bits | Acc | Fire | EMD | Dead | Acc | Fire | EMD | Dead |
| CIFAR-100 (FP32: R18: 75.2%, R8: 72.3%) | |||||||||
| Signed | 2 | 67.1 | .041 | .0139 | 82.2 | 66.6 | .063 | .0283 | 67.7 |
| Unsigned | 2 | 71.9 | .033 | .0104 | 84.9 | 70.7 | .053 | .0247 | 73.0 |
| Signed | 4 | 74.8 | .073 | .0075 | 67.3 | 72.4 | .091 | .0132 | 42.2 |
| Unsigned | 4 | 73.3 | .077 | .0097 | 63.3 | 71.4 | .083 | .0143 | 47.7 |
Neural Network Quantization
Neural network quantization represents weights, activations, and states with fewer bits to reduce memory use, computation, and deployment costs.
See all 394 papers