MADSNet: A Multi-Scale Axial-Attentive Dense Spiking Network for Spike Camera Image Reconstruction
Organizations: School of Data Science, The Chinese University of Hong Kong, Shenzhen, China · School of Computer Science, Peking University, Beijing, China · College of Computing and Data Science, Nanyang Technological University, Singapore · School of Intelligence Science and Engineering, Harbin Institute of Technology, Shenzhen, China ·
Abstract
Spike cameras encode dynamic scenes into high-temporal-resolution binary spike streams for efficient high-speed vision. Although spiking neural networks (SNNs) can process such signals with sparse and accumulate-only computation, existing SNN-based reconstruction methods are typically shallow and still lag behind ANN-based models in reconstruction fidelity. This paper proposes MADSNet, a Multi-scale Axial-attentive Dense Spiking Network for spike camera image reconstruction. MADSNet adopts a hierarchical spiking encoder--decoder, where a multi-scale spike stem extracts early features, axial spike attention captures long-range dependencies, a dense spiking bottleneck enhances feature reuse, and a spike-to-continuous decoder reconstructs continuous intensity images from spike-domain representations. Experiments on gray-scale and color spike reconstruction show that MADSNet outperforms SSIR by 4.3 dB PSNR and Spk2ImgNet by 1.94 dB on SREDS. Compared with Spk2ImgNet, it achieves about 15 lower latency and uses only about 1/40 of the estimated energy, demonstrating that carefully designed SNN architectures can improve reconstruction quality while preserving computational efficiency.
Figures & tables
| Paradigm | Method | SREDS Dataset | ||||
| PSNR | SSIM | LPIPS | NIQE | BRISQUE | ||
| Non-SNN | TFP [ 3 ] | 28.027 | 0.687 | 0.269 | 7.445 | 40.656 |
| TFI [ 3 ] | 24.258 | 0.691 | 0.263 | 5.074 | 40.069 | |
| TFSTP [ 22 ] | 20.845 | 0.640 | 0.271 | 5.163 | 36.948 | |
| MAHTF [ 4 ] | 31.566 | 0.904 | 0.089 | 2.631 | 15.997 | |
| ANN | ETNet [ 32 ] | 31.088 | 0.899 | 0.095 | 3.477 | 14.357 |
| Paradigm | Method | PSNR | SSIM | LPIPS |
| Non-SNN | TFP [ 3 ] | 23.78 | 0.6207 | 0.3986 |
| TFI [ 3 ] | 23.97 | 0.6294 | 0.3731 | |
| TFSTP [ 22 ] | 23.32 | 0.5978 | 0.3759 | |
| 3DRI [ 18 ] | 26.95 | 0.8029 | 0.1946 | |
| ANN | SJRE [ 9 ] | 24.84 | 0.5499 | 0.4050 |
| SSL-CSC [ 19 ] | 29.95 | 0.8417 | 0.1829 |
| Variant | PSNR | SSIM | LPIPS |
| MADSNet (Full) | 37.232 | 0.956 | 0.028 |
| w/o MS3Stem (single SConv) | 35.406 | 0.948 | 0.034 |
| w/o ASA | 36.601 | 0.955 | 0.030 |
| w/o DS-SEWBlock (standard SEWBlock) | 36.990 | 0.954 | 0.032 |
| w/o Dense Bottleneck (sequential) | 36.566 | 0.954 | 0.032 |
| w/o SPSU (transposed conv) | 36.581 | 0.954 | 0.031 |
| Architecture | Neuron | PSNR | SSIM | LPIPS |
| SSIR (baseline) | PLIF | 32.930 | 0.922 | 0.050 |
| IBRA-LIF | 33.168 | 0.937 | 0.030 | |
| MADSNet (Ours) | PLIF | 30.230 | 0.817 | 0.124 |
| IBRA-LIF | 37.232 | 0.956 | 0.028 |
| Layer Group | SSIR | SSIR | MADSNet | MADSNet |
| Neuron | PLIF | IBRA | PLIF | IBRA |
| SSIR | ||||
| Stem (static_conv) | 39.66 | 23.53 | – | – |
| Encoder (enc1) | 80.94 | 36.30 | – | – |
| Bottleneck (eres1) | 65.05 | 29.42 | – | – |
| Decoder (dec3) | 83.79 | 13.19 | – | – |
| Method | Latency (ms) | Memory (GB) | Energy (mJ) | Norm. Energy |
| Spk2ImgNet | 305.4 | 1.675 | 4690.0 | 1 |
| SSIR | 3.3 | 0.310 | 4.6 | 1/1019 |
| MADSNet (Ours) | 20.4 | 0.489 | 118.4 | 1/40 |
Image Reconstruction
Image reconstruction recovers images, volumes, or scenes from incomplete, noisy, indirect, or compressed measurements using physical models and learned priors.
See all 323 papers