PAFS: Perturbation-Aware Firing Scaffolds for Robust Event-Based SNNs
Organizations: The University of Western Australia, Australia · Nanjing University, China · The Chinese University of Hong Kong, Hong Kong SAR, China · Hangzhou City University, China ·
Abstract
Event-based spiking neural networks (SNNs) encode information through temporal firing dynamics, but the same stateful computation makes their predictions sensitive to event loss, timestamp jitter, and speed variation. These perturbations alter evidence accumulation, yet late-layer firing trajectories can retain error-diagnostic structure that is absent from the final logits alone. We introduce Perturbation-Aware Firing Scaffolds (PAFS), a labeled post-training calibration method that exploits this structure without updating the pretrained backbone. PAFS associates standardized late-layer leaky integrate-and-fire trajectories with the class-probability residuals of an Adapter anchor, then applies singular value decomposition to extract compact residual-aligned channel directions. At inference, firing trajectories from the same backbone pass are projected onto this fixed low-rank scaffold and combined with anchor statistics to predict a residual logit correction. Across four matched dataset-backbone settings spanning three event datasets and two spiking Transformer architectures, PAFS improves corrupted-average and worst-condition accuracy over the corresponding Adapter anchors, with maximum gains of 3.06 and 3.65 percentage points. In the DailyAction-DVS/Spikingformer setting, the added trainable parameters amount to approximately 0.34% of the frozen backbone.
Figures & tables
| Method | Clean | Window Drop | Jitter | Speed | Corr. Avg. | Worst |
|---|---|---|---|---|---|---|
| DailyAction-DVS, Spikformer | ||||||
| LoRA | 97.62 0.55 | 86.51 1.40 | 91.35 2.10 | 87.89 3.00 | 88.58 1.90 | 86.51 1.40 |
| Plain MLP | 97.52 0.60 | 86.16 1.55 | 89.62 2.35 | 87.89 3.20 | 87.89 2.05 | 86.16 1.55 |
| Adapter | 97.35 0.53 | 86.62 1.22 | 90.43 2.50 | 86.85 3.65 | 87.97 1.57 | 86.62 1.22 |
| PAFS (ours) | 97.46 0.53 | 87.20 1.51 | 90.77 2.80 | 88.93 3.34 | 88.97 2.28 | 87.20 1.51 |
| DailyAction-DVS, Spikingformer | ||||||
| Dataset | Representation | Clean | Window Drop | Jitter | Speed | Avg. | Corr. Avg. | Worst |
|---|---|---|---|---|---|---|---|---|
| CIFAR10-DVS | PAFS (ours) | 57.43 1.21 | 53.53 3.00 | 49.07 2.40 | 37.73 2.66 | 49.44 2.63 | 46.78 2.63 | 37.73 2.66 |
| PCA scaffold | 56.93 1.08 | 52.87 2.55 | 47.42 2.08 | 36.31 2.18 | 48.38 1.92 | 45.53 2.03 | 36.31 2.18 | |
| Random scaffold | 56.84 1.17 | 52.61 2.72 | 47.18 2.22 | 36.74 2.36 | 48.34 2.06 | 45.51 2.14 | 36.74 2.36 | |
| Logit-only MLP | 56.71 1.12 | 52.76 2.63 | 47.05 1.96 | 36.58 2.27 | 48.28 1.98 | 45.46 2.07 | 36.58 2.27 | |
| Adapter anchor | 57.50 1.32 | 53.43 2.84 | 48.80 1.95 | 37.60 2.43 | 49.33 2.34 | 46.61 2.34 | 37.60 2.43 | |
| DailyAction-DVS | PAFS (ours) | 99.65 0.27 | 94.69 2.03 | 96.54 1.83 | 94.46 2.96 | 96.34 2.20 | 95.23 2.20 | 94.46 2.96 |
| Control | Matched components | Changed factor |
|---|---|---|
| LoRA | Frozen predictor, data protocol, and validation selection | Parameter-efficient weight update |
| Plain MLP | Frozen predictor and approximately matched Adapter budget | Output-space residual MLP without an Adapter anchor |
| Logit-only | Adapter anchor, correction budget, optimization, and selection | Uses only ; no firing features |
| PCA / Random | Anchor, LIF sources, rank, correction head, and training | Fixed firing-basis construction rule |
| Scalar rules | Candidate coordinates, retained budget, correction head, and training | Channel-ranking criterion only |
| Setting | Value |
|---|---|
| Input representation | event-count frames |
| Spatial resolution | |
| Adapter bottleneck | |
| Adapter dropout | |
| Optimizer | AdamW |
| Learning rate |
| Deployment overhead | Measured inference cost | Robustness gain vs. Adapter | |||||
|---|---|---|---|---|---|---|---|
| Method | Learned params ( / % frozen) | FP32 storage (KiB) | Added MACs ( /sample) | Latency (ms/sample) | Energy (mJ/sample) | Corr. Avg. (pp) | Worst (pp) |
| Adapter | / | ||||||
| LoRA | / | ||||||
| Logit-only MLP | / | ||||||
| PAFS (ours) | / | ||||||
| Method / scoring rule | Clean | Window Drop | Jitter | Speed | Corr. Avg. | Worst |
|---|---|---|---|---|---|---|
| Adapter | 97.35 0.53 | 86.62 1.22 | 90.43 2.50 | 86.85 3.65 | 87.97 1.57 | 86.62 1.22 |
| PAFS (Ours) | 97.46 0.53 | 87.20 1.51 | 90.77 2.80 | 88.93 3.34 | 88.97 2.28 | 87.20 1.51 |
| Random ranking | 97.18 0.61 | 85.74 1.68 | 89.88 2.17 | 85.92 3.08 | 87.18 1.46 | 85.74 1.68 |
| Activation frequency | 97.52 0.48 | 86.48 1.45 | 90.61 1.92 | 86.34 2.84 | 87.81 1.30 | 86.34 2.84 |
| Activation variance | 97.58 0.46 | 86.71 1.56 | 89.92 2.06 | 86.10 2.73 | 87.58 1.28 | 86.10 2.73 |
| Temporal variance | 97.31 0.55 | 87.36 1.41 | 89.85 1.80 | 86.20 2.69 | 87.80 1.21 | 86.20 2.69 |
Spiking Neural Networks
Spiking neural networks process information through discrete, time-dependent neural events, aiming for efficient computation and biologically inspired learning.
See all 351 papers