Neural Activity Synchronization-Based Fast Local Learnable Spiking Neural Network Architecture
Organizations: Department of Computer Science and Engineering, Sister Nivedita University, Kolkata, India · Department of Computer Science and Engineering, UPES Dehradun, Dehradun, India
Abstract
Implementing intelligent learning systems on low- power edge devices is challenging due to the high compu- tational complexity, training latency, and energy demands of traditional Artificial Neural Networks (ANNs). Spiking Neural Networks (SNNs), biologically plausible and spike-driven, come as an alternative. However, SNN training commonly relies on backpropagation through time (BPTT), which is computationally expensive, inherently global, and unsuitable for battery-driven devices. This work proposes a novel local learning framework for multi-layered SNNs inspired by Neural Activity Synchronization (NAS). Each layer updates its own weights using locally com- puted gradients. No gradient backpropagation is needed. This significantly reduces computational complexity, training latency, and energy consumption. The proposed SNN model is trained and evaluated on the MNIST dataset, achieving a classification accuracy of 97.78%. The model is also analyzed with Gaussian and salt-and-pepper noise, demonstrating robust performance across different noise levels.
Figures & tables
| Dataset | # Hidden layers | # Neurons | # Parameters | Learning rate | Basis type | Accuracy (%) |
|---|---|---|---|---|---|---|
| MNIST | 3 | 1024-256-64 | 1,083,338 | 0.1 | Periodic | 97.78 |
| Fashion-MNIST | 2 | 2048-1024 | 3,716,106 | 0.1 | Sinusoidal | 88.06 |
| EMNIST | 4 | 1024-512-256-128 | 1,498,927 | 0.05 | Sinusoidal | 73.62 |
| Paper | Training Method | # Hidden Layers (# Neurons) | Time-Steps | Epochs | Local Learning | Accuracy (%) |
| CoLaNET [ 14 ] | Supervised STDP with dopamine-modulated plasticity | 1 (150) | 20 | - | - | 96.87 |
| CDNA-SNN [ 25 ] | Supervised STDP with CDNA-Weighted STDP | 2 (55-38) | 300 | 100 | Yes (unsupervised) | 98.91 |
| HM2-BP [ 10 ] | Hybrid macro/micro level backpropagation | 1 (800) | 400 | 100 | No (supervised) | 98.93 |
| STDBP [ 27 ] | Spike-Timing-Dependent Backpropagation | 1 (800) | - | 150 | No (supervised) | 98.50 |
| BS4NN [ 13 ] | BPTT + Binary synaptic weights | 1 (600) | 256 | 500 | No (supervised) | 97.00 |
| PSAC [ 20 ] | STDP with Reinforcement learning | 1 (7010) | - | 6 | Yes (unsupervised) | 98.10 |
| Paper | Training Method | # Hidden Layers (# Neurons) | Time-Steps | Epochs | Local Learning | Accuracy (%) |
|---|---|---|---|---|---|---|
| CDNA-SNN [ 25 ] | Supervised STDP with CDNA-Weighted STDP | 2 (53-46) | 300 | 100 | Yes (unsupervised) | 90.12 |
| STDBP [ 27 ] | Spike-Timing-Dependent Backpropagation | 1 (1000) | - | 150 | No (supervised) | 88.10 |
| BS4NN [ 13 ] | BPTT + Binary synaptic weights | 1 (1000) | 256 | 500 | No (supervised) | 87.30 |
| This work | Local Learning + NAS | 2 (2048-1024) | 20 | 100 | Yes (supervised) | 88.06 |
Spiking Neural Networks
Spiking neural networks process information through discrete, time-dependent neural events, aiming for efficient computation and biologically inspired learning.
See all 375 papers