Mixed-signal implementation of feedback-control optimizer for single-layer Spiking Neural Networks
Authors: Jonathan Haag, Christian Metzner, Dmitrii Zendrikov, Giacomo Indiveri, Benjamin Grewe, Chiara De Luca, Matteo Saponati
Organizations: Institute of Neuroinformatics, University of Zürich and ETH Zürich, Zürich, Switzerland · AI Center, ETH, Zürich, Switzerland · Digital Society Initiative, University of Zurich, Switzerland
On-chip learning is key to scalable and adaptive neuromorphic systems, yet existing training methods are either difficult to implement in hardware or overly restrictive. However, recent studies show that feedback-control optimizers can enable expressive, on-chip training of neuromorphic devices. In this work, we present a proof-of-concept implementation of such feedback-control optimizers on a mixed-signal neuromorphic processor. We assess the proposed approach in an In-The-Loop(ITL) training setup on both a binary classification task and the nonlinear Yin-Yang problem, demonstrating on-chip training that matches the performance of numerical simulations and gradient-based baselines. Our results highlight the feasibility of feedback-driven, online learning under realistic mixed-signal constraints, and represent a co-design approach toward embedding such rules directly in silicon for autonomous and adaptive neuromorphic computing.
Figures & tables
Fig. 1: Schematic of the computational primitive. One output neuron (black) receives inputs (black arrow) and sends output (blue arrows) to the two corresponding positive (purple) and negative (cyan) control neurons. Arrows and circles indicate excitation and inhibition, respectively.
Fig. 2: a ) In-the-loop (ITL) training setup. b Left: Calibration of input and target spike generation with recorder neurons, before and after calibration. Middle: Frequency-frequency curves of calibrated DYNAP-SE neurons for different synaptic weights (see legend). Right: relation between error (output activity minus target activity) and the total feedback (activity of the control neurons) in Hz.
Fig. 3: Successful ITL training with the DYNAP-SE. a ) Binary classification task. b ) Target error during ITL training and comparison with numerical simulations. SNN-SFC stands for Spiking Neural Network - Spiking Feedback Control. c ) Left: Activity of the output neuron during ITL training when given inputs from class 1 and 2 (see legend). Right: Dynamics of the input weights. d ) Poisson encoding of the Yin Yang dataset. e ) Same as b for classification accuracy. ANN-BP stands for Artificial Neural Network - Backpropagation. f ) Left: Network inference at test time. Right: Dynamics of the input weights.
dataset
test-time metric
numerical sim.
DYNAP-SE
power [μW]
Binary
accuracy [%]
100
100
41
target error [Hz]
3.9
2.1
Yin–Yang
accuracy [%]
63
67
189
target error [Hz]
7.2
6.1
TABLE I: Test-time accuracy for standard single-layer ANN: 100 % on binary classification, 66 % on Yin Yang [ 12 ] . Estimated power consumption on DYNAP-SE during inference.
Energy-efficient neuromorphic computing at the edge requires simulation tools that can capture the non-ideal behavior of mixed-signal spiking neural network (SNN) hardware while supporting system-level design exploration. This work presents an open-source hardware-aware simulation framework for mixed-signal SNNs that enables comparative analysis across neuron, synapse and architecture choices. The framework supports multiple neuron models, including Leaky Integrate-and-Fire (LIF), Hodgkin-Huxley (HH) and Axon-Hillock (AH), together with non-volatile analog synapses based on floating-gate transistors and ReRAM devices. By incorporating device-level nonlinearities directly into PyTorch-based training and inference, the tool enables optimization of physical synaptic parameters rather than idealized abstract weights. The framework is evaluated on standard neuromorphic benchmarks, including N-MNIST, DVS Gesture and Spiking Heidelberg Digits (SHD). For each model dataset configuration, it reports classification accuracy together with hardware-oriented metrics such as silicon area, power consumption and quantization sensitivity. These capabilities enable cross-layer design space exploration and help identify neuron-synapse configurations that best satisfy application-specific constraints on accuracy, energy efficiency, area and hardware fidelity.
Spiking Neural Networks (SNNs) offer an energy efficient alternative to conventional Artificial Neural Networks (ANNs) but typically still require a large number of parameters. This work introduces Linearized Bregman Iterations (LBI) as an optimizer for training SNNs, enforcing sparsity through iterative minimization of the Bregman distance and proximal soft thresholding updates. To improve convergence and generalization, we employ the AdaBreg optimizer, a momentum and bias corrected Bregman variant of Adam. Experiments on three established neuromorphic benchmarks, i.e. the Spiking Heidelberg Digits (SHD), the Spiking Speech Commands (SSC), and the Permuted Sequential MNIST (PSMNIST) datasets, show that LBI based optimization reduces the number of active parameters by about 50% while maintaining accuracy comparable to models trained with the Adam optimizer, demonstrating the potential of convex sparsity inducing methods for efficient neuromorphic learning.
Daniel Windhager, Bernhard A. Moser, Michael Lunglmayr
Silicon Austria Labs, Linz, Austria · Software Competence Center Hagenberg, Hagenberg, Austria · Institute of Signal Processing, Johannes Kepler University, Linz, Austria
In biological circuits, sequential neural activity evolves along dynamic, low-dimensional manifolds to enable flexible behavior. Spiking network models link aspects of this sequential activity to features of manifold geometry through specific circuit mechanisms, making dynamic neural manifolds parameterizable, and thereby offering an explainable framework for neural computation. Extending this framework to neuromorphic engineering, we present an implementation on the SpiNNaker 2 chip for real-time, closed-loop control. By allowing sensory inputs to modulate heterogeneous inhibition, gain, and transient currents, our architecture drives rapid subspace rotations to switch between behaviors, as well as fine-grained trajectory control within them. We validate this via a robotic simulation where an agent uses sensory feedback to dynamically reconfigure its manifold geometry to navigate through a maze. Our results establish dynamic manifolds as a feasible approach for explainable neuromorphic architectures and a substrate for investigating biological neural dynamics.
Oskar von Seeler, Christian Tetzlaff, Andrew Lehr
Group of Computational Synaptic Physiology, Department of Neuro- and Sensory Physiology, University Medical Center Göttingen, Germany · Campus Institute Data Science, University of Göttingen, Germany · Circulant Labs, Bensheim, Germany