cs.NE · 2606.14146 Copy arXiv ID · Jun 12, 2026 Save A Programmer's Guide to Cascaded Adaptive Combiners: Online Learning by Biologically Accurate Models of Multilayer Neuron Networks Authors: Martin Nilsson , Denis Kleyko
Organizations: RISE Research Institutes of Sweden, Kista, Sweden · Örebro University, Örebro, Sweden
Abstract Learning in biological multilayer neuronal networks offers insights that extend beyond the classical weighted-sum neuron model commonly used in artificial neural networks. This article presents an accessible guide to a mechanistic neuronal network model that more accurately captures aspects of biological computation while enabling a simple yet powerful mechanism for learning in multilayer neural networks. The proposed approach supports efficient online streamed learning and provides a practical alternative to backpropagation. We demonstrate its potential in an image classification task, achieving competitive classification performance. The approach's simplicity, biological grounding, and broad applicability highlight a promising path toward algorithms that unify mechanistic neuron models and machine learning.
Explore similar work Aug 7, 2026 · Roy Abel, Shimon Ullman Synaptic Plasticity Backpropagation
Jun 30, 2026 · Yutaro Yamada, Luca Grillotti, Rujikorn Charakorn +3 Backpropagation Credit Assignment
Aug 7, 2026 · cs.AI J/K move · Enter open · S save
Roy Abel, Shimon Ullman
Weizmann Institute of Science
Biologically plausible learning models aim to explain how neural circuits can implement effective learning under the constraints of real neurons. Although significant progress has been made, a major remaining challenge is that existing models often allow neurons or synapses to represent mixed-sign values, both positive and negative, in violation of a basic aspect of cortical circuitry -- Dale's constraint: biological neurons are either excitatory or inhibitory, but not both, and synapses cannot change sign. In this work, we address this discrepancy by introducing a biologically motivated neural architecture in which both neural activations and learning signals are represented by non-negative activity, and synapses have fixed sign, while still supporting backpropagation-like learning. Our approach uses two complementary interacting non-negative channels to represent positive and negative contributions, inspired by evidence of on-off representations in the brain. These channels are implemented through a simple neural circuit motif, which is repeated throughout the network in both bottom-up and top-down pathways. Combined with a local Hebbian learning rule, the resulting model propagates learning signals and updates weights using only local interactions between neurons. We show theoretically that our learning scheme can exactly recover the backpropagation update despite relying solely on non-negative error signals. Empirically, beyond satisfying stronger biological constraints, the on-off architecture learns efficient representations, yielding substantial gains over comparable vanilla networks on the Tiny ImageNet benchmark. These results demonstrate that effective learning can emerge from biologically plausible mechanisms without requiring mixed-sign signals, providing a step toward more realistic models of neural computation.