cs.LGJun 21, 2026

Low-power analogue neural networks with trainable nonlinear connections for continuous control

Authors: Ian T. VidamourFernando AguirreThomas J. HaywardMatthew O. A. EllisCharles SwindellsAlexander McDonnellMartin TrefzerFinley Robins+8 more

Organizations: School of Computer Science, University of Sheffield, Sheffield, S1 4DP, United Kingdom · Intrinsic Semiconductor Technologies, London, United Kingdom · School of Chemical, Biological, and Materials Science Engineering, University of Sheffield, Sheffield, S1 3JD, United Kingdom · School of Physics, Engineering, and Technology, University of York, York, YO10 5EZ, United Kingdom · Department of Computer Science, University of York, York, YO10 5EZ, United Kingdom · Department of Electronic & Electrical Engineering, University College London, Roberts Building, Torrington Place, London, WC1E 7JE, United Kingdom · King’s College London, London, WC2R 2LS, United Kingdom · Blackett Laboratory, Imperial College London, London, SW7 2AZ, United Kingdom

Abstract

Physical neural networks promise low-power machine learning by computing directly with analogue device physics, but most architectures force nonlinear device responses to act as scalar weights. Inspired by Kolmogorov-Arnold networks, we place trainable nonlinear functions on the connections, making each physical connection a learnable computational element. Realising these functions as analogue band-pass filters on field-programmable analogue arrays, we find that the benefit is task-dependent and follows from the smoothness of the physical basis: the networks represent smooth, continuously valued targets, including robotic kinematics, continuous control, and photovoltaic maximum-power-point tracking, with far fewer nodes and connections than multilayer perceptrons, but offer no parameter-efficiency advantage on classification-like decision boundaries. Trained networks transfer to hardware across approximately 35,000 connections with quantified fidelity, and a dedicated CMOS implementation is projected to operate at approximately 30 microwatts. A memristive realisation reproduces the same behaviour in simulation, indicating that the advantage comes from placing trainable nonlinearity on connections, rather than from a particular device.

Explore similar work

CardsList