Sequential Learning and Catastrophic Forgetting in Differentiable Resistor Networks

Physical learning rules such as equilibrium propagation (EP), coupled learning (CL), and adjoint coupled learning (AL) train resistive networks through local measurements. In the small-nudge limit EP and CL exactly conserve the conductance mass K = (1/2) sum_e kappa_e^2, a property that stabilizes training. We show that conservation also governs the inductive bias of these rules. For a single output we prove that EP and CL are trajectory equivalent, so single-output experiments cannot distinguish what the two rules learn. We prove that AL does not conserve the mass but dissipates it at exactly twice its own loss. In linear circuits we prove that the conserved mass has no functional consequence: all three vector fields are homogeneous in the conductances, so the selected solution is independent of the initialization scale. Fixed nonlinear elements break this protection. In diode circuits the learned input-output function depends on the initialization scale by up to about forty percent, an effect absent in linear controls, and the conservative rules retain this memory permanently while the dissipative rule partially erases it. At matched training loss the dissipative rule typically generalizes worse than the conservative rules, although it reaches low training loss faster; the penalty correlates with the mass dissipated en route and fades in larger circuits, where little mass is lost. The conservation structure of a local learning rule thus sets its initialization memory, its training speed, and, where dissipation is appreciable, its generalization; it should be treated as a design parameter of physical learning machines.

Catastrophic forgetting is often framed as a representational problem: after sequential training, a model appears to lose the features that supported performance on earlier tasks. We challenge the stronger form of this view. Across controlled continual-learning settings, we find that a significant portion of apparent forgetting can be attributed to interface drift between internal stages rather than permanent erasure of task-relevant computation. We study this phenomenon through a stitched evaluation protocol that combines early computation from a post-update network with late computation from its predecessor, optionally mediated by a compact, task-specific transport key. We describe transport keys at a systems level as compact interface-alignment operators estimated from a small set of paired anchor activations and evaluated through model stitching. On split CIFAR-100 with a ResNet-style network, transport keys recover most of the original Task A performance after sequential training on Task B. On a compact vision transformer, we observe a similar recovery pattern. These results suggest that continual learning may require better mechanisms for indexing and re-accessing latent computations, not only methods that prevent weight change.

One of the critical limitations of artificial neural networks is their lack of ability to continually learn: training on new tasks often leads to interference and forgetting of the previous ones. While several algorithms have been proposed to protect old memories from interference, they are typically applied during or immediately after each new episode of training. In contrast, humans and animals can learn continuously, acquiring multiple new memories during active learning before consolidating all of them into long-term storage. Here we show that multiple new tasks can be trained sequentially before an unsupervised sleep-like replay phase is applied to partially restore performance across all previously learned tasks. Our study further suggests that task-specific information remains resilient to new training but decays gradually as network is trained on new tasks. These findings point to novel principles for developing a broad range of continual learning AI solutions.