cs.AIOct 30, 2026

Neurons Are All You Need

Authors: Joseph B. Alzagatiti, Alain C. Glanzman, Perry A. Demsko, Pablo I. Salanova, David L. Glanzman

Organizations: Department of Integrative Biology and Physiology, UCLA College, University of California, Los Angeles, Los Angeles, CA, USA. · Department of Neurobiology, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA. · Brain Research Institute, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.

Abstract

For decades, artificial neural networks have operated under the assumption that durable, learned capability resides exclusively in adaptive synaptic parameters, primarily due to the established neurobiology of synaptic connectivity. This design forces models to remain stateless during deployment, incurring well-known limitations such as catastrophic forgetting and expensive retraining. However, recent neurobiological research by Glanzman and colleagues, and others, shows that memories can be transferred between individual organisms in a synaptically independent manner. Inspired by this research, we sought to demonstrate memory transfer of persistent memory between AI model instances, leveraging a neurocentric version of memory. In this paper, we propose NURESA (Neural Unit with Retentive Self-Adaptive Architecture), a novel neural layer that eschews sole reliance on synaptic weight updating by introducing persistent intra-unit memory as a first-class, computational primitive. By structurally separating computation from persistent memory, NURESA enables autonomous memory accumulation and consolidation into transferable stores of memory registers. Experiments across MLP, GPT-2, and modern frontier models like Qwen2.5 demonstrate qualitatively new capability: zero-shot transfer of learned capability into a naive model instance without retraining or access to the original training data; this transfer is enabled by a sparse set of parameters in NURESA's memory register that the model selects on its own based on which neurons were most active. The memory transfer capability of NURESA also protects against domain loss when transformer models undergo learning via fine-tuning. Finally, the memory transfer process completes in approximately one minute even for transformer models with millions to billions of parameters, producing a transfer file orders of magnitude smaller than the original model.

Explore similar work

Jun 7, 2026

Not Just After One: Sleep-Inspired Replay Prevents Catastrophic Forgetting After Sequential Tasks

One of the critical limitations of artificial neural networks is their lack of ability to continually learn: training on new tasks often leads to interference and forgetting of the previous ones. While several algorithms have been proposed to protect old memories from interference, they are typically applied during or immediately after each new episode of training. In contrast, humans and animals can learn continuously, acquiring multiple new memories during active learning before consolidating all of them into long-term storage. Here we show that multiple new tasks can be trained sequentially before an unsupervised sleep-like replay phase is applied to partially restore performance across all previously learned tasks. Our study further suggests that task-specific information remains resilient to new training but decays gradually as network is trained on new tasks. These findings point to novel principles for developing a broad range of continual learning AI solutions.
Mar 22, 2026

Mixture of Chapters: Scaling Learnt Memory in Transformers

Transformers lack an explicit architectural mechanism for storing and organizing knowledge acquired during training. We introduce learnable sparse memory banks: a set of latent tokens, randomly initialized and trained end-to-end, that transformer layers query via cross-attention to retrieve stored knowledge. To scale memory capacity without prohibitive attention costs, we propose chapter-based routing inspired by Mixture-of-Experts architectures, partitioning the memory bank into chapters and training a router to select relevant subsets per input. This enables scaling to 262K memory tokens while maintaining tractable computation. We evaluate our approach against standard transformers (in iso-FLOP settings) on pre-training and instruction fine-tuning across relevant benchmarks. Our models surpass iso-FLOP baselines suggesting scope for a new axis of scaling, demonstrating that explicit associative memory provides complementary capacity to what is captured implicitly in model parameters. Additionally, we observe improved knowledge retention under continued training, with robustness to forgetting when transitioning between training phases (e.g., pretraining to instruction fine-tuning).
Apr 26, 2026

ZenBrain: A Neuroscience-Inspired 7-Layer Memory Architecture for Autonomous AI Systems

ZenBrain is a seven-layer, neuroscience-derived architecture for agent memory in LLM agents. An open library holds the seven layers, a MemoryCoordinator and nine foundational algorithms; six Predictive Memory Architecture components run in a private production system. In the open library at version 0.5.1, decay acts only on working memory and nothing is replayed. Ablating one component at a time exposes an effect we call cooperative masking. The ablation runs in a simulation harness that switches fifteen components as stand-ins at simulated values, not as production code. Under moderate load, fourteen of the fifteen ablations look costless. Raising decay, the horizon, the corpus and the queries, with no change to the components, moves ten of the fifteen in the same direction on all ten seeds - nine losses (Delta-Q down to -93.7%) and one gain. With ten seeds this is the one p-value the normal approximation of the Wilcoxon test can reach (5.06e-3), and it does not pass the Bonferroni-corrected level for fifteen contrasts (3.33e-3). On LongMemEval_S (500 questions), the evaluated ZenBrain arm - a Python port of a scoring class from our test harness, not the seven-layer system - answers 47.7% of the questions correctly under a binary judge (95% interval [43.3, 52.1]). With the compared systems' adapters repaired, Letta reaches 48.4% and Mem0 47.2%. ZenBrain reaches 91.3% of a full-context baseline's accuracy with 1/109.7 of its input tokens in the answer step; building the memory is not counted. Of nine head-to-head comparisons of the retrieved context (3 competitors x 3 LLM judges), three hold at Bonferroni-corrected significance, all against A-Mem, and the remaining six show no significant difference. On LoCoMo, the routing results of version 8 came from placeholder embeddings; with text-embedding-3-small, the flat variant (F1 0.059) lies above the full system (0.058).