Dense Associative Memory

Follow this topic Ask about this topic

Momentum

9 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 40

All topics

Learning Under Forgetting: Statistical Support-Selective Retention in Stochastic Training Dynamics
Sep 30, 2026Fujie Gao, Zuyue Zhang, Gang SunDense Associative Memory Synaptic Plasticity
Intrinsic Associative Memory on Riemannian Manifolds: Curvature, Capacity, and Emergent Modes
Sep 28, 2026Krishnakumar Balasubramanian, Zhaoyang ShiDense Associative Memory Riemannian Manifolds
Department of Statistics, University of California, Davis. · Center for Applied Mathematics, Fudan University.
DRAM: Delta-rule Recurrent Associative Memory for Robot Manipulation Policies
Sep 26, 2026Xinyu Zhao, Yixiang Shan, Tao Yang +5Robot Policies Robotic Manipulation Policies
Simplexity Robotics
MemBodied: Recurrent Associative Memory for Vision-Language-Action Models
Sep 23, 2026Tej Deep Pala, Navonil Majumder, Bryce Goh +4Generalizable Vision-Language-Action Policies Embodied
Nanyang Technological University · Griffin Labs · École Centrale de Lyon
Bias-Induced Crossover in Absolute Capacity of Dense Associative Memory
Sep 15, 2026Yuto Sakurai, Takeaki Shimokawa, Kazunori Iwata +1Dense Associative Memory Hopfield Networks
Graduate School of Information Sciences, Hiroshima City University, 3-4-1 Ohtsuka-higashi, Asaminami-ku, Hiroshima 731-3194, Japan · RIKEN Center for Advanced Intelligence Project and The University of Tokyo
Anatomy of Associative Recall in Fixed-State Recurrences: A Matched-State Decomposition, an Interference Wall, and a Curriculum That Breaks It
Sep 14, 2026Julian Boesch, Andrew WeeDense Associative Memory Recurrent State
1Purdue University · 2Obit Research
Hierarchical Prototype Emergence in Modern Hopfield Models
Sep 14, 2026Aditya Cowsik, Adithya SriramHopfield Networks Dense Associative Memory
Department of Physics, Stanford University, Stanford, CA 94305, USA
Kalman Delta Networks: Uncertainty-aware Associative Memory
Sep 7, 2026Ngoc Bui, Tinglin Huang, Rex YingKimi Delta Attention Linear Attention
Department of Computer Science, Yale University
On the Recall Scaling Laws in Mamba: A Theoretical and Mechanistic Study via Hashing
Sep 7, 2026Yuval Koren, Assaf Ben-Kish, Raja Giryes +2Dense Associative Memory Factual Recall
Blavatnik School of Computer Science and AI, Tel Aviv University
Basin Geometry and Reliable Recall of Dynamical Memories in Reservoir Computing
Sep 1, 2026Ling-Wei Kong, Ying-Cheng LaiReservoir Computing Dense Associative Memory
Department of Computational Biology, Cornell University, Ithaca, NY 14850, USA · School of Electrical, Computer, and Energy Engineering, Arizona State University, Tempe, AZ 85287, USA · Department of Physics, Arizona State University, Tempe, Arizona 85287, USA
SSAKG 2.0: An Open-Source Package for Structural Associative Sequence Memory and Context-Based Retrieval
Sep 1, 2026Przemysław Stokłosa, Janusz A. Starzyk, Paweł RaifKnowledge Graphs Dense Associative Memory
Institute of Management and Information Technology Bielsko-Biała, Poland · University of Information Technology and Management Rzeszów, Poland · Silesian University of Technology Gliwice, Poland
Associative Emotional Learning in Convolutional Neural Networks
Jul 21, 2026Seowung Leem, Andreas Keil, Mingzhou Ding +1Dense Associative Memory Neural Network
J. Crayton Pruitt Family Dept. of Biomedical Engineering, University of Florida, Gainesville, FL 32611, USA · Center for the Study of Emotion and Attention, University of Florida, Gainesville, Florida, USA · Department of Electrical and Computer Engineering, University of Florida, Gainesville, FL 32611, USA +3
Free energy landscape of Dense Associative Memory
Jul 21, 2026Sumedha, Abhishek SinghDense Associative Memory Hopfield Networks
School of Physical Sciences, National Institute of Science Education and Research, Bhubaneswar, P.O. Jatni, 752050, India · 2Homi Bhabha National Institute, Training School Complex, Anushakti Nagar 400094, India
Extending LLM Context via Associative Recurrent Memory
Jul 13, 2026Gleb Kuzmin, Ivan Rodkin, Aydar Bulatov +8Efficient Long-Context Inference Instruction-Tuned Models
1FusionBrain Lab 2MBZUAI 3Cognitive AI Systems Lab 4RUDN · 2MBZUAI · 6MIRAI +5
Creating Intelligence: A Computational Foundation for AGI
Jun 30, 2026Peter OvermannBrain-Inspired Synergistic Framework Dense Associative Memory
Distributed Hierarchical Temporal Memory with Shared Associative Memory for Cross-Entity Preemptive Warning
Jun 30, 2026Pavia Bera, Jennifer Adorno, Sanjukta BhanjaTime-Series Anomaly Detection Graph Anomaly Detection
University of South Florida, Tampa, FL, USA
Explaining Machine Learning and Memorization with Statistical Mechanics
Jun 30, 2026Robin TheriaultDense Associative Memory Neural Network
Faculty of Science
Active Adversarial Perturbation-driven Associative Memory Retrieval for RGB-Event Visual Object Tracking
Jun 24, 2026Xiao Wang, Xufeng Lou, Zikang Yan +5Rgb-Event Object Tracking Multimodal Fusion
School of Electronic and Computer Engineering, Shenzhen Graduate School, Peking University, China
Reasoning as Attractor Dynamics: Latent Memory Retrieval via Gibbs-Weighted Energy Minimization
Jun 23, 2026Kanishk AwadhiyaDense Associative Memory Mathematical Reasoning
Independent Researcher
Parallel Manifold Steering: Efficient Adaptation of Large Associative Memories via Residual Energy Shaping
Jun 23, 2026Kanishk AwadhiyaDense Associative Memory Transformer Architectures
Independent Researcher
How Should a Robot Configure Its Laser Scanner for Inspection?
Jun 19, 2026Zhiling Chen, David Gorsich, Matthew P. Castanier +3Robotic Perception Inspection
University of Connecticut, Storrs, CT, USA · US Army DEVCOM Ground Vehicle Systems Center (GVSC), Warren, MI, USA
Why SWAVE May Not Be All You Need:A Concept-Evolution Retrospective on Complex-Valued Recurrent Language Models
Jun 16, 2026Ramprasath Ganesaraja, Swathika N, Sahil Dilip PanseCollapse Dense Associative Memory
EdgeVerve Systems Limited
Turning music identification into a neural forward pass
Jun 15, 2026Muhammad Taimoor Haseeb, Ahmad Hammoudeh, Gus XiaMusic Structure Analysis Neural Audio
Music X Lab, Mohamed Bin Zayed University of Artificial Intelligence, UAE
AI Engram: In Search of Memory Traces in Artificial Intelligence
Jun 12, 2026Jea Kwon, Dong-Kyum Kim, Jiwon Kim +3Dense Associative Memory Neural Circuits
Max Planck Institute for Security and Privacy (MPI-SP), Bochum, Germany · Seoul National University (SNU), Seoul, Korea · KAIST, Daejeon, Korea
Robust Auto-associative Memory via Convolutional Restricted Hopfield Networks
Jun 11, 2026Ci Lin, Tet Yeap, Iluju KiringaDense Associative Memory Hopfield Networks
Electrical Engineering and Computer Science University of Ottawa
Balancing Fidelity and Diversity in Diffusion Models via Symmetric Attention Decomposition: Hopfield Perspective
May 26, 2026Hyunmin Cho, Woo Kyoung Han, Kyong Hwan JinTransformer Attention Hopfield Networks
Department of Electrical Engineering, Korea University, Seoul, South Korea.
Bridging Silicon and the Hippocampus: Algebro-Deterministic Memory "VaCoAl" as a Substrate for Vector-HaSH and TEM
May 15, 2026Hiroyuki Chuma, Kanji Otsuka, Yoichi SatoDense Associative Memory Human Visual Cortex
Institute of Innovation Research, Hitotsubashi University, Kunitachi, Tokyo 186-8603, Japan · Meisei University, Hino, Tokyo, Japan · Shuhari System, Tokyo, Japan
Variational Linear Attention: Stable Associative Memory for Long-Context Transformers
May 11, 2026Vishal Pandey, Gopal SinghKimi Delta Attention Linear Attention
Independent Researcher London, UK · Metriqual Athens, GR
Factual recall in linear associative memories: sharp asymptotics and mechanistic insights
May 11, 2026Alessio Giorlandino, Sebastian Goldt, Antoine MaillardDense Associative Memory Factual Recall
1International School of Advanced Studies (SISSA), Trieste, Italy · 2INRIA Paris & DI ENS, PSL University, Paris, France
Hyperparameter Transfer for Dense Associative Memories
May 11, 2026Roi Holtzman, Dmitry Krotov, Boris HaninDense Associative Memory Hyperparameter
Rudolf Peierls Centre for Theoretical Physics, University of Oxford, Oxford OX1 3PU, UK · Dynamical Mind, IBM Research · Princeton
Context-Gated Associative Retrieval: From Theory to Transformers
May 8, 2026Moulik Choraria, Argyrios Gerogiannis, Vidhata Jayaraman +2Dense Associative Memory In-Context Learning
UIUC · University of Minnesota, Twin Cities · Stony Brook University
Efficient event-driven retrieval in high-capacity kernel Hopfield networks
May 7, 2026Akira TamamoriHopfield Networks Neuromorphic Computing
Faculty of Information Science, Aichi Institute of Technology 1247 Yachigusa, Yakusa-cho, Toyota-shi, Aichi 470-0392, Japan
Sharp Capacity Thresholds in Linear Associative Memory: From Winner-Take-All to Listwise Retrieval
May 6, 2026Nicholas Barnfield, Juno Kim, Eshaan Nichani +2Dense Associative Memory Full-Rank Correlation Matrices
Harvard University · University of California, Berkeley · Princeton University
FAAST: Forward-Only Associative Learning via Closed-Form Fast Weights for Test-Time Supervised Adaptation
May 6, 2026Guangsheng Bao, Hongbo Zhang, Han Cui +4Parameter-Efficient Adaptation Efficient Task Adaptation
Zhejiang University · Westlake University · Shanghai Polytechnic University +1
Learning Hippo: Multi-attractor Dynamics and Stability Effects in a Biologically Detailed CA3 Extension of Hopfield Networks
Apr 22, 2026Daniele Corradetti, Renato CorradettiHopfield Networks Dense Associative Memory
Grupo de Física Matemática Instituto Superior Técnico Av. Rovisco Pais, 1049-001 Lisboa, Portugal · Dipartimento di Neuroscienze, Psicologia, Area del Farmaco e Salute del Bambino (NEUROFARBA) Università di Firenze, Italy22
Where to Bind Matters: Hebbian Fast Weights in Vision Transformers for Few-Shot Character Recognition
Apr 22, 2026Gavin Money, Sindhuja Penchala, Jiacheng Li +1Vision Transformer Dense Associative Memory
Department of Computer Science, The University of Alabama, Tuscaloosa, AL, USA
SRMU: Relevance-Gated Updates for Streaming Hyperdimensional Memories
Apr 16, 2026Shay Snyder, Andrew Capodieci, David Gorsich +1Dense Associative Memory Non-Stationarity
George Mason University · George Mason University, USA · Neya Robotics +3
Attractor-Keyed Memory
Mar 17, 2026Natalia G. BerloffDense Associative Memory Signatures
Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge CB3 0WA, United Kingdom
Distributed Dynamic Associative Memory via Online Convex Optimization
Nov 28, 2025Bowen Wang, Matteo Zecchin, Osvaldo SimeoneDecentralized Optimization Dense Associative Memory
Department of Engineering, King’s College London, London WC2R 2LS, U.K. · Communication Systems Department, EURECOM, 06904 Sophia Antipolis, France · Institute for Intelligent Networked Systems (INSI) at Northeastern University London, London E1 8PH, U.K.
Redundancy Maximization as a Principle of Associative Memory Learning in Hopfield Networks
Nov 4, 2025Mark Blümel, Andreas C. Schneider, Valentin Neuhaus +5Hopfield Networks Dense Associative Memory
Complex Systems Theory, Max Planck Institute for Dynamics and Self-Organization, Göttingen, Germany · Faculty of Physics, Institute for the Dynamics of Complex Systems, University of Göttingen · Göttingen Campus Institute for Dynamics of Biological Networks, University of Göttingen, Göttingen, Germany +1

Sep 30, 2026, cs.LGJ/K move · Enter open · S save

Learning Under Forgetting: Statistical Support-Selective Retention in Stochastic Training Dynamics

Fujie Gao, Zuyue Zhang, Gang Sun

Dense Associative Memory Synaptic Plasticity Forgetting Retention

Open paper AskPDF arXiv

Prior work has shown that neural networks exhibit implicit biases toward low-complexity structure (e.g., spectral bias), memorization dynamics, and compression-like effects during training, but a unified dynamical account of selective retention remains incomplete. We propose Repeated Reinforcement with Persistent Forgetting (RPF) dynamics, a minimal framework in which repeated exposure reinforces patterns and structures that recur in the data, while persistent forgetting attenuates learned information. This view treats forgetting not merely as a failure mode, but as a selection mechanism. We build the theory in three successive layers. First, in an independent-feature model, we derive an exposure-selective survival law and a support-dependent retention boundary characterizing which patterns persist under forgetting. Second, in a shared-parameter model, we show that forgetting induces spectral filtering over covariance modes, preserving strongly supported shared components while suppressing weak ones. Third, under small-step and norm/coding approximations, we show how RPF dynamics induce an implicit trade-off between data fitting and the cost of stored information, yielding Minimum Description Length (MDL)-like compression. Controlled experiments provide evidence for this reinforcement--forgetting selection mechanism in scalar memories and a nonlinear shared network. Joint reinforcement and attenuation interventions shift conditional retention, while matched exposure counts reveal forgetting-dependent effects of reinforcement timing and changes in the composition of the retained set. Together, these results show that repeated reinforcement and persistent forgetting jointly provide a controllable source of inductive bias beyond neural architecture and scale.

Momentum

Related topics

Latest papers 40