Neural Network Memorization

Overview

Neural network memorization concerns how models retain specific examples or facts, from associative recall in Hopfield networks to verbatim or factual recall in language models. Researchers study capacity and training dynamics—including noisy-label fitting and grokking—and use probes, canaries, spectral and geometric measures, and controlled benchmarks to distinguish memorized information from generalizable structure. Methods such as unlearning, parameter editing, and data-reuse strategies aim to remove or manage stored information, while preserving useful performance. A central challenge is that observable recall does not always prove a training example was memorized, and reducing memorization can either protect privacy or impair useful learning.

Latest papers

CardsList

69 papers4 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. An Information Budget for Label-Noise Memorization, and What Statistical Complexity Tracks: A Study with Multilayer Perceptrons

    Nov 3, 2026Nancy Baygorrea C., Otávio da Fonseca Martins GomesNeural Network MemorizationLearning with Noisy Labels

  2. Meta-memorization and memorization scaling laws in transformers

    Nov 1, 2026Alex Nguyen, Kenneth A. Norman, Gautam ReddyNeural Network MemorizationTransformer Training Dynamics

  3. Memory and Recall of Color Images Using Neural Networks-1 - The Cue-Ball Model based on the Associative Memory Mechanism -

    Oct 30, 2026Hiroshi InazawaNeural Network MemorizationAssociative Memory

  4. Memorization Capacity of Invariant Convolutional Neural Nets

    Oct 28, 2026Sjoerd Dirksen, Patrick Finke, Paul GeuchenNeural Network MemorizationConvolutional Neural Networks

  5. A Geometrical Approach to Constructing Neural Networks for Perfect Training-set Classification

    Oct 12, 2026Akos HajnalNeural Network MemorizationImage Classification

  6. Fisher information and the geometry of memorization in neural networks

    Oct 12, 2026Daniel T. Bernstein, Chase Goddard, Luca Di Carlo +2Neural Network MemorizationNeural Network Generalization

  7. Memorization in image classification: test set behavior and scaling laws

    Oct 12, 2026Jeevesh Attri, Florentin GuthNeural Network MemorizationNeural Network Training Dynamics

  8. DeltaNet-PC: Test-Time Memory Without Backpropagation Through Time

    Oct 10, 2026Todd Morrill, Richard ZemelNeural Network MemorizationPredictive Coding

  9. ROTE: Benchmarking Neural Memorization on Complexity-Controlled Symbolic Sequences

    Sep 25, 2026Xinye Chen, Stefan Güttel, Mohammad MozaffariNeural Network MemorizationRecurrent Neural Networks

  10. Memorisation bias in medical AI

    Sep 15, 2026Moritz A. Knolle, Martin J. Menten, Laurin Lux +5Neural Network MemorizationClinical Prediction

  11. PatchBench: Evaluating AI Agents for Vulnerability Patching

    Sep 3, 2026Chihao Shen, Jiacheng Li, Aastha Mahajan +3Automated Program RepairNeural Network Memorization

  12. Tunneling the Loss Landscape: Bypassing Memorization with Monte Carlo Parameter Swapping

    Aug 3, 2026Lai Shun Chan, Xiaotian Zhang, Yue Shang +2Neural Network GeneralizationMarkov Chain Monte Carlo

  13. Free energy landscape of Dense Associative Memory

    Jul 21, 2026Sumedha, Abhishek SinghFree Energy CalculationNeural Network Memorization

  14. Extractable Memorization From First Principles

    Jul 14, 2026A. Feder Cooper, Marika Swanberg, Jamie Hayes +5LLM EvaluationMemorization in Language Models

  15. Fisher Rank Inflation: A Spectral Signature of Memorization under Label Noise

    Jul 14, 2026Satwik Bathula, Anand A. JoshiNeural Network MemorizationNoisy-Label Learning

  16. Random Label Prediction Heads for Studying Memorization in Deep Neural Networks

    Jul 13, 2026Marlon Becker, Jonas Konrad, Luis Garcia Rodriguez +1Neural Network GeneralizationNeural Network Memorization

  17. Train Smarter, Not Longer: Memorization-Guided Data Reuse for Efficient LLM Training

    Jul 6, 2026Jingwei Zuo, Cong Zeng, Ilyas Chahed +6Memorization in Language ModelsNeural Network Memorization

  18. Probing Memorization of Tabular In-Context Learning

    Jun 30, 2026Francesco Capano, Jonas BöhlerTabular Foundation ModelsMembership Inference Attacks

  19. Probe Choice Changes Canary-Memorization Verdicts: Three Post-Hoc Disagreement Case Studies in a Text-Dominant LoRA-Tuned Autoregressive Testbed

    Jun 30, 2026Zhichao Fan, Zexin Zhuang, Yanhang LiMemorization in Language ModelsLLM Auditing