Memorization in Generative Models

Overview

Memorization research asks when generative models reproduce training data rather than learn reusable patterns, raising concerns about privacy, copyright, and trustworthy evaluation. Researchers test language models with extraction prompts and canaries, and use membership inference, similarity measures, and functional comparisons; for diffusion models, they also study score geometry, denoising trajectories, and noise schedules. Mitigation approaches include training-time regularization, unlearning and weight filtering, and inference-time steering or sampling changes, evaluated against both memorization and retained generation quality. A central challenge is distinguishing harmful recall from legitimate generalization, since near-duplicates and dataset structure can confound audits, while reducing copying may also weaken fidelity or utility.

Latest papers

CardsList

94 papers7 papers in the last four weeks, down 50% on the four weeks before. 0.1% of all new papers.

  1. Memorization Lives in a Few Attention Heads: Mitigating Memorization in Diffusion Models via Projection-Based Suppression

    Nov 14, 2026Puwei Lian, Yujun Cai, Songze Li +2Memorization in Generative ModelsDiffusion Models

  2. Spectral Signatures of Memorization Basins in Diffusion Trajectories

    Nov 1, 2026Achref Jaziri, Martin Mundt, Ahmed Imtiaz Humayun +1Memorization in Generative ModelsDiffusion Models

  3. TACO: Trajectory-Aware Curvature Observation for Memorization Localization and Mitigation in Diffusion Models

    Oct 30, 2026Ruxi Gu, Zilei Wang, Wei WangMemorization in Generative ModelsDiffusion Models

  4. Valid Early Detection of Memorization in Diffusion Models

    Oct 25, 2026Yixiao Jing, Chia-Yu Hsu, Milad Hoseinpour +1Memorization in Generative ModelsSequential Hypothesis Testing

  5. Information-Theoretic Scaling Laws for Generative Diffusion Training

    Oct 23, 2026Druv Pai, Dejan Stancevic, Yi Ma +1Diffusion ModelsMemorization in Generative Models

  6. Detection of Memorization in Diffusion Models Through Thermodynamic Singularity

    Oct 20, 2026Iljung Kim, Kangwoo Park, Yung-Kyun Noh +1Memorization in Generative ModelsDiffusion Models

  7. Loss Curvature as a Sampling-Free Proxy for Memorization in Diffusion Models

    Oct 13, 2026Shashank Sule, Xinyue Yu, Boonam Shin +3Memorization in Generative ModelsDiffusion Models

  8. Your Discrete Graph Diffusion Model is Secretly Memorizing

    Oct 9, 2026Adarsh Jamadandi, Nicolas KerivenMemorization in Generative ModelsGraph Diffusion

  9. Early Signatures of Memorization in Diffusion Models via Basin Geometry and Cyclic Denoising

    Oct 8, 2026Nikhil Verma, Siddharthan Dileep, Anoop Singh +4Memorization in Generative ModelsDiffusion Models

  10. Memorization and Malign Generalization in Conditional Diffusion Models with Random Features

    Oct 8, 2026Gwangho Kim, Sungyoon LeeRandom Feature MethodsConditional Diffusion Models

  11. Disentangling Paradigm, Identifier, and Decoding in Generative Retrieval

    Oct 6, 2026Hicham Randrianarivo, Logan Renaud, Alexia AllalGenerative RetrievalMemorization in Generative Models

  12. Rethinking Memorization Mitigation in Diffusion Models: Reinforcing Text Conditioning

    Oct 1, 2026Hyungjun Joo, Sehwan Kim, Hyeonggeun Han +2Diffusion Model AlignmentAttention Control in Diffusion Models

  13. From Modes to Memories: Characterizing the Scale-Space Dynamics of Diffusion Models

    Sep 30, 2026Cristina López Amado, Marco Fumero, Francesco LocatelloMemorization in Generative ModelsDiffusion Models

  14. Ghost in the Encoder: Decodable Artist Identity Representations in Lyrics-to-Song Generation

    Sep 30, 2026Arhan Vohra, Choenden Kyirong, Laura Ibáñez-Martínez +1Text-to-Music GenerationAudio Diffusion Models

  15. First Learn, Then Memorize: The Spectral Bias of Diffusion Models

    Sep 28, 2026Raphaël Urfin, Tony Bonnaire, Giulio Biroli +1Neural Network GeneralizationMemorization in Generative Models

  16. Background Gradients Shape Memorization in Flow Matching

    Sep 27, 2026Xuanhua Yin, Boyu Wei, Shuyi Zhang +3Memorization in Generative ModelsFlow-Based Generative Modeling

  17. The Null Is the Hard Part: Exact Tests for Memorization in Generative Models

    Sep 23, 2026Sushovan Majhi, Pramita BagchiPermutation TestingMemorization in Generative Models

  18. Double Descent and Malign Overfitting in Diffusion Models

    Sep 22, 2026Raphaël Urfin, Tony Bonnaire, Giulio Biroli +1Double DescentBenign Overfitting

  19. Mitigating Sequential Reappearance in Diffusion Data-Point Unlearning

    Sep 21, 2026Donghyun Kim, Taehyuk Lee, Jinyeong Kim +4Memorization in Generative ModelsDiffusion Model Unlearning

  20. Copying Versus Randomization in Lempel-Ziv Music Synthesis

    Sep 10, 2026Nadav Mishan, Ram ZamirControllable Music GenerationSymbolic Music Generation

  21. Auditing Patient Privacy in Medical Generative Models: Scalable Memorization Detection with DeepSSIM++

    Sep 3, 2026Antonio Scardace, Francesco Guarnera, Sebastiano Battiato +1Privacy AuditingMemorization in Generative Models

  22. Generalization, memorization, and overfitting for diffusion models trained in the lazy high-dimensional regime

    Aug 25, 2026Hugo Latourelle-Vigeant, Sinho Chewi, Aram-Alexandre Pooladian +2Generative ModelingScore-Based Generative Modeling

  23. An exact information theory of generalization phase transitions in Bayesian diffusion models

    Jul 9, 2026Henry Hunt, Mason Kamb, Surya GanguliMemorization in Generative ModelsDiffusion Models

  24. Cyclic Denoising Reveals Ultrastable Memories in Diffusion Models

    Jun 22, 2026Rishabh Sharma, Stefano MartinianiTraining Data ExtractionDiffusion Model Sampling