Memory-Augmented Language Models

Ask about this topic

Overview

Memory-augmented language models study how systems can store information from documents, conversations, or earlier tasks and use it in later responses. Approaches include retrieval-augmented generation and structured episodic stores, reusable key-value caches and latent or parametric adapters, and recurrent or fast-weight memories; many add selective writing, compression, routing, or forgetting. Work tests these methods on long-context question answering and recall, reasoning, and continual personalization, using benchmarks such as LoCoMo, LongMemEval, and RULER. Memory can improve access to distant or newly learned information, but systems still struggle with noisy or changing memories, interference with existing capabilities, and evaluations that distinguish successful storage from useful and reliable retrieval.

Latest papers

CardsList

292 papers55 papers in the last four weeks, up 90% on the four weeks before. 0.3% of all new papers.

  1. AnchorMem: Anchored Facts with Associative Contexts for Building Memory in Large Language Models

    Apr 19, 2026Zhanyu Shen, Sijie Cheng, Zhicheng Guo +3Memory-Augmented Language ModelsMemorization in Language Models

    College of Computer Science and Software Engineering, Shenzhen University · Tsinghua University

  2. The Continuity Layer: Why Intelligence Needs an Architecture for What It Carries Forward

    Apr 19, 2026Samuel Sameer TanguturiMemory-Augmented Language ModelsPersistent Memory for Language Models

    Kenotic Labs

  3. LANTERN: Layered Archival and Temporal Episodic Retrieval Network for Long-Context LLM Conversations

    Apr 18, 2026Rahul SubramaniMemory-Augmented Language ModelsPersistent Memory for Language Models

    Cisco Systems, Inc.

  4. Generic Triple-Latent Compression with Gated Associative Retrieval

    Apr 17, 2026Liu XiaoMemory-Augmented Language ModelsAutoregressive Language Modeling

  5. Response-Aware User Memory Selection for LLM Personalization

    Apr 15, 2026Jillian Fisher, Jennifer Neville, Chan Young ParkLLM PersonalizationMemory-Augmented Language Models

    Department of Computer Science and Engineering, University of Washington, Seattle, WA, United States of America · Microsoft Research, Redmond, WA, United States of America

  6. MemCoT: Test-Time Scaling through Memory-Driven Chain-of-Thought

    Apr 9, 2026Haodong Lei, Junming Liu, Yirong Chen +2Long-Context Reasoning in Language ModelsMemory-Augmented Language Models

    Southeast University Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory Shanghai, China

  7. TSUBASA: Improving Long-Horizon Personalization via Evolving Memory and Self-Learning with Context Distillation

    Apr 9, 2026Xinliang Frederick Zhang, Lu WangPersonalized Language ModelsMemory-Augmented Language Models

    Computer Science and Engineering, University of Michigan, Ann Arbor, MI

  8. Efficient and Effective Internal Memory Retrieval for LLM-Based Healthcare Prediction

    Apr 8, 2026Mingchen Li, Jiatan Huang, Zonghai Yao +1Memory-Augmented Language ModelsMedical LLMs

    University of Massachusetts, Amherst · University of Connecticut · University of Massachusetts, Lowell +1

  9. Improving Sparse Memory Finetuning

    Apr 6, 2026Satyam Goyal, Anirudh Kanchi, Garv Shah +1Continual Learning for LLMsSparse Fine-Tuning

    University of Michigan, Ann Arbor

  10. Phase-Associative Memory: Sequence Modeling in Complex Hilbert Space

    Apr 6, 2026Gowrav Vishwakarma, Christopher J. AgostinoAutoregressive Language ModelingComplex-Valued Neural Networks

    Xavoc Technocrats Pvt. Ltd., https: // xavoc. com , India · NPC Worldwide, Bloomington, Indiana 47403, USA

  11. Procedural Knowledge at Scale Improves Reasoning

    Apr 1, 2026Di Wu, Devendra Singh Sachan, Wen-tau Yih +1Retrieval-Augmented ReasoningLLM Reasoning

    University of California, Los Angeles · Meta FAIR

  12. Human-Like Lifelong Memory: A Neuroscience-Grounded Architecture for Infinite Interaction

    Mar 30, 2026Diego C. Lerma-TorresPersistent Memory for Language ModelsLong-Term Conversational Memory

    Universidad de Guanajuato

  13. The Root Theorem of Context Engineering

    Mar 29, 2026Borja Odriozola SchickContext EngineeringLLM Context Management

    Independent Researcher

  14. Beyond Acoustic Prefixes: Persistent Access to Serialized Acoustic Memory for LLM-Based Multi-Talker Speech Recognition

    Mar 28, 2026Hao Shi, Yuan Gao, Xugang Lu +1Multi-Speaker ASRMemory-Augmented Language Models

    Graduate School of Informatics, Kyoto University, Kyoto, Japan · National Institute of Information and Communications Technology, Japan

  15. MemBoost: A Memory-Boosted Framework for Cost-Aware LLM Inference

    Mar 27, 2026Joris Köster, Zixuan Liu, Siavash Khajavi +1LLM Inference ServingCost-Aware Inference

    Department of Computer Science, Aalto University, Finland · Department of Computer Science, Tulane University, LA, USA · Department of Industrial Engineering and Management, Aalto University, Finland

  16. Enhanced Mycelium of Thought (EMoT): A Bio-Inspired Hierarchical Reasoning Architecture with Strategic Dormancy and Mnemonic Encoding

    Mar 25, 2026Florian Odi StummerLLM PromptingMemory-Augmented Language Models

    Institute of General Medicine Martin Luther University Halle-Wittenberg, Germany

  17. TAMTRL: Teacher-Aligned Reward Reshaping for Multi-Turn Reinforcement Learning in Long-Context Compression

    Mar 23, 2026Li Wang, Yandong Wang, Xin Yu +3RL for Language ModelsLong-Context Language Modeling

    School of Artificial Intelligence, Beihang University, Beijing, 100191, China · Hangzhou International Innovation Institute, Beihang University, Hangzhou, China · Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University, Beijing, China

  18. HUOZIIME: An On-Device LLM-enhanced Input Method for Deep Personalization

    Mar 23, 2026Baocai Shan, Yuzhuang Xu, Wanxiang ChePersonalized Language ModelsOn-Device Language Model Inference

    Harbin Institute of Technology, Harbin, China

  19. Generalizable Self-Evolving Memory for Automatic Prompt Optimization

    Mar 23, 2026Guanbao Liang, Yuanchen Bei, Sheng Zhou +5Automatic Prompt OptimizationLanguage Model Self-Improvement

    Zhejiang University · University of Illinois Urbana-Champaign · Alibaba Group

  20. Mixture of Chapters: Scaling Learnt Memory in Transformers

    Mar 22, 2026Tasmay Pankaj Tibrewal, Pritish Saha, Ankit Meda +2Memory-Augmented Language ModelsPersistent Memory for Language Models

    IIT Kharagpur · Fractal AI

  21. MKA: Memory-Keyed Attention for Efficient Long-Context Reasoning

    Mar 21, 2026Dong Liu, Yanxuan Yu, Ben Lengerich +1Attention MechanismsMemory-Efficient Attention

    University of California, Los Angeles, Los Angeles, California, USA · Columbia University, New York, New York, USA · University of Wisconsin-Madison, Madison, Wisconsin, USA

  22. A Training-Free Regeneration Paradigm: Contrastive Reflection Memory Guided Self-Verification and Self-Improvement

    Mar 20, 2026Yuran Li, Di Wu, Benoit BouletLanguage Model Self-VerificationLanguage Model Self-Improvement

    Department of Electrical and Computer Engineering, McGill University · Department of Mechanical, Industrial and Aerospace Engineering, Concordia University

  23. Trained Persistent Memory for Frozen Decoder-Only LLMs

    Mar 20, 2026Hong JeongPersistent Memory for Language ModelsMemory-Augmented Language Models

    Inha University in Tashkent, Uzbekistan

  24. Trained Persistent Memory for Frozen Encoder--Decoder LLMs: Six Architectural Methods

    Mar 17, 2026Hong JeongPersistent Memory for Language ModelsMemory-Augmented Language Models

    Inha University in Tashkent, Uzbekistan

  25. Selective Memory for Artificial Intelligence: Write-Time Gating with Hierarchical Archiving

    Mar 16, 2026Oliver Zahn, Simran ChanaMemory-Augmented Language ModelsPersistent Memory for Language Models

    Independent Researcher · University of Cambridge

  26. Evolving Contextual Safety in Multi-Modal Large Language Models via Inference-Time Self-Reflective Memory

    Mar 16, 2026Ce Zhang, Jinxi He, Junyi He +2Multimodal Large Language ModelsLanguage Model Safety Evaluation

    Robotics Institute, Carnegie Mellon University

  27. Learning to Forget: Sleep-Inspired Memory Consolidation for Resolving Proactive Interference in Large Language Models

    Mar 15, 2026Ying XieKV-Cache ManagementKnowledge Conflicts in Language Models

    Kennesaw State University

  28. GradMem: Learning to Write Context into Memory with Test-Time Gradient Descent

    Mar 14, 2026Yuri Kuratov, Matvey Kairov, Aydar Bulatov +2Memory-Augmented Language ModelsContext Compression

    AXXX, Cognitive AI Systems Lab, Moscow, Russia · MIRAI, Moscow, Russia · MBZUAI, Abu Dhabi, UAE +1

  29. StatePlane: A Cognitive State Plane for Long-Horizon AI Systems Under Bounded Context

    Mar 13, 2026Sasank Annapureddy, John Mulcahy, Anjaneya Prasad ThamataniLLM Context ManagementPersistent Memory for Language Models

  30. LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling

    Mar 12, 2026Keqin XieLong-Context Language ModelingAutoregressive Language Modeling

    Independent Researcher, Suzhou, China