Memory-Augmented Language Models

Ask about this topic

Overview

Memory-augmented language models study how systems can store information from documents, conversations, or earlier tasks and use it in later responses. Approaches include retrieval-augmented generation and structured episodic stores, reusable key-value caches and latent or parametric adapters, and recurrent or fast-weight memories; many add selective writing, compression, routing, or forgetting. Work tests these methods on long-context question answering and recall, reasoning, and continual personalization, using benchmarks such as LoCoMo, LongMemEval, and RULER. Memory can improve access to distant or newly learned information, but systems still struggle with noisy or changing memories, interference with existing capabilities, and evaluations that distinguish successful storage from useful and reliable retrieval.

Latest papers

CardsList

292 papers55 papers in the last four weeks, up 90% on the four weeks before. 0.3% of all new papers.

  1. Adaptive Loops and Memory in Transformers: Think Harder or Know More?

    Mar 9, 2026Markus Frey, Behzad Shomali, Ali Hamza Bashir +3TransformerMemory-Augmented Language Models

    Lamarr Institute · Fraunhofer IAIS · University of Bonn

  2. Can Large Language Models Keep Up? Benchmarking Online Adaptation to Continual Knowledge Streams

    Mar 8, 2026Jiyeon Kim, Hyunji Lee, Dylan Zhou +6LLM EvaluationContinual Learning for LLMs

    KAIST AI · UNC Chapel Hill · Google +3

  3. MSA: Memory Sparse Attention for Efficient End-to-End Memory Model Scaling to 100M Tokens

    Mar 6, 2026Yu Chen, Runkai Chen, Sheng Yi +9Memory-Augmented Language ModelsLong-Context Language Modeling

    Evermind · Shanda Group · Peking University

  4. MemSifter: Offloading LLM Memory Retrieval via Outcome-Driven Proxy Reasoning

    Mar 3, 2026Jiejun Tan, Zhicheng Dou, Liancheng Zhang +3Memory-Augmented Language ModelsPersistent Memory for Language Models

    Gaoling School of Artificial Intelligence · Renmin University of China · Beijing, China

  5. GAM-RAG: Gain-Adaptive Memory for Evolving Retrieval in Retrieval-Augmented Generation

    Mar 2, 2026Yifan Wang, Mingxuan Jiang, Zhihao Sun +5Retrieval-Augmented GenerationAdaptive RAG

    1Fudan University.

  6. Understanding LoRA as Knowledge Memory: An Empirical Analysis

    Mar 1, 2026Seungju Back, Dongwoo Lee, Naun Kang +4Continual Learning for LLMsMemory-Augmented Language Models

    KAIST · Samsung SDS · New York University

  7. Memory Caching: RNNs with Growing Memory

    Feb 27, 2026Ali Behrouz, Zeman Li, Yuan Deng +3Recurrent Neural NetworksMemory-Augmented Language Models

  8. KEEP: A KV-Cache-Centric Memory Management System for Efficient Embodied Planning

    Feb 27, 2026Zebin Yang, Tong Xie, Baotong Lu +3Agent Memory ManagementMemory-Augmented Language Models

    Institute for Artificial Intelligence · School of Integrated Circuits · Microsoft Research +2

  9. ParamMem: Augmenting Language Agents with Parametric Reflective Memory

    Feb 26, 2026Tianjun Yao, Yongqiang Chen, Yujia Zheng +3Self-Reflection in Language Model AgentsMemory-Augmented Language Model Agents

    Mohamed bin Zayed University of Artificial Intelligence · Carnegie Mellon University · Georgia Institute of Technology

  10. SR-TTT Does Not Learn Retrieval: A Correction and Mechanistic Post-Mortem of Surprisal-Aware Residual Test-Time Training

    Feb 26, 2026Swamynathan V PMemory-Augmented Language ModelsTest-Time Training

    Department of Computer Science and Engineering Amrita School of Computing Amrita Vishwa Vidyapeetham Chennai, Tamil Nadu, India

  11. Efficient Continual Learning in Language Models via Thalamically Routed Cortical Columns

    Feb 25, 2026Afshin KhadangiContinual Learning for LLMsDecoder-Only Language Models

    SnT, University of Luxembourg

  12. Adaptive Engram Memory System for Indonesian Language Model: Generative AI Based on TOBA LM for Batak and Minang Language

    Feb 17, 2026Hokky Situngkir, Kevin Siringoringo, Andhika Bernard LumbantobingLanguage Model PretrainingMultilingual Language Models

    AI Research Center IT Del & Bandung Fe Institute · Bandung Fe Institute · Bandung Fe Institute & Adjunct Science Fellow in InaAI

  13. ER-MIA: Black-Box Adversarial Memory Injection Attacks on Long-Term Memory-Augmented Large Language Models

    Feb 17, 2026Mitchell Piehl, Zhaohan Xi, Zuobin Xiong +2Adversarial Attacks on LLMsLLM Security

    Department of Computer Science, The University of Iowa · School of Computing, State University of New York at Binghamton · Department of Computer Science, University of Nevada, Las Vegas +1

  14. Panini: Continual Learning in Token Space via Structured Memory

    Feb 16, 2026Shreyas Rajesh, Pavan Holur, Mehmet Yigit Turali +2Continual Learning for LLMsMemory-Augmented Language Models

    Department of Electrical and Computer Engineering, University of California, Los Angeles, USA.

  15. Towards robust long-context understanding of large language model via active recap learning

    Jan 20, 2026Chenyu HuiMemory-Augmented Language ModelsLLM Context Compression

    School of Microelectronics, Xi’an Jiaotong University, Xi’an, China

  16. SPRInG: Continual LLM Personalization via Selective Parametric Adaptation and Retrieval-Interpolated Generation

    Jan 15, 2026Seoyeon Kim, Jaehyung KimContinual Learning for LLMsLLM Personalization

    Yonsei University

  17. Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

    Jan 12, 2026Xin Cheng, Rui Tian, Wangding Zeng +18Memory-Augmented Language ModelsLanguage Model Scaling Laws

    Peking University · DeepSeek-AI

  18. MemBuilder: Reinforcing LLMs for Long-Term Memory Construction via Attributed Dense Rewards

    Jan 9, 2026Zhiyu Shen, Ziming Wu, Fuming Lai +2Reinforcement LearningMemory-Augmented Language Models

    School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Tencent Inc.

  19. Role-aware Heuristic Episodic Attention for Conversational LLMs

    Dec 7, 2025Wanyang Hong, Zhaoning Zhang, Yi Chen +5LLM Context ManagementMemory-Augmented Language Models

    National Key Laboratory of Parallel and Distributed Computing College of Computer Science and Technology National University of Defense Technology, Changsha, China.

  20. PERK: Long-Context Reasoning as Test-Time Learning

    Jul 8, 2025Zeming Chen, Angelika Romanou, Gail Weiss +1Memory-Augmented Language ModelsLong-Context Modeling

    EPFL

  21. You Do Not Fully Utilize Transformer's Representation Capacity

    Feb 13, 2025Gleb Gerasimov, Yaroslav Aksenov, Nikita Balagansky +2Representation CollapseMemory-Augmented Language Models

    1T-Tech · 2Moscow Institute of Physics and Technology · 3HSE University

  22. Attention is All You Need Until You Need Retention

    Jan 15, 2025M. Murat YasliogluMemory-Augmented Language ModelsAgent Memory Poisoning

    Istanbul University, School of Business