Memory-Augmented Language Models

Ask about this topic

Overview

Memory-augmented language models study how systems can store information from documents, conversations, or earlier tasks and use it in later responses. Approaches include retrieval-augmented generation and structured episodic stores, reusable key-value caches and latent or parametric adapters, and recurrent or fast-weight memories; many add selective writing, compression, routing, or forgetting. Work tests these methods on long-context question answering and recall, reasoning, and continual personalization, using benchmarks such as LoCoMo, LongMemEval, and RULER. Memory can improve access to distant or newly learned information, but systems still struggle with noisy or changing memories, interference with existing capabilities, and evaluations that distinguish successful storage from useful and reliable retrieval.

Latest papers

CardsList

292 papers55 papers in the last four weeks, up 90% on the four weeks before. 0.3% of all new papers.

  1. ParaTTT: Parallelizing Test-Time Training Layers with Deep Memories

    Oct 28, 2026Noel Loo, Neehal Tumma, T. Konstantin Rusch +3Test-Time TrainingRecurrent Language Models

    MIT CSAIL · Liquid AI · Max Planck Institute for Intelligent Systems

  2. ETAMem: Decoupling and Aligning Heterogeneous Memory for Long-Term Conversational Agents

    Oct 27, 2026Xinying Qian, Ying Zhang, Yu Zhao +3Memory Management for LLM AgentsLong-Term Conversational Memory

    Nankai University, Tianjin, China · Tiangong University, Tianjin, China · The University of Edinburgh, Edinburgh, United Kingdom

  3. CRIM: Composable and Reusable Item Memory for Efficient Personalized Retrieval

    Oct 26, 2026Haolin Li, Haipeng Zhang, Mang Li +5Information RetrievalMemory-Augmented Language Models

    Tsinghua University, Beijing, China · Alibaba International Digital Commerce Group, Beijing, China

  4. Let the Gate Decide: Per-Lookup Precision for Quantized Conditional Memory in LLMs

    Oct 26, 2026Tianqi Chen, Xunchao Li, Linchuan Xie +4Memory-Augmented Language ModelsLLM Quantization

    C2DL, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Tencent

  5. Can Test-Time Memory Evolution Outperform Test-Time Training for Scientific Discovery?

    Oct 23, 2026Yepeng Liu, Shengmai Chen, Xuandong Zhao +4Test-Time AdaptationLarge Language Model-Guided Scientific Discovery

    UC Santa Barbara · UC Berkeley

  6. Memory-Aware Reward Modeling: Learning Human Preferences for LLM Memory Use

    Oct 22, 2026Yijiang River Dong, Zexue He, Cheng Yu +9Memory-Augmented Language ModelsReward Modeling

    University of Cambridge · Stanford University · Technical University of Munich +2

  7. Delta N-gram: Forward-Only Continual Writing into a Language Model's Native N-gram Memory

    Oct 22, 2026Hao WuPersistent Memory for Language ModelsMemory-Augmented Language Models

    Illinois Institute of Technology

  8. MemT-1.0: Towards Memory-Native Evolution

    Oct 19, 2026Zhiyu Li, Zeyu Zhang, Linyun Liu +71Memory-Augmented Language ModelsPersistent Memory for Language Models

  9. Mixture-of-Memories: Low-Overhead Language Modeling with Modular Knowledge Injection

    Oct 18, 2026Yifan Lu, Rubin Wei, Ziyun Zou +8Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    MBZUAI, Abu Dhabi, UAE · LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University, China · The Chinese University of Hong Kong, Hong Kong +1

  10. Atoms, Not Knowledge: What Production-Scale Addressed-Memory Writes Deposit

    Oct 18, 2026Wei Gao, Cheng Tian, Duan Yang +1Memory-Augmented Language ModelsPersistent Memory for Language Models

    Shibei Qiyuan AI Technology · Xi’an Jiaotong University

  11. Deep Fusion Memory: A Chunk-Level Parametric Memory for Large Language Models

    Oct 18, 2026Rubin Wei, Siyuan Sun, Hao Sun +5Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory

  12. Reasoning with Context Management and External Memory

    Oct 16, 2026Man-Ling Sung, William Hartmann, Jiangying ZhouLLM Context ManagementEfficient Language Model Reasoning

    RTX BBN Technologies, Cambridge MA, USA

  13. Cache2LoRA: Understanding and Improving Context Internalization

    Oct 16, 2026Yi Fang, Gaurav Srivastava, Zhenyu Bi +2LLM Context CompressionKnowledge Augmentation for Language Models

    Department of Computer Science, Virginia Tech, Blacksburg, VA, USA · Department of Biomedical Data Science, Stanford University, Stanford, CA, USA

  14. Causal Latent Workspaces for Looped Transformers

    Oct 16, 2026Ilia ZaznovAutoregressive Language ModelingMemory-Augmented Language Models

  15. Hy-Memory-30B-A3B: Attributed Reinforcement Learning for Long-Term Memory Writing

    Oct 15, 2026Tianxiang Fei, Jiazheng Kang, Mao Zheng +2Memory-Augmented Language ModelsPersistent Memory for Language Models

    Tencent Hunyuan

  16. N-Gram Memories at Two Bits: Quantizing Lookup Tables in Large Language Models

    Oct 15, 2026Donghoon Han, Minseop Jung, Dong Woo Kwak +2Memory CompressionLLM Compression

    Dnotitia Inc. · KAIST

  17. Writability and the Pathway: A Controlled Study of Knowledge Injection into Addressed Memory

    Oct 15, 2026Wei Gao, Cheng Tian, Duan Yang +1Knowledge Augmentation for Language ModelsKnowledge Editing

    Shibei Qiyuan AI Technology · Xi'an Jiaotong University

  18. Memorilla: Latent Semantic Memory for LLMs

    Oct 15, 2026Adibvafa Fallahpour, Parsa Idehpour, Vignesh Kothapalli +4Memory-Augmented Language ModelsPersistent Memory for Language Models

    Stanford University · University of Toronto · Vector Institute +3

  19. FOLD: Position-Free Far Memory with Local Order for Long-Context Speculative Decoding

    Oct 14, 2026Shuxuan Li, Jialiang Kang, Yanghao Zhou +2Speculative DecodingLong-Context Language Model Inference

    Sun Yat-sen University · Canva Research · Peking University

  20. Evaluating Compressed Memory: Dependence, Utility, and Content Benefit

    Oct 14, 2026Minsu Oh, Seunghui Jwa, Chanjun Park +1Memory-Augmented Language ModelsLLM Evaluation

    Department of Artificial Intelligence, Jeju National University · School of Software, Soongsil University

  21. Titan-Llama: Retrofitting Pre-trained LLMs with External Neural Memory Modules

    Oct 13, 2026Sarah Pan, Ali BehrouzLong-Context Language Model InferenceMemory-Augmented Language Models

    Massachusetts Institute of Technology · Cornell University

  22. Depth Memory

    Oct 13, 2026David González-Martínez, Philipp Nazari, T. Konstantin Rusch +1Memory-Augmented Language ModelsAssociative Memory

    ELLIS Institute Tübingen · Max Planck Institute for Intelligent Systems, Tübingen · Tübingen AI Center +2

  23. Encoding Context into LLM Weights: What Makes It Context?

    Oct 13, 2026Yue Wang, Qizhou Wang, Feng Liu +3LLM Context ManagementTest-Time Training

    The University of Melbourne · RIKEN Center for Advanced Intelligence Project · The University of Tokyo +1

  24. Error Correction in Trained TTT Layers

    Oct 12, 2026Yuhe HuTest-Time TrainingMemory-Augmented Language Models

    Duke University

  25. History Replays Itself: Unleashing Long-Context Capability in Linear Attention

    Oct 11, 2026Li Nanbo, Firas Laakom, Yilan Zhang +10Long-Context ModelingMemory-Augmented Language Models

    King Abdullah University of Science and Technology (KAUST)

  26. What Survives When Activation Steering Is Used as Memory

    Oct 10, 2026Vedant JumlePersistent Memory for Language ModelsMemory-Augmented Language Models

    Delft University of Technology

  27. Representation Drift in Continual Learning: LoRA versus N-gram Memory

    Oct 10, 2026Hao WuContinual Learning for LLMsOnline Continual Learning

    Illinois Institute of Technology

  28. Test-Time Memory Construction

    Oct 9, 2026Zijun Wang, Yifan Ji, Haidong Xin +6Conversational QAMemory-Augmented Language Models

    School of Computer Science and Engineering, Northeastern University, China · Department of Computer Science and Technology, Tsinghua University, China · Alibaba Group, China

  29. DP-MIND: Differentially private memory-guided Long context Inference

    Oct 9, 2026Zhihao Liu, Yitian Cheng, Shuang Liu +3Privacy-Preserving Language ModelsLong-Context Language Model Inference

    Zhejiang University · Ant Group · Institute of Science Tokyo +1

  30. Trainable Quantum-Native Language Models: Dissipative Memory, Capacity Limits, and Hardware Validation

    Oct 8, 2026Deniz Yunus GöğüşLanguage ModelingQuantum Machine Learning