Memory-Augmented Language Models

Ask about this topic

Momentum

29 papers in the last four weeks, up 142% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 193

All topics
CardsList

  1. Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory

    Jul 30, 2026Rubin Wei, Jiaqi Cao, Jiarui Wang +4Language Model PretrainingMemory-Augmented Language Models

    LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Electronic Engineering, Tsinghua University

  2. Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory

    Jul 30, 2026Vishwajith RameshMemory-Augmented Language ModelsLLM Auditing

    Vy Labs, Inc.

  3. InferScale: GPU-Native KV Injection for Personalized LLM Serving

    Jul 29, 2026Peter Li, Prashant PandeyLLM ServingMemory-Augmented Language Models

    Northeastern University Boston, Massachusetts, USA

  4. Metis: Memory Foundation Model

    Jul 29, 2026Zeyu Zhang, Ziliang Guo, Yihang Sun +14Agent MemoryMemory-Augmented Language Models

    MemTensor (Shanghai) Technology Co., Ltd. · Shanghai Jiao Tong University · National University of Singapore +2

  5. Voice Memory for Agentic Speech Recognition

    Jul 29, 2026Chao-Han Huck Yang, Zih-Ching Chen, Piotr Zelasko +3Memory-Augmented Language ModelsAutomatic Speech Recognition

    NVIDIA

  6. MemSFT: Mitigating Alignment Tax with an External Parametric Memory

    Jul 28, 2026Jiarui Wang, Xiang Shi, Jiaqi Cao +8LLM AlignmentMemory-Augmented Language Models

    LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai AI Laboratory · School of Computer Science, Shanghai Jiao Tong University +1

  7. Memory for Large Language Models

    Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Memory-Augmented Language ModelsLLM Memory

    Tsinghua University · National University of Singapore · Bosch AI

  8. Raven: High-Recall Sequence Modeling with Sparse Memory Routing

    Jul 28, 2026Arshia Afzal, Aviv Bick, Eric P. Xing +2Memory-Augmented Language ModelsLong-Context Language Modeling

    EPFL · Carnegie Mellon University · MBZUAI +1

  9. CALMRec: Causally Aligned Language Memory for Long-Horizon Recommendation

    Jul 26, 2026Gengyu ZhanMemory-Augmented Language ModelsRecommender Systems

    Shenzhen University

  10. MaSRead: Content-Addressed Reading of Replicated Latent Stores

    Jul 21, 2026Carlos Baquero, Luís Brito, João ResendeMemory-Augmented Language Models

    FEUP & INESC TEC, Universidade do Porto, Porto, Portugal · ESTG, Instituto Politécnico de Viana do Castelo, Viana do Castelo, Portugal · DCC, FCUP, Universidade do Porto, Porto, Portugal

  11. SmartRAG: Native Graph-Based RAG for Mobile Device

    Jul 16, 2026Zhihan Jiang, Meng Li, Shenghao Liu +5Named Entity RecognitionOn-Device Language Model Inference

    1Nanjing University · 2HUST · 3Southeast University

  12. Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel

    Jul 15, 2026Sietse SchelpeMemory-Augmented Language ModelsKnowledge Augmentation for Language Models

    Corbenic AI

  13. PReM: Learning What to Preserve and When to Refresh for Context Compression

    Jul 15, 2026Bohan Yu, Lei Shen, Chenxi Zhou +5Memory-Augmented Language ModelsLong-Context Language Model Inference

    Alibaba Group

  14. Extending LLM Context via Associative Recurrent Memory

    Jul 13, 2026Gleb Kuzmin, Ivan Rodkin, Aydar Bulatov +8Memory-Augmented Language ModelsLong-Context Language Modeling

    1FusionBrain Lab 2MBZUAI 3Cognitive AI Systems Lab 4RUDN · 2MBZUAI · 6MIRAI +5

  15. Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams

    Jul 11, 2026Siddharth Pal, Viktoria RojkovaMemory-Augmented Language ModelsLong-Context Modeling

  16. Creativity, honesty and designed forgetting emerge in small hyperbolic language models

    Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinLLM SycophancyMemory-Augmented Language Models

    PolymathMinds Lab, Seoul, Republic of Korea. · Department of Chemical Engineering, POSTECH, Pohang, and aSSIST University, Seoul, Republic of Korea. · Korean Educational Development Institute, Jincheon, Republic of Korea.

  17. Co-LMLM: Continuous-Query Limited Memory Language Models

    Jul 8, 2026Yair Feldman, Linxi Zhao, Nathan Godey +5Language Model PretrainingMemory-Augmented Language Models

    Department of Computer Science Cornell University

  18. TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models

    Jul 8, 2026Yutang Ma, Kecheng Huang, Xikun Jiang +1Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    The Chinese University of Hong Kong · Beijing Institute of Technology, Zhuhai

  19. Sparse Delta Memory: Scaling the State of Linear RNNs through Sparsity

    Jul 8, 2026Loïc Cabannes, Pierre-Emmanuel Mazaré, Gergely Szilvasy +6Long-Context RetrievalMemory-Augmented Language Models

    Meta FAIR · Inria Paris & ENS-PSL University · University of Tübingen

  20. MILES: Modular Instruction Memory with Learnable Selection for Self-Improving LLM Reasoning

    Jul 8, 2026Ruilin Tong, Dong GongContinual Learning for LLMsMemory-Augmented Language Models

    University of New South Wales (UNSW Sydney)

  21. Do You Remember? Toward Memory-Centric Multimodal AI

    Jul 7, 2026Xuguang Yu, Weigang Zheng, Minyue YuMemory-Augmented VLMsMultimodal Memory

  22. From Application-Layer Simulation to Native Meta-Architecture: Structural Tension as an Endogenous Driver for Heterogeneous AI Evolution

    Jul 7, 2026Heting MaoLLM AlignmentMemory-Augmented Language Models

    Shanghai Lixin University of Accounting and Finance

  23. MemDefrag: Latent Memory Defragmentation for Large Language Models

    Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoContinual Learning for LLMsMemory-Augmented Language Models

    Kyoto University · LIGHTSPEED · Independent Researcher

  24. Akashic: A Low-Overhead LLM Inference Service with MemAttention

    Jul 7, 2026Yang Liu, Zhaokai Luo, Huayi Jin +7LLM ServingMemory-Augmented Language Models

    Xiaohongshu Inc., China · ShangHai JiaoTong University · Peking University

  25. Parametric Memory Decoding for Zero-Shot Routing in LoRA-Based External Parametric Memory

    Jul 5, 2026Fengxian Ji, Zhuohan Xie, Jingpu Yang +3Zero-Shot LearningMemory-Augmented Language Models

    1MBZUAI, United Arab Emirates · Institute of Automation, Chinese Academy of Sciences, China

  26. PraMem: Practice-derived Experiential Memory for Long-horizon Behavior Prediction

    Jul 3, 2026Zhuoqun Li, Boxi Cao, Jiawei Chen +11Memory-Augmented Language ModelsNext-Action Prediction

    Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences · University of Chinese Academy of Sciences · Fudan University +1

  27. DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models

    Jul 2, 2026Xi Fang, Weijie Xu, Yingqiang Ge +3LLM PersonalizationMemory-Augmented Language Models

    1Amazon

  28. A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets

    Jul 2, 2026Wanyun CuiLong-Context RetrievalMemory-Augmented Language Models

    Shanghai University of Finance and Economics

  29. InduceKV: Fixed-Footprint Continual Adaptation of Multimodal LLMs via Inducing KV Memories

    Jul 2, 2026Qianyu Chen, Ziteng Feng, Canran Xiao +1Continual Learning for LLMsMemory-Efficient Fine-Tuning

    1Nanyang Technological University · University of Science and Technology of China · 3Shenzhen Campus of Sun Yat-sen University

  30. Auditing Forgetting in Limited Memory Language Models

    Jul 1, 2026Arya Raeesi, Hanna RoedMemory-Augmented Language ModelsLLM Auditing

    University of California, Berkeley, Berkeley, California, United States of America.

  31. ISM:Self-Improving Strategy Memory for Continual Mathematical Reasoning

    Jun 30, 2026Prakhar Dixit, Tim OatesContinual Learning for LLMsMemory-Augmented Language Models

    Department of Computer Science, University of Maryland, Baltimore County, Baltimore, Maryland, USA

  32. HippoSpark: An On-Demand Experience System for LLM Reasoning

    Jun 29, 2026Jingyao Liu, Danling Meng, Chen Huang +5Retrieval-Augmented GenerationMemory-Augmented Language Models

    College of Computer Science, Sichuan University · Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, China · College of Software Engineering, Sichuan University +3

  33. MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation

    Jun 27, 2026Junyi Zou, Avrova DonzContinual Learning for LLMsTest-Time Adaptation

    1MMLA-org · 2Communication University of China (CUC), No. 1 Dingfuzhuang East Street, Chaoyang District, Beijing 100024, China

  34. Erase-then-Delta Attention: Decoupling Erase and Write Addresses in Delta-Rule Linear Attention

    Jun 25, 2026Xiao Li, Chengruidong Zhang, Hao Luo +15Memory-Augmented Language ModelsLong-Context Language Modeling

    1Qwen Team · 2Nanjing University · 3Zhejiang University

  35. Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One

    Jun 24, 2026Alex KwonLLM EvaluationMemory-Augmented Language Models

    Independent Researcher

  36. ATMA: Length-Invariant Language Modeling via Polar Attention and Gated-Delta Compression Memory

    Jun 23, 2026Habibullah AkbarMemory-Augmented Language ModelsLong-Context Language Modeling

    Kreasof AI Jakarta, Indonesia

  37. Towards Version-aware Operations and Transaction Memories for Multi-layer MeMo

    Jun 23, 2026Peiran LiKnowledge EditingContinual Learning for LLMs

    Freie Universität Berlin, Kaiserswerther Str. 16-18, 14195 Berlin, Germany

  38. Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs

    Jun 22, 2026Hongxun Ding, Xiang Yu, Chengbing Wang +4LLM PersonalizationMemory-Augmented Language Models

    University of Science and Technology of China, China

  39. Latent Personal Memory: Represent personal memory as dynamic soft prompts

    Jun 18, 2026Debrup Das, Avinash Amballa, Yashas Malur Saidutta +3LLM Inference EfficiencyMemory-Efficient Fine-Tuning

    University of Massachusetts Amherst · Samsung Research America

  40. User as Engram: Internalizing Per-User Memory as Local Parametric Edits

    Jun 17, 2026Bojie LiKnowledge EditingLLM Personalization

    Pine AI

  41. Continual Self-Improvement with Lightweight Experiential Latent Memories

    Jun 16, 2026Vaggelis Dorovatas, Nancy Kalaj, Rahaf AljundiContinual Learning for LLMsMemory-Augmented Language Models

    Toyota Motor Europe · University of Trento

  42. DYNA : Dynamic Episodic Memory Networks for Augmenting Large Language Models with Temporal Knowledge Graphs in Continuous Learning

    Jun 14, 2026Ali Sarabadani, Mahtab TajvidiyanContinual Learning for LLMsMemory-Augmented Language Models

    Department of Computer Engineering and Information Technology, University of Qom, Qom, Iran

  43. Retrievable Gradients: Continual Post-Training Without Cumulative Weight Drift

    Jun 14, 2026Weihang Su, Jiacheng Kang, Jingyan Xu +7Retrieval-Augmented GenerationContinual Learning for LLMs

    Department of Computer Science and Technology, Tsinghua University

  44. Knowledge Graph Enhanced Memory-Augmented Retrieval for Long Context Modeling

    Jun 12, 2026Ghadir Alselwi, Basem Suleiman, Hao Xue +4Memory-Augmented Language ModelsKnowledge Augmentation for Language Models

    University of New South Wales, Sydney, NSW, Australia · 2Hong Kong University of Science and Technology (Guangzhou) · University of Southampton, Southampton, UK +2

  45. Multi-Turn Reasoning When Context Arrives in Pieces: Scalable Sharding and Memory-Augmented RL

    Jun 11, 2026Shu Tong Luo, Wenqin Liu, Rui Liu +2Memory-Augmented Language ModelsRL for Language Model Reasoning

    The University of Melbourne · The University of Tokyo

  46. Context-Driven Incremental Compression for Multi-Turn Dialogue Generation

    Jun 10, 2026Yeongseo Jung, Jaehyeok Kim, Eunseo Jung +5Memory-Augmented Language ModelsLong-Context Modeling

    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong · NVIDIA AI Technology Center, NVIDIA · University of Tsukuba, Japan +1

  47. Doc-to-Atom: Learning to Compile and Compose Memory Atoms

    Jun 10, 2026Xingjian Diao, Wenbo Li, Yashas Malur Saidutta +3Memory-Augmented Language ModelsLong-Context Language Model Inference

    AI Center-Mountain View, Samsung Electronics · Dartmouth College

  48. Augmenting Molecular Language Models with Local nn-gram Memory

    Jun 10, 2026Xinni Zhang, Zijing Liu, He Cao +2Memory-Augmented Language ModelsLanguage Modeling

    1The Chinese University of Hong Kong · 2International Digital Economy Academy

  49. Task-Aware Structured Memory for Dynamic Multi-modal In-Context Learning

    Jun 10, 2026Zhirui Chen, Ziwei Chen, Ling ShaoMemory-Augmented Language ModelsMultimodal ICL

    UCAS-Terminus AI Lab, University of Chinese Academy of Sciences, China · ByteDance Inc.

  50. Recalling Too Well: Sycophancy Evaluation and Mitigation in Memory-Augmented Models

    Jun 9, 2026Shelly Bensal, Axel Magnuson, Aparna Balagopalan +1LLM SycophancyMemory-Augmented Language Models

    Writer, Inc.

  51. Parallel Causal Associative Fields: Gated Sparse Memory for Long-Context Language Modeling

    Jun 9, 2026Muhammad AhmedMemory-Augmented Language ModelsLong-Context Language Model Inference

    Independent Researcher

  52. Titans-as-a-Layer: Test-Time Memory for Conversational Speech Emotion Recognition

    Jun 7, 2026Daniel Chen, Qicong Hu, Yang Xiao +2Memory-Augmented Language ModelsAudio Understanding

    Department of Computer Science, University of Auckland, Auckland, New Zealand · School of Computer and Information Technology, Melbourne, Australia

  53. Tensorizing Engram: Sharing Latents Across N-Gram Embeddings is Beneficial in LLMs

    Jun 6, 2026Wuyang Zhou, Yuxuan Gu, Giorgos Iacovides +3Text EmbeddingsLLM Compression

    Department of Electrical and Electronic Engineering, Imperial College London, London, United Kingdom · AIP, RIKEN, Tokyo, Japan.

  54. Position: Hippocampal Explicit Memory Is the Cornerstone for AGI

    Jun 5, 2026Sangjun ParkMemory-Augmented Language ModelsLLM Memory

    Department of Computer Science, University of Texas at Austin, TX, USA · Cognizant AI Labs, San Francisco, CA, USA

  55. Why Limit the Residual Stream to Layers and Not Tokens? Persistent Memory for Continuous Latent Reasoning

    Jun 5, 2026Mujtaba Farhan, Maheep ChaudharyMemory-Augmented Language ModelsPersistent Memory for Language Models

    1Algoverse AI Research · 2Independent

  56. Rethinking LoRA Memory Through the Lens of KV Cache Compression

    Jun 4, 2026Chunsheng Zuo, Liaoyaqi Wang, William Jurayj +2Retrieval-Augmented GenerationMemory-Augmented Language Models

    Johns Hopkins University

  57. Cartridges at Scale: Training Modular KV Caches over Large Document Collections

    Jun 3, 2026Momchil Hardalov, Gonzalo Iglesias, Adrià de GispertMemory-Augmented Language ModelsKV Caching

    Amazon AGI

  58. Streaming Knowledge Compilation: Proactive Materiality-Scored Pinning for Time-Evolving LLM Wikis

    Jun 3, 2026Juan M. HuertaMemory-Augmented Language ModelsKnowledge Augmentation for Language Models

    Zinnia Tech Solutions 600 Steamboat Road Greenwich, CT 06830, USA

  59. HybridThinker: Efficient Chain-of-Thought Reasoning via Compressed Memory and Transient Thought Steps

    Jun 2, 2026Xin Liu, Runsong Zhao, Xinyu Liu +8Memory-Augmented Language ModelsEfficient Language Model Reasoning

    School of Computer Science and Engineering, Northeastern University, Shenyang 110819, China · China Unicom Cloud-Link, China · NiuTrans Research, Shenyang, China

  60. eMoT: evolving Memory-of-Thought via Symbolic Anchoring and Memory Corrosion

    Jun 1, 2026Xiang Li, Jiwei Wei, Ke Liu +5Memory-Augmented Language ModelsLLM Mathematical Reasoning

    Center for Future Media, University of Electronic Science and Technology of China, Chengdu, China