Large Language Model Memory

Ask about this topic

Momentum

25 papers in the last four weeks, up 317% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 132

All topics
CardsList

  1. EngramEdit: Decoupled Knowledge Updates in LLMs through Conditional Memory

    Oct 7, 2026Hongru Cai, Ran Wei, Wenjie Wang +4Multimodal Knowledge EditingLarge Language Model Memory

    The Hong Kong Polytechnic University · Hangzhou Diagens Biotechnology Co., Ltd · University of Science and Technology of China

  2. Cache the Encoder Within:Compact, Reusable Memory across LLM Queries

    Oct 7, 2026Hanzuo Liu, Chunyu Liu, Chaofan Lin +2Large Language Model Memory

    Tsinghua University

  3. Memory Canonicalization: A Framework and Benchmark for Cross-Model Drift in Persistent LLM Memory

    Oct 4, 2026Amit Vadnere, Aishwarya LonarkarLarge Language Model Memory

    Product Solutions Engineer

  4. Decoupling Memory from Context: Structured Memory for Token-Efficient Test-Time Continual Learning

    Oct 2, 2026Yehya Farhat, Michael Desmond, Anastasios KyrillidisLarge Language Model MemoryGraph-Structured Memories

    Rice University, Department of Computer Science Houston, TX, USA · IBM Research Yorktown Heights, NY, USA

  5. Local Support Learning

    Oct 1, 2026Assaf Ben-Kish, Akarsh Kumar, James Glass +1Catastrophic ForgettingLarge Language Model Memory

    Tel Aviv University · MIT CSAIL

  6. Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval

    Oct 1, 2026Arman Behnam, Binghui WangLarge Language Model MemoryRetention

    Department of Computer Science Illinois Institute of Technology Chicago, IL

  7. CoEM: Empowering Long-Context Reasoning with Commit-on-Evidence Memory

    Sep 29, 2026Jingguang Li, Yebo Wu, Zuyi Guo +7Long-Context ReasoningLLM Reasoning Strategies

    Korea Advanced Institute of Science & Technology · University of Macau · Massachusetts Institute of Technology

  8. FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models

    Sep 28, 2026Bowen Yang, Jingbo Zhou, Qinghong Miao +1Unigram TokenizerLarge Language Model Memory

    Large Model Frontier Research Department, Baidu Inc., China · Nanyang Technological University

  9. Causal Routing for Unlearning

    Sep 28, 2026Bardh Prenkaj, Andrea D'Angelo, Davide Mottin +4Large Language Model MemoryCausal

    Sapienza University of Rome · Aarhus University

  10. Making LLMs Truly Forget: Deep Unlearning by Searching, Selecting, and Severing Knowledge Paths

    Sep 28, 2026Jialu Wang, Peizhi Niu, Haoteng Yin +3Large Language Model UnlearningForgetting

    Tongji University · University of Illinois Urbana-Champaign · Purdue University +1

  11. Thinking Outside the Box: Retention and Transmission of Information in Sliding-Window KV Inference

    Sep 28, 2026Timothy DeLise, Seth CromelinCacheLarge Language Model Memory

  12. Positions Are Not Facts: The Mismatch Between KV Caches and Memory

    Sep 27, 2026Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5Key-Value CacheLarge Language Model Memory

    Fudan University · Baidu · Zhejiang University +2

  13. Just Let Linear States Forget the Distant Past: Prefix Caching via Suffix Replay for Hybrid LLMs

    Sep 27, 2026Yirui Liu, Ruoling Qi, Xuaner Wu +6Kimi Delta AttentionCache

    Institute of Artificial Intelligence, China Telecom (TeleAI) China · Shanghai Jiao Tong University · Individual Researcher +1

  14. LSTMem: Hierarchical Long Short-Term Online Memory for Large Language Models

    Sep 27, 2026Xianglong Shi, Ruijie Yang, Sirui Zhao +4Large Language Model MemoryPeak Memory

    University of Science and Technology of China

  15. When Fancy Eviction Fails: Rethinking Cache Replacement For LLM Prefix Reuse

    Sep 24, 2026Yiyu Liu, Minlan Yu, Juncheng YangEvictionCache

    Harvard University

  16. Compressing Long Context into Answer-Aligned Memory Embeddings for LLM Inference

    Sep 22, 2026Md Mostafizer Rahman, Md Faizul Ibne Amin, Md Shahajada Mia +2LLM Inference OptimizationLarge Language Model Memory

    Lucy Family Institute for Data & Society, University of Notre Dame, IN, USA · The University of Aizu, Aizuwakamatsu, Japan · Department of Applied and Computational Mathematics and Statistics, University of Notre Dame, IN, USA

  17. Memory vs. Context? Influential Factors of Factual Recall in Language Models

    Sep 21, 2026Guilhem Fouilhé, Nicholas Asher, Philippe MullerLarge Language Model MemoryFactual Recall

    IRIT ANITI · IRIT CNRS · IRIT Université de Toulouse

  18. TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

    Sep 18, 2026Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu +4Kv-Cache ManagementDepthweave-Kv

    University of Georgia Athens, GA, USA · Peking University Beijing, China · Western Digital Research San Jose, CA, USA

  19. MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup

    Sep 14, 2026Muchen Li, Leonid Sigal, Renjie LiaoLarge Language Model Memory

    University of British Columbia · 2Vector Institute for AI · 3Canada CIFAR AI Chair +1

  20. Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size

    Sep 14, 2026MyungHoon Ryu, XinYu Piao, Jong-Kook KimLarge Language Model MemoryFactual Recall

    Korea University South Korea

  21. Rebalancing Token Importance in Language Models with TF-IDF Weighted Cross-Entropy Loss

    Sep 10, 2026Zhijian Li, Stefan Larson, Kevin LeachLarge Language Model MemoryTerm Frequency-Inverse Document Frequency

    University of Southern California, Los Angeles · Vanderbilt University, Nashville

  22. ConvMem: Convolutional Memory for Long-Context Reasoning

    Sep 9, 2026Hongming Zhang, Zhaozhen Gu, Fengshuo Bai +6Efficient Long-Context InferenceLarge Language Model Memory

    Institute of Automation, Chinese Academy of Sciences

  23. Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs

    Sep 9, 2026Ravi Ranjan, Olivera Kotevska, Agoritsa PolyzouLarge Language Model UnlearningLarge Language Model Quantization

    Florida International University (FIU), Miami, FL, USA · Oak Ridge National Laboratory (ORNL), Oak Ridge, TN, USA

  24. Fortunate Recall: Ontology-Driven Memory Lifecycle Management for Persistent Coherence in LLMs

    Sep 9, 2026Ansuman Mullick, Eray TüzünLarge Language Model MemoryFactual Recall

    Bilkent University

  25. KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints

    Sep 9, 2026Xi Shi, Mengxin Zheng, Qian LouKv-Cache ManagementLarge Language Model Serving

    University of Central Florida

  26. From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora

    Sep 9, 2026Christoph Wigbels, Ali Abusaleh, Markus T. Jansen +2Large Language Model MemorySmall Large Language Models

    Bergische Universität Wuppertal · Goethe-Universität Frankfurt

  27. Separating Stream Stability from Long-Term Recall in Language Models

    Sep 7, 2026Peipei Cao, Xin Zhang, Jie Tang +3Large Language Model MemoryEfficient Long-Context Inference

    School of Computer and Electronic Information, Guangxi University · School of Information Science and Engineering, Chongqing Jiaotong University · School of Computer Science and Technology, Guangdong University of Technology

  28. SGD-KV: Summarization Guided KV Cache Compression

    Sep 3, 2026Zeyu Liu, Woomin Song, Xuandi Fu +5Key-Value Cache CompressionEfficient Long-Context Inference

    USC, USA · KAIST, Korea · Amazon AGI, USA

  29. LatentPress: Context Compression Beyond Text and Vision

    Sep 1, 2026Zhengze Zhou, Hejian SangEfficient Long-Context InferenceLarge Language Model Compression

    1Cornell University · 2Iowa State University

  30. mzCache: On-Device LLM Memory Management under Multitasking

    Sep 1, 2026Hongseung Yu, Minsung Kim, Jongseok Park +1LLM Inference OptimizationLarge Language Model Memory

    Seoul National University · UC Berkeley

  31. What It Costs to Compose, Rebuild, and Correct Precomputed Memory

    Aug 31, 2026Asa ShepardLarge Language Model MemoryKey-Value Cache

    Department of Computer Science, Williams College

  32. When Errors Become Memories: Causal Pathway Tracing in Multi-Turn Memory-Augmented LLMs

    Aug 31, 2026Shuyao Xiao, Shengling Wang, Xuan Chen +8Large Language Model MemoryLarge Language Models Fail

    College of Artificial Intelligence, Beijing Normal University, Beijing, China · 2Beike Language and Intelligence, Beijing, China · Center for Data Science, New York University, New York, NY, USA

  33. Sliding-window beats linear attention

    Aug 28, 2026Alexia Jolicoeur-Martineau, Rhea Sanjay Sukthanker, Pashmina Cameron +1Kimi Delta AttentionLarge Language Model Memory

    Microsoft Applied Sciences Group (ASG) · Independent

  34. DistillCache: KL-Guided Adaptive KV-Cache Eviction for Memory-Efficient LLM Inference

    Aug 9, 2026Asaad AlthoubiCacheLarge Language Model Memory

    Oklahoma State University Stillwater, OK USA

  35. Mitigating Over-Personalization in LLMs via Structured Memory

    Aug 8, 2026Hakeem Hannoon, Andrew Zhao, Mihir Narayan +2Large Language Model MemoryLong-Term Memory

    University of Saskatchewan · University of California–Irvine · University of Wisconsin–Madison +2

  36. When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs

    Aug 5, 2026Jiaming Cheng, Subhransu Das, Rajiv RamnathMulti-Agent Large Language Model SystemsLarge Language Model Memory

    Independent Researcher · The Ohio State University

  37. Distractor-Aware Truncation: Disentangling Context-Length Effects from Signal Loss in Long-Context LLM Benchmarks

    Aug 4, 2026Mohsen ArjmandiContext LengthLarge Language Model Memory

    evolutionID GmbH

  38. PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory

    Aug 4, 2026Dawei Liu, Haixu Song, Shuang Cheng +9Long-Context ReasoningLarge Language Model Memory

    Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Tsinghua University +3

  39. Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection

    Aug 3, 2026Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson +2Large Language Model MemoryEfficient Long-Context Inference

    BrainChip Inc. 23041 Avenida de la Carlota, Laguna Hills, CA

  40. LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference

    Aug 3, 2026Zhichen Liu, Ruihan Sun, Hengjie Yang +4Large Language Model MemoryPersistent State

    Southern University of Science and Technology · Xidian University

  41. TransMem: Transforming Hidden States into Memory for Large Language Models

    Jul 31, 2026Haodong Lei, Junming Liu, Yirong Chen +4Large Language Model MemoryLarge Language Model Agents

    Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China

  42. CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance

    Jul 30, 2026Anubhav Lakra, Yue FengLarge Language Model QuantizationLarge Language Model Memory

    University of Birmingham, Birmingham, United Kingdom

  43. CoMem: Reusing Transformer Depth across Queries with Persistent Intermediate Residuals

    Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Efficient Long-Context InferenceLarge Language Model Memory

    Tsinghua University · Tencent

  44. Back from the Future: Key-Value Cache Management by Counter-Causal Surprise

    Jul 30, 2026Stephen Gould, Anton van den HengelKey-Value CacheCache

    Metacognition AI · Australian National University · Adelaide University

  45. Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory

    Jul 30, 2026Vishwajith RameshLarge Language Model MemoryDeletion

    Vy Labs, Inc.

  46. InferScale: GPU-Native KV Injection for Personalized LLM Serving

    Jul 29, 2026Peter Li, Prashant PandeyLarge Language Model MemoryKv-Cache Management

    Northeastern University Boston, Massachusetts, USA

  47. LLMET: Enabling Cross-Layer Evaluation of Emerging M3D Memories for Energy-Efficient LLM Serving

    Jul 29, 2026Ming-Yen Lee, Hanchen Yang, Faaiq Waqar +4Large Language Model MemoryVram

    Georgia Institute of Technology, Atlanta, GA, USA · Samsung Semiconductor Inc., San Jose, CA, USA

  48. ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models

    Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangLarge Language Model MemoryCatastrophic Forgetting

    Department of Automation, University of Science and Technology of China, Hefei, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China.

  49. MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based Agents

    Jul 28, 2026Shuyue Wei, Chang Liu, Zimu Zhou +2Large Language Model MemoryPeak Memory

    C-FAIR & School of Software, Shandong University · SKLCCSE Lab, Beihang University · Department of Data Science, City University of Hong Kong

  50. Bits and Memories: Measuring Verbatim Extraction Across LLM Quantization

    Jul 28, 2026Akshay SasiLarge Language Model QuantizationLarge Language Model Memory

    Independent Researcher

  51. Memory for Large Language Models

    Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Large Language Model MemoryPeak Memory

    Tsinghua University · National University of Singapore · Bosch AI

  52. From Observation to Intervention: Memory in Brains and Large Language Models

    Jul 27, 2026Morteza Salehjahromi, Shayan A. Zadegan, Amgad Muneer +1Large Language Model MemoryEpisodic Memory

    Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA · Department of Neurology, The University of Tennessee Health Science Center, Memphis, TN, USA · Department of Thoracic/Head and Neck Medical Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA +1

  53. HijackKV: New Threat in Position-Independent KV Cache Reuse

    Jul 22, 2026Yichi Zhang, Zhiqi Wang, Huan Zhang +1Key-Value CacheCache

    The Pennsylvania State University · University of Illinois Urbana-Champaign

  54. SALT: Salience-Aware Lexical Trie for Long-Context Compression

    Jul 20, 2026Oteo Mamo, Hyunjin Yi, Joydhriti Choudhury +2Efficient Long-Context InferenceLarge Language Model Memory

    Florida State University

  55. Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration

    Jul 18, 2026Maksim Sheverev, David Finkelstein, Sergey NikolenkoLarge Language Model MemoryScientific Discovery

    Quantellence Research · St. Petersburg Department of the Steklov Institute of Mathematics, St. Petersburg, Russia · St. Petersburg State University, St. Petersburg, Russia

  56. Can a Language Model Learn Facts Continually in Its Weights?

    Jul 13, 2026Charles O'Neill, Max Kirkby, Jonathon Liu +1Large Language Model MemoryFacts

    Baseten

  57. MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference

    Jul 12, 2026Venkatesha Matam, Keon KimKey-Value Cache EvictionKv-Cache Management

    Independent Researcher New York City, USA

  58. MLPs are Hebbians: Constructing Efficient Fact-Storing MLPs for Transformers

    Jul 10, 2026Roberto Garcia, Jerry Liu, Ronny Junkins +3Large Language Model MemoryTransformer Architectures

    Institute for Computational & Mathematical Engineering, Stanford University · Department of Computer Science, Stanford University · Department of Computer Science and Engineering, University at Buffalo

  59. Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Kv-Cache ManagementLarge Language Model Serving

    School of Computing and Information Systems, The University of Melbourne · School of Computer Science and Technology, Huazhong University of Science and Technology (www.ruizhang.info)

  60. What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

    Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiCompactionLarge Language Model Memory

    University of California, Irvine Irvine, California, USA