Large Language Model Memory

Follow this topic Ask about this topic

Recent momentum

-31%

9 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Large Language Model Memory.

Period ending 2026-09-14

5 new papers

A weekly snapshot of new work published in Large Language Model Memory.

92 papers

Latest in Large Language Model Memory

Browse all topics →

Complementary Roles of Activation and Parametric Memory in Few-Shot Learning
Sep 23, 2026Miaohe Niu, Runsong Zhao, Xinyu Liu +5Large Language Model Memory
Compressing Long Context into Answer-Aligned Memory Embeddings for LLM Inference
Sep 22, 2026Md Mostafizer Rahman, Md Faizul Ibne Amin, Md Shahajada Mia +2LLM Inference Efficiency Large Language Model Memory
Memory vs. Context? Influential Factors of Factual Recall in Language Models
Sep 21, 2026Guilhem Fouilhé, Nicholas Asher, Philippe MullerLarge Language Model Memory
MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup
Sep 14, 2026Muchen Li, Leonid Sigal, Renjie LiaoMixture-Of-Expert Language Models Large Language Model Memory
Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
Sep 14, 2026MyungHoon Ryu, XinYu Piao, Jong-Kook KimEfficient Long-Context Inference Large Language Model Memory
Rebalancing Token Importance in Language Models with TF-IDF Weighted Cross-Entropy Loss
Sep 10, 2026Zhijian Li, Stefan Larson, Kevin LeachLarge Language Model Memory Term Frequency-Inverse Document Frequency
Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs
Sep 9, 2026Ravi Ranjan, Olivera Kotevska, Agoritsa PolyzouLarge Language Model Unlearning Several Approximate Unlearning Strategies
Fortunate Recall: Ontology-Driven Memory Lifecycle Management for Persistent Coherence in LLMs
Sep 9, 2026Ansuman Mullick, Eray TüzünLarge Language Model Memory Ontology
From Retrieval to Weights: Parametric Individualization of Small Language Models with Individual Text Corpora
Sep 9, 2026Christoph Wigbels, Ali Abusaleh, Markus T. Jansen +2Large Language Model Memory Small Language Models
Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning
Sep 3, 2026Heng Wang, Jielin Qiu, Wenting Zhao +7Key-Value Cache Eviction Eviction
mzCache: On-Device LLM Memory Management under Multitasking
Sep 1, 2026Hongseung Yu, Minsung Kim, Jongseok Park +1LLM Inference Efficiency Large Language Model Memory
What It Costs to Compose, Rebuild, and Correct Precomputed Memory
Aug 31, 2026Asa ShepardLarge Language Model Memory Key-Value Cache
DistillCache: KL-Guided Adaptive KV-Cache Eviction for Memory-Efficient LLM Inference
Aug 9, 2026Asaad AlthoubiKey-Value Cache Eviction Cache
Distractor-Aware Truncation: Disentangling Context-Length Effects from Signal Loss in Long-Context LLM Benchmarks
Aug 4, 2026Mohsen ArjmandiContext Length Large Language Model Memory
PI-Mem: Pushing Long-Context Reasoning to 3.6M Tokens with Parallel-Iterative Memory
Aug 4, 2026Dawei Liu, Haixu Song, Shuang Cheng +9Efficient Long-Context Inference Large Language Model Memory
CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance
Jul 30, 2026Anubhav Lakra, Yue FengLarge Language Model Quantization Large Language Model Memory
Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory
Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Efficient Long-Context Inference Large Language Model Memory
Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
Jul 30, 2026Rubin Wei, Jiaqi Cao, Jiarui Wang +4Large Language Model Memory Large Language Model Decoder
Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory
Jul 30, 2026Vishwajith RameshLarge Language Model Memory Deletion
InferScale: GPU-Native KV Injection for Personalized LLM Serving
Jul 29, 2026Peter Li, Prashant PandeyLarge Language Model Memory Key-Value
LLMET: Enabling Cross-Layer Evaluation of Emerging M3D Memories for Energy-Efficient LLM Serving
Jul 29, 2026Ming-Yen Lee, Hanchen Yang, Faaiq Waqar +4Large Language Model Serving Large Language Model Memory
ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangLarge Language Model Memory Catastrophic Forgetting
MemLens: A Value-Aware Memory Management System with Interactive Analytics for LLM-based Agents
Jul 28, 2026Shuyue Wei, Chang Liu, Zimu Zhou +2Large Language Model Memory Llm-Based Agent
Memory for Large Language Models
Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Large Language Model Memory Explicit Memory
From Observation to Intervention: Memory in Brains and Large Language Models
Jul 27, 2026Morteza Salehjahromi, Shayan A. Zadegan, Amgad Muneer +1Large Language Model Memory Episodic Memory
SALT: Salience-Aware Lexical Trie for Long-Context Compression
Jul 20, 2026Oteo Mamo, Hyunjin Yi, Joydhriti Choudhury +2Efficient Long-Context Inference Large Language Model Memory
Beyond Memory Leaderboards: Evaluating Scientific Memory as Budgeted Context Restoration
Jul 18, 2026Maksim Sheverev, David Finkelstein, Sergey NikolenkoLarge Language Model Memory Agent Memory
Can a Language Model Learn Facts Continually in Its Weights?
Jul 13, 2026Charles O'NeillLarge Language Model Memory Training Language Models
MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference
Jul 12, 2026Venkatesha Matam, Keon KimKey-Value Cache Eviction Cache
MLPs are Hebbians: Constructing Efficient Fact-Storing MLPs for Transformers
Jul 10, 2026Roberto Garcia, Jerry Liu, Ronny Junkins +3Large Language Model Memory Transformer Architectures
Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization
Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Key-Value Cache Large Language Model Serving
Co-LMLM: Continuous-Query Limited Memory Language Models
Jul 8, 2026Yair Feldman, Linxi Zhao, Nathan Godey +5Large Language Model Memory
TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models
Jul 8, 2026Yutang Ma, Kecheng Huang, Xikun Jiang +1Large Language Model Memory LLM Inference Efficiency
MemDefrag: Latent Memory Defragmentation for Large Language Models
Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoLarge Language Model Memory Long-Term Memory
Akashic: A Low-Overhead LLM Inference Service with MemAttention
Jul 7, 2026Yang Liu, Zhaokai Luo, Huayi Jin +7Large Language Model Memory LLM Inference Efficiency
DRIFTLENS: Measuring Memory-Induced Reasoning Drift in Personalized Language Models
Jul 2, 2026Xi Fang, Weijie Xu, Yingqiang Ge +3Large Language Model Reasoning Large Language Model Memory
A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets
Jul 2, 2026Wanyun CuiQuadratic Attention Dense Associative Memory
Auditing Forgetting in Limited Memory Language Models
Jul 1, 2026Arya Raeesi, Hanna RoedLarge Language Model Unlearning Large Language Model Memory
Beyond Perplexity: A Behavioral Evaluation Framework for Deployment-Memory Claims in LLM Test-Time Training
Jul 1, 2026Xiangchen Song, Zhenhao Chen, Lingjing Kong +4Large Language Model Memory Large Models
From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving
Jun 30, 2026Jie Li, Tongyang Wang, Yong ChenCache Large Language Model Serving
The Past Is Prologue: A Plug-in Controller for Selective Updates in Sequentially Evolving LLM Memory
Jun 30, 2026Zihan Chen, Songwei Dong, Chengshuai Shi +4Large Language Model Memory Updates
Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM
Jun 28, 2026Shuvendu Roy, Mengyao Zhai, Hossein Hajimirsadeghi +1Key-Value Cache Eviction LLM Inference Efficiency
Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One
Jun 24, 2026Alex KwonLarge Language Model Memory Correctness
TriggerBench: Investigating Prospective Memory for Large Language Models
Jun 22, 2026Tianhua Zhang, Xinjiang Wang, Qianxi Zhang +6Large Language Model Memory Factual Recall
Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs
Jun 22, 2026Hongxun Ding, Xiang Yu, Chengbing Wang +4Large Language Model Memory Memory Retrieval
Recency/Frequency Adaptive KV Caching for Large Language Model Serving
Jun 19, 2026Yang Shen, Meghana Madhyastha, Robert Underwood +2Key-Value Cache LLM Inference Efficiency
Latent Personal Memory: Represent personal memory as dynamic soft prompts
Jun 18, 2026Debrup Das, Avinash Amballa, Yashas Malur Saidutta +3Large Language Model Memory Memory Retrieval
LOKI: Memory-Free Null-Space Constrained Lifelong Knowledge Editing
Jun 18, 2026Masih Eskandar, Miquel Sirera Perelló, Stratis Ioannidis +1Multimodal Knowledge Editing Large Language Model Memory
User as Engram: Internalizing Per-User Memory as Local Parametric Edits
Jun 17, 2026Bojie LiLarge Language Model Memory Memory Retrieval
On the Memorization Behavior of LLMs in Generative Recommendation: Observations, Implications, and Training Strategies
Jun 15, 2026Sunwoo Kim, Sunkyung Lee, Clark Mingxuan Ju +5Large-Scale Recommendation Systems Recommendation
TokenPilot: Cache-Efficient Context Management for LLM Agents
Jun 15, 2026Buqiang Xu, Zirui Xue, Dianmou Chen +12Large Language Model Memory Large Language Model Agents
Substrate Asymmetry in User-Side Memory: A Diagnostic Framework
Jun 10, 2026Youwang DengLarge Language Model Memory Explicit Memory
Recalling Too Well: Sycophancy Evaluation and Mitigation in Memory-Augmented Models
Jun 9, 2026Shelly Bensal, Axel Magnuson, Aparna Balagopalan +1Sycophancy Large Language Model Memory
How LoRA Remembers? A Parametric Memory Law for LLM Finetuning
May 28, 2026Ziwen Xu, Haiwen Hong, Linsong Yu +4Large Language Model Memory Large Language Model Fine-Tuning
VikingMem: A Memory Base Management System for Stateful LLM-based Applications
May 28, 2026Jiajie Fu, Junwen Chen, Mengzhao Wang +5Large Language Model Memory Agent Memory
MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems
May 27, 2026Xinle Deng, Ruobin Zhong, Hujin Peng +15Large Language Model Memory Large Language Model Performance
Why Can't They Remember? Uncovering Representation and Retrieval Bottlenecks in Multi-Turn Acoustic Memory
May 26, 2026Yang Xiao, Siyi Wang, Han Yin +4Large Audio Language Models Large Language Model Memory
MemFail: Stress-Testing Failure Modes of LLM Memory Systems
May 26, 2026Ishir Garg, Neel Kolhe, Dawn Song +1Large Language Model Memory Large Language Model Performance
Memory Architectures for Multi-Turn Text-to-SQL: A Benchmark and Empirical Study
May 25, 2026Ravi Kumar Tummalapenta, Suman AddankiText-To-Sql Large Language Model Memory
Simulating Human Memory with Language Models
May 25, 2026Qihan Wang, Nicholas Tomlin, Michael Hu +2Large Language Model Memory Cognitive Memory

Sep 23, 2026 · cs.CLJ/K move · Enter open · S save

Complementary Roles of Activation and Parametric Memory in Few-Shot Learning

Miaohe Niu, Runsong Zhao, Xinyu Liu, Bo Jin+4

At test time, large language models (LLMs) can encode historical information in activation memory (i.e., KV caches) and parametric memory (i.e., updated parameters). While activation memory is generally considered effective for factual recall and parametric memory for learning new tasks, their interplay remains unclear. In this work, we systematically investigate the role of memory in few-shot learning through controlled experiments. We find that activation memory is superior for recalling facts, whereas parametric memory does not consistently outperform activation memory in task learning. Moreover, our experiments show that the composite task, Conditional Arithmetic, requires the synergy of both memory types. Through neuron-level analysis, we find that the model activates distinct sets of neurons when accessing the same historical information through activation versus parametric memory. When both memory types are combined, the model recruits neurons from both sets, which is crucial for solving Conditional Arithmetic. These findings suggest that neither memory mechanism alone is sufficient for this composite task, highlighting the importance of their collaboration.