Persistent Memory for Language Models

Follow this topic Ask about this topic

Momentum

48 papers in the last four weeks, up 200% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 213

All topics

Kathleen Remembers: Length-Invariant One-Shot Recall Without Attention
Aug 31, 2026George FountzoulasMemory-Augmented Neural Networks Persistent Memory for Language Models
Department of Computer Engineering & Informatics Frederick University, Nicosia, Cyprus
PolyMemDB: A Polyglot Database System for AI Memory Management
Aug 26, 2026Yu Wang, Jiaheng LuAgent Memory Management Persistent Memory for Language Models
University of Helsinki
Wontopos Tablet 2: Measuring Multilingual and Multimodal Memory Retrieval Without Lexical Matching
Aug 24, 2026Sunwoo KimPersistent Memory for Language Models Multilingual IR
Wontopos L.L.C.
MegaMem: A Retrieval Solution for Ultra-Large Context Windows
Aug 22, 2026Xinyuan Song, Bowen Zhu, Hasibul Haque +1Retrieval-Augmented Generation Persistent Memory for Language Models
Causal Dynamics Lab, USA · Emory University, USA
MemGuard: Persisting Verifier Signals for LLM-Agent Memory Governance
Aug 22, 2026Haoyu Wang, Guangyuan Dong, He Liang +5Persistent Memory for Language Models Agent Memory Management
Nankai University · National University of Singapore · Shanghai Institute of Optics and Fine Mechanics, Chinese Academy of Sciences +5
rEDMRec: Distilling Large Language Model Reasoning into an Editable Experience Memory for Recommendation
Aug 19, 2026Minh Hoang Nguyen, Tung Le, Huy Tien NguyenRecommender Systems Large Language Model-Based Recommendation
ArborMem: Navigating Interaction States with Memory Forests
Aug 18, 2026Zongwei Lv, Yuemeng Xu, Yilun Yao +8Conversational Memory Persistent Memory for Language Models
Mental Model Management: An Operator-Based Framework for LLM Memory
Aug 16, 2026Oliver KramerPersistent Memory for Language Models LLM Memory
Handover of In-Context Learning State Across Session Boundaries
Aug 14, 2026Masahiro Kato, Taka KatoLLM Context Management Persistent Memory for Language Models
RippleMem: From Isolated Retrieval to Associative Recollection for Long-Term Agent Memory
Aug 13, 2026Jingbo Ji, Lingyi Li, Xilong Cheng +4Agent Memory Persistent Memory for Language Models
Communication University of China, Beijing, China. · Zhilian Yinghe Technology Co., Ltd., Beijing, China · State Key Laboratory of Media Convergence and Communication, Beijing, China
LycheeMemory V2: Efficient Long-Term Memory for LLM Agents via Semantic Segment-Level Consolidation
Aug 13, 2026Dongfang Li, Zixuan Liu, Junmai Wang +5LLM Agent Memory Persistent Memory for Language Models
Harbin Institute of Technology, Shenzhen
MARCH: Scaling Recurrent Memory with Content-Routed State Anchors
Aug 12, 2026Ming Zhang, Kaisen Yang, Shu Yu +6Long-Context Retrieval In-Context Retrieval
Shanghai AI Laboratory · Tsinghua University · Fudan University
Total Recall at What Cost? Benchmarking the Serving Cost of Agentic Memory Systems
Aug 12, 2026Natchanon Pollertlam, Witchayut KornsuwannawitLLM Serving LLM Agent Memory
Bricks Technology · Thailand
Consolidator: Learning Persistent Routed Memory Across Context Boundaries
Aug 12, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungMemory-Augmented Neural Networks Persistent Memory for Language Models
College of Pharmacy, Chungnam National University · Department of Computer Science & Engineering, Chungnam National University
Mitigating Over-Personalization in LLMs via Structured Memory
Aug 8, 2026Hakeem Hannoon, Andrew Zhao, Mihir Narayan +2LLM Sycophancy Persistent Memory for Language Models
University of Saskatchewan · University of California–Irvine · University of Wisconsin–Madison +2
TEPA: Revoking Stale Memories for Conflict-Robust Language Agents
Aug 7, 2026Yan Zhou, Yue Ouyang, Kaiyang Zheng +1LLM Agent Memory Persistent Memory for Language Models
School of Mathematics and Statistics, Changsha University of Science and Technology, Changsha, China · School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China.
LeanMem: Simple and Efficient Long-Term Memory for LLM Agents
Aug 4, 2026Yuxin Liao, Le Wu, Min Hou +3LLM Agent Memory Persistent Memory for Language Models
Hefei University of Technology
Verifiable Memory: Learning Unified Memory Management with Local and Global Verifiers for Large Language Model Agents
Aug 4, 2026Xiaolong Sun, Qichao Wang, Hangyu Li +1LLM Agent Memory Persistent Memory for Language Models
Sun Yat-Sen University, Guangzhou, China · Nanyang Technological University, Singapore · Tencent, Shenzhen, China
Structured Memory for Edge Language Models: Persistent Context and Corpus Retrieval via O(1) SSM State Injection
Aug 3, 2026Anusha Madan Gopal, Aras Pirbadian, Kristofor D. Carlson +2Retrieval-Augmented Generation On-Device Language Model Inference
BrainChip Inc. 23041 Avenida de la Carlota, Laguna Hills, CA
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
Aug 3, 2026Zhichen Liu, Ruihan Sun, Hengjie Yang +4Memory-Augmented Language Models LLM Inference
Southern University of Science and Technology · Xidian University
Mamba with Hierarchical Memory: Solving Representation Bottleneck in Long Sequence Modeling
Aug 3, 2026Qinwen Wang, Jieping Luo, Aoxiang Qin +5Long-Context Retrieval Memory-Augmented Neural Networks
The Chinese University of Hong Kong, Shenzhen · Hainan Bielefeld University of Applied Sciences · BrainGalaxy
PGMem: Tightly Coupled Persona-Memory Graph for Lifelong Personalized Agents
Aug 3, 2026Wonjun Choi, Yerim Kim, Yukyung Lee +1Agent Memory LLM Personalization
Korea University, Seoul, Korea · Boston University, Boston, USA
TrajWiki: Source-Grounded Memory Trajectories for Long-Horizon Dialogue Agents
Aug 2, 2026Jingyu Sun, Yuyang Xue, Mingyang Li +9Agent Memory LLM Agent Memory
1The University of Manchester · 2The University of Melbourne · 3The University of Edinburgh +2
PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents
Aug 2, 2026Jingyu Sun, Yan Lin, Yuyang Xue +10Memory-Augmented VLMs Multimodal Memory
The University of Manchester · The University of Newcastle · The University of Edinburgh +5
Lost in Compaction: Evaluating Side-Constraint Loss under Context Compaction
Jul 31, 2026Zhiqi Wang, Yichi Zhang, Dongwon Lee +1Persistent Memory for Language Models Instruction Following
The Pennsylvania State University
Zero-Mem: Zero-Token Memory Operations for LLM Agents
Jul 31, 2026Yilin Xiao, Zhehan Zhu, Yujing Zhang +8Conversational Memory Long-Context QA
The Hong Kong Polytechnic University, Hong Kong SAR · School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics · School of Artificial Intelligence, Jilin University
Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory
Jul 31, 2026Jinghan Xu, Yiyong Xiao, Wanru Shao +2Persistent Memory for Language Models Agent Memory Poisoning
TransMem: Transforming Hidden States into Memory for Large Language Models
Jul 31, 2026Haodong Lei, Junming Liu, Yirong Chen +4Memory-Augmented Language Models LLM Agent Memory
Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China
Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
Jul 30, 2026Rubin Wei, Jiaqi Cao, Jiarui Wang +4Language Model Pretraining Memory-Augmented Language Models
LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Electronic Engineering, Tsinghua University
Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory
Jul 30, 2026Vishwajith RameshMemory-Augmented Language Models LLM Auditing
Vy Labs, Inc.

Aug 31, 2026, cs.CLJ/K move · Enter open · S save

Kathleen Remembers: Length-Invariant One-Shot Recall Without Attention

George Fountzoulas

Department of Computer Engineering & Informatics Frederick University, Nicosia, Cyprus

Memory-Augmented Neural Networks Persistent Memory for Language Models Long-Context Modeling Associative Memory

Open paper AskPDF arXiv

Recurrent, attention-free sequence models share a structural weakness: a fading state cannot perform exact recall of something seen once, far in the past. We add to the Kathleen trunk a second memory layer -- a "notebook": a fixed-key holographic (HRR) associative store with a learned local write gate, a self-gating raw read, and write-triggered forgetting -- 25K parameters that attach to the logits of any trunk. (1) Mechanism: on a controlled needle-in-haystack task the notebook reaches 80-82% one-shot recall at 4x the training length, where the bare trunk scores ~4% and a parameter-matched attention head scores 100% inside its training length and 0% beyond it. Addressing is length-invariant by construction; the untrained memory alone recalls at 90% accuracy identically at 512, 2048 and 4096 bytes. Because the store is a linear superposition, two capabilities follow from arithmetic alone: selective unlearning (one subtraction erases one fact to chance, retained facts unharmed) and per-token attribution (counterfactual erasure names the source fact of every correct byte, 100% provenance). (2) Real text: on WikiText-2 bytes the notebook improves prediction of repeated rare words by +0.15-0.27 bits/byte, the gain growing with the distance between mentions and holding zero-shot at 4x training length; write-triggered forgetting eliminates memory pollution at 8x length (first-mention cost +0.33 -> -0.004). (3) Scope and scale: a parameter-matched attention head does generalize on natural-text repetition, so the notebook's claim is exact recall at O(L); on a WikiText-103 ladder (8 to 512 MB) the zero-shot repeat gain rises monotonically. All experiments are pre-registered, seeds reported, and reproducible on a single free-tier GPU.

Momentum

Related topics

Latest papers 213