Persistent Memory for Language Models

Follow this topic Ask about this topic

Persistent memory lets language models carry useful information across conversations, tasks, or long sequences without repeatedly processing the full history. Approaches include extracting and compressing facts or episodes for lexical, vector, and graph-based retrieval; managing memory through updates, provenance, and forgetting; and adding learned latent, parametric, recurrent, or persistent key-value states. Systems are commonly tested on cross-session question answering and personalization benchmarks such as LoCoMo and LongMemEval, as well as long-context reasoning and interactive agent tasks. The central tension is retaining enough faithful, current evidence for reliable reasoning while controlling storage, token, and latency costs—and preventing stale, sensitive, or poisoned memories from shaping answers.

Latest papers

272 papers50 papers in the last four weeks, up 67% on the four weeks before. 0.3% of all new papers.

Improving Coherence and Persistence in Agentic AI for System Optimization
Mar 22, 2026Pantea Karimi, Kimia Noorbakhsh, Mohammad Alizadeh +1Long-Horizon LLM Agents Autonomous Research Agents
MIT Cambridge, USA
Mixture of Chapters: Scaling Learnt Memory in Transformers
Mar 22, 2026Tasmay Pankaj Tibrewal, Pritish Saha, Ankit Meda +2Memory-Augmented Language Models Persistent Memory for Language Models
IIT Kharagpur · Fractal AI
Trained Persistent Memory for Frozen Decoder-Only LLMs
Mar 20, 2026Hong JeongPersistent Memory for Language Models Memory-Augmented Language Models
Inha University in Tashkent, Uzbekistan
Memori: A Persistent Memory Layer for Efficient, Context-Aware LLM Agents
Mar 20, 2026Luiz C. Borro, Luiz A. B. Macarini, Gordon Tindall +2Persistent Memory for Language Models LLM Memory
Memori Labs Inc.
MemArchitect: A Policy Driven Memory Governance Layer
Mar 18, 2026Lingavasan Suresh Kumar, Yang Ba, Rong PanAgent Memory Governance Agent Memory Management
Arizona State University
Facts as First Class Objects: Knowledge Objects for Persistent LLM Memory
Mar 18, 2026Oliver Zahn, Simran ChanaPersistent Memory for Language Models LLM Memory
Independent Researcher · University of Cambridge
BenchPreS: A Benchmark for Context-Aware Personalized Preference Selectivity of Persistent-Memory LLMs
Mar 17, 2026Sangyeon Yoon, Hyesoo Hong, Wonje Jeung +5Personalized Language Models LLM Evaluation
Yonsei University · LG AI Research
Trained Persistent Memory for Frozen Encoder--Decoder LLMs: Six Architectural Methods
Mar 17, 2026Hong JeongPersistent Memory for Language Models Memory-Augmented Language Models
Inha University in Tashkent, Uzbekistan
MemX: A Local-First Long-Term Memory System for AI Assistants
Mar 17, 2026Lizheng SunPersistent Memory for Language Models Long-Term Conversational Memory
Selective Memory for Artificial Intelligence: Write-Time Gating with Hierarchical Archiving
Mar 16, 2026Oliver Zahn, Simran ChanaMemory-Augmented Language Models Persistent Memory for Language Models
Independent Researcher · University of Cambridge
Memory as Asset: From Agent-centric to Human-centric Memory Management
Mar 15, 2026Yanqi Pan, Qinghao Huang, Weihao YangAgent Memory Management Persistent Memory for Language Models
Harbin Institute of Technology, Shenzhen · Brachisto Ltd., Hong Kong
StatePlane: A Cognitive State Plane for Long-Horizon AI Systems Under Bounded Context
Mar 13, 2026Sasank Annapureddy, John Mulcahy, Anjaneya Prasad ThamataniLLM Context Management Persistent Memory for Language Models
LPC-SM: Local Predictive Coding and Sparse Memory for Long-Context Language Modeling
Mar 12, 2026Keqin XieLong-Context Language Modeling Autoregressive Language Modeling
Independent Researcher, Suzhou, China
AlpsBench: An LLM Personalization Benchmark for Real-Dialogue Memorization and Preference Alignment
Mar 9, 2026Jianfei Xiao, Xiang Yu, Chengbing Wang +8LLM Personalization Personalized Language Model Alignment
University of Science and Technology of China · National University of Singapore
Proactive Memory for Ad-Hoc Recall over Streaming Dialogues
Mar 5, 2026Bingbing Wang, Jing Li, Ruifeng XuLong-Term Conversational Memory Persistent Memory for Language Models
Department of Computing The Hong Kong Polytechnic University · The School of Computer Science and Technology Harbin Institute of Technology (Shenzhen)
Beyond the Context Window: A Cost-Performance Analysis of Fact-Based Memory vs. Long-Context LLMs for Persistent Agents
Mar 5, 2026Natchanon Pollertlam, Witchayut KornsuwannawitPersistent Memory for Language Models Long-Term Conversational Memory
Bricks Technology
Memory as Ontology: A Constitutional Memory Architecture for Persistent Digital Citizens
Mar 5, 2026Zhenghui LiAgent Memory Governance Agent Memory
RVHE Group / Animesis Memory Project
CraniMem: Cranial Inspired Gated and Bounded Memory for Agentic Systems
Mar 3, 2026Pearl Mody, Mihir Panchal, Rishit Kar +2Agent Memory Agent Memory Management
Dwarkadas Jivanlal Sanghvi College of Engineering
MemSifter: Offloading LLM Memory Retrieval via Outcome-Driven Proxy Reasoning
Mar 3, 2026Jiejun Tan, Zhicheng Dou, Liancheng Zhang +3Memory-Augmented Language Models Persistent Memory for Language Models
Gaoling School of Artificial Intelligence · Renmin University of China · Beijing, China
GAM-RAG: Gain-Adaptive Memory for Evolving Retrieval in Retrieval-Augmented Generation
Mar 2, 2026Yifan Wang, Mingxuan Jiang, Zhihao Sun +5Retrieval-Augmented Generation Adaptive RAG
1Fudan University.
Persistent Identity in AI Agents: A Multi-Anchor Architecture for Resilient Memory and Continuity
Mar 2, 2026Prahlad G. MenonAgent Memory Persistent Memory for Language Models
The Menon Lab
MetaState: Persistent Working Memory Enhances Reasoning in Discrete Diffusion Language Models
Mar 2, 2026Kejing Xia, Mingzhe Li, Lixuan Wei +5Diffusion Language Models Persistent Memory for Language Models
Georgia Institute of Technology · University of Massachusetts Amherst · Harvard University
Understanding LoRA as Knowledge Memory: An Empirical Analysis
Mar 1, 2026Seungju Back, Dongwoo Lee, Naun Kang +4Continual Learning for LLMs Memory-Augmented Language Models
KAIST · Samsung SDS · New York University
Contextual Memory Virtualisation: DAG-Based State Management and Structurally Lossless Trimming for LLM Agents
Feb 25, 2026Cosmo SantoniLLM Context Management Agent Memory Management
Imperial College London
Personalized Graph-Empowered Large Language Model for Proactive Information Access
Feb 25, 2026Chia Cheng Chang, An-Zi Yen, Hen-Hsen Huang +1Persistent Memory for Language Models Information Retrieval
Department of Computer Science and Information Engineering, National Taiwan University, Taipei, Taiwan · Department of Computer Science, National Yang Ming Chiao Tung University, Hsinchu, Taiwan · Institute of Information Science, Academia Sinica, Taipei, Taiwan +1
Revolutionizing Long-Term Memory in AI: New Horizons with High-Capacity and High-Speed Storage
Feb 18, 2026Hiroaki Yamanaka, Daisuke Miyashita, Takashi Toi +3Agent Memory Agent Memory Management
AI & System Research Center, Kioxia Corporation, Yokohama, Japan
Agent Memory Below the Prompt: Persistent Q4 KV Cache for Multi-Agent LLM Inference on Edge Devices
Feb 17, 2026Yakov Pyotr ShkolnikovMemory Management for LLM Agents LLM Agent Memory
Panini: Continual Learning in Token Space via Structured Memory
Feb 16, 2026Shreyas Rajesh, Pavan Holur, Mehmet Yigit Turali +2Continual Learning for LLMs Memory-Augmented Language Models
Department of Electrical and Computer Engineering, University of California, Los Angeles, USA.
Learning to Remember: End-to-End Training of Memory Agents for Long-Context Reasoning
Feb 13, 2026Kehao Zhang, Shangtong Gui, Sheng Yang +2Persistent Memory for Language Models Long-Context Inference
1Key Laboratory of Intelligent Information Processing, Institute of Computing Technology, Chinese Academy of Sciences (ICT/CAS) · University of Chinese Academy of Sciences, Beijing, China · 4Li Auto Inc. +1
MemBuilder: Reinforcing LLMs for Long-Term Memory Construction via Attributed Dense Rewards
Jan 9, 2026Zhiyu Shen, Ziming Wu, Fuming Lai +2Reinforcement Learning Memory-Augmented Language Models
School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China · Tencent Inc.

Mar 22, 2026J/K move · Enter open · S save

Improving Coherence and Persistence in Agentic AI for System Optimization

Pantea Karimi, Kimia Noorbakhsh, Mohammad Alizadeh, Hari Balakrishnan

MIT Cambridge, USA

Long-Horizon LLM Agents Autonomous Research Agents Persistent Memory for Language Models

Open paper AskPDF arXiv

Designing high-performance system heuristics is a creative, iterative process requiring experts to form hypotheses and execute multi-step conceptual shifts. While Large Language Models (LLMs) show promise in automating this loop, they struggle with complex system problems due to two critical failure modes: evolutionary neighborhood bias and the coherence ceiling. Evolutionary methods often remain trapped in local optima by relying on scalar benchmark scores, failing when coordinated multi-step changes are required. Conversely, existing agentic frameworks suffer from context degradation over long horizons or fail to accumulate knowledge across independent runs. We present Engram, an agentic researcher architecture that addresses these limitations by decoupling long-horizon exploration from the constraints of a single context window. Engram organizes exploration into a sequence of agents that iteratively design, test, and analyze mechanisms. At the conclusion of each run, an agent stores code snapshots, logs, and results in a persistent Archive and distills high-level modeling insights into a compact, persistent Research Digest. Subsequent agents then begin with a fresh context window, reading the Research Digest to build on prior discoveries. We find that Engram exhibits superior performance across diverse domains including multi-cloud multicast, LLM inference request routing, and optimizing KV cache reuse in databases with natural language queries.