Persistent Memory for Language Models

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 400% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 190

All topics

PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents
Aug 2, 2026Jingyu Sun, Yan Lin, Yuyang Xue +10Memory-Augmented VLMs Multimodal Memory
The University of Manchester · The University of Newcastle · The University of Edinburgh +5
Lost in Compaction: Evaluating Side-Constraint Loss under Context Compaction
Jul 31, 2026Zhiqi Wang, Yichi Zhang, Dongwon Lee +1Persistent Memory for Language Models Instruction Following
The Pennsylvania State University
Zero-Mem: Zero-Token Memory Operations for LLM Agents
Jul 31, 2026Yilin Xiao, Zhehan Zhu, Yujing Zhang +8Conversational Memory Long-Context QA
The Hong Kong Polytechnic University, Hong Kong SAR · School of Computing and Artificial Intelligence, Southwestern University of Finance and Economics · School of Artificial Intelligence, Jilin University
Memory Provenance Laundering in LLM Agents: A Non-Amplification Firewall for Persistent Memory
Jul 31, 2026Jinghan Xu, Yiyong Xiao, Wanru Shao +2Persistent Memory for Language Models Agent Memory Poisoning
TransMem: Transforming Hidden States into Memory for Large Language Models
Jul 31, 2026Haodong Lei, Junming Liu, Yirong Chen +4Memory-Augmented Language Models LLM Agent Memory
Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China
Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
Jul 30, 2026Rubin Wei, Jiaqi Cao, Jiarui Wang +4Language Model Pretraining Memory-Augmented Language Models
LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Artificial Intelligence Laboratory · Electronic Engineering, Tsinghua University
Subtract, Transport, or Replay? Auditable Deletion from Language-Model Memory
Jul 30, 2026Vishwajith RameshMemory-Augmented Language Models LLM Auditing
Vy Labs, Inc.
InferScale: GPU-Native KV Injection for Personalized LLM Serving
Jul 29, 2026Peter Li, Prashant PandeyLLM Serving Memory-Augmented Language Models
Northeastern University Boston, Massachusetts, USA
Metis: Memory Foundation Model
Jul 29, 2026Zeyu Zhang, Ziliang Guo, Yihang Sun +14Agent Memory Memory-Augmented Language Models
MemTensor (Shanghai) Technology Co., Ltd. · Shanghai Jiao Tong University · National University of Singapore +2
A Graph-Native Bitemporal Memory Store for Conversational AI Agents
Jul 29, 2026Alp Niksarli, Gopesh BahetiConversational Memory LLM Agent Memory
Davidson College
ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangKnowledge Editing Continual Learning for LLMs
Department of Automation, University of Science and Technology of China, Hefei, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China.
Eviction as Estimation: A Fixed-Lag Smoothing View of Test-Time Memory, and When Measuring Beats Accumulating
Jul 27, 2026Maruthi Vemula, Neeraj Praneeth GajulaKV Caching KV-Cache Eviction
University of North Carolina at Chapel Hill · New York University
MemChain: Learning Interpretable Memory Traces for Memory-Augmented LLM Agents
Jul 27, 2026Yiwen Ma, Songjun Tu, Qichao Zhang +3LLM Agent Memory Persistent Memory for Language Models
Institute of Automation, Chinese Academy of Sciences · School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences +1
A Frozen 12B Beats Frontier Models on Verified Work: 100% Accuracy, 0 Tokens, Bit-Exact, Forever
Jul 26, 2026Sietse SchelpePersistent Memory for Language Models LLM Memory
Corbenic AI
Compute Globally, Materialize Locally: The Memory Contract of Sparse Event-KV
Jul 26, 2026Zefeng Cai, Zerui CaiKV Caching KV-Cache Eviction
Independent Researchers
RUMBA: Russian User Memory Benchmark
Jul 23, 2026Elizaveta Shevtsova, Inna Glebkina, Mark Baushenko +2Temporal Reasoning in Language Models Temporal Reasoning
1DAIMLD
Naju: A Native Discrete State-Space Model with Independent Retention and Writing for Long-Sequence Memory
Jul 23, 2026Hyuk Lim, Seunghyun YoonPersistent Memory for Language Models Long-Context Modeling
Korea Institute of Energy Technology (KENTECH)
PRO-LONG: Programmatic Memory Enables Long-Horizon Reasoning
Jul 22, 2026Alexis Fox, Junlin Wang, Paul Rosu +1Persistent Memory for Language Models Long-Horizon Agent Tasks
Duke University
Exploratory and Assimilating Reflection: Reflective Recall Cycle for Long-term Memory
Jul 20, 2026Ganesh Senrayan, Moyuru Yamada, Ishan Jindal +1LLM Agent Memory Persistent Memory for Language Models
1Fujitsu Limited
ZifaMem: Structured Memory for Persona, Preference, and Emotional Continuity in AI Companions
Jul 20, 2026Jingzhe Fang, Guozhi Xu, Yunfan Cui +2LLM Agent Memory Persistent Memory for Language Models
ZifaCorp · University of Science and Technology of China · Fudan University
Retain or Consolidate? Budget-Dependent Operator Selection for Language Agent Memory
Jul 20, 2026Qingcan Kang, Mingyang Liu, Shixiong Kai +5LLM Agent Memory Persistent Memory for Language Models
Huawei Noah’s Ark Lab · Department of Computer Science, City University of Hong Kong
LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory
Jul 17, 2026Jing Yu, Yibo Zhao, Jiaming Zhang +1Persistent Memory for Language Models Long-Term Conversational Memory
School of Data Science and Engineering, East China Normal University
Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
Jul 15, 2026Eric Hanchen Jiang, Zhi Zhang, Yuchen Wu +11Persistent Memory for Language Models Agent Memory Management
University of California Los Angeles · University of Washington · Northwestern University
MemOps: Benchmarking Lifecycle Memory Operations in Long-Horizon Conversations
Jul 14, 2026Xixuan Hao, Zeyu Zhang, Zehao Lin +6Conversational Memory Persistent Memory for Language Models
MemTensor (Shanghai) Technology Co., Ltd. · The Hong Kong University of Science and Technology (Guangzhou) · Renmin University of China
Shared Selective Persistent Memory for Agentic LLM Systems
Jul 10, 2026Sanjana Pedada, Aditya Dhavala, Neelraj PatilLLM Agent Memory Persistent Memory for Language Models
Apple Inc.
FluctlightDB: A Memory Model of Data for AI Agents
Jul 10, 2026Ganesh SConversational Memory Persistent Memory for Language Models
Independent Researcher
TF-Engram: A Train-Free Engram with SSD-Backed Memory for Large Language Models
Jul 8, 2026Yutang Ma, Kecheng Huang, Xikun Jiang +1Memory-Augmented Language Models Knowledge Augmentation for Language Models
The Chinese University of Hong Kong · Beijing Institute of Technology, Zhuhai
MemDefrag: Latent Memory Defragmentation for Large Language Models
Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoContinual Learning for LLMs Memory-Augmented Language Models
Kyoto University · LIGHTSPEED · Independent Researcher
From Passive Retrieval to Active Memory Navigation: Learning to Use Memory as a Structured Action Space
Jul 7, 2026Yue Xu, Yutao Sun, Yihao Liu +7Persistent Memory for Language Models Long-Term Conversational Memory
Qwen Large Model Application Team, Alibaba · Zhejiang University · Peking University +2
A Hippocampus for Linear Attention: An Exact Memory for What the Recurrent State Forgets
Jul 2, 2026Wanyun CuiLong-Context Retrieval Memory-Augmented Language Models
Shanghai University of Finance and Economics

Aug 2, 2026, cs.AIJ/K move · Enter open · S save

PMMC: Prospective Multimodal Memory Compilation for Long-Term LVLM Agents

Jingyu Sun, Yan Lin, Yuyang Xue, Yifan Wang+9

The University of Manchester · The University of Newcastle · The University of Edinburgh+5

Memory-Augmented VLMs Multimodal Memory Persistent Memory for Language Models Multimodal QA Long-Horizon LLM Agents Memory Consolidation

Open paper AskPDF arXiv

Long-term memory is essential for LVLM agents to maintain consistency and integrate information across extended multimodal interactions. Existing agent memory systems, however, often reduce visual experiences into textual summaries or rely on static retrieve-then-reason pipelines, which are inefficient at query time and brittle when questions require image-text binding, temporal updates, or visual details. We propose Prospective Multimodal Memory Compilation, a framework that shifts part of the memory reasoning process from query time to memory consolidation time. Given accumulated multimodal interactions, a Questioner predicts future question candidates, a Planner compiles question-conditioned multimodal memory programs, and a Doubter verifies whether the planned evidence path can support the predicted answer. The verified question-program pairs form a structured question bank for efficient query-time routing and evidence retrieval. Experiments on multimodal long-term memory benchmarks show that our method improves answer quality and visual evidence recall while reducing query-time token and latency costs. Extensive ablations analyze the effects of self-feedback, dynamic planning, raw-image access, and question bank coverage.

Momentum

Related topics

Latest papers 190