Persistent Memory for Language Models

Follow this topic Ask about this topic

Momentum

35 papers in the last four weeks, up 400% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 190

All topics

MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models
May 14, 2026Xiyu Ren, Zhaowei Wang, Yiming Du +11VLM Evaluation Memory-Augmented VLMs
CSE Deparment, HKUST · CUHK · OmniMemory (Shenzhen) Intelligent Technology Co., Ltd. +1
A Heterogeneous Temporal Memory Governance Framework for Long-Term LLM Persona Consistency
May 14, 2026Zhao Yang, Wang Huan, Li Yingshuo +2Memory-Augmented Language Models Persona Consistency
Changchun Kelaile Technology Co., Ltd, Qinglong Road, Luyuan District, Changchun, 130000, Jilin, China. · School of Electronic Information, Zhongshan Institute, University of Electronic Science and Technology of China, No. 1 Xueyuan Road,2026 Zhongshan, 528402, Guangdong, China.
Phasor Memory Networks: Stable Backpropagation Through Time for Scalable Explicit Memory
May 13, 2026Sungwoo Goo, Hwi-yeol Yun, Sangkeun JungMemory-Augmented Neural Networks Memory-Augmented Language Models
College of Pharmacy Chungnam National University Daejeon, South Korea · Department of Computer Science & Engineering Chungnam National University Daejeon, South Korea
Useful Memories Become Faulty When Continuously Updated by LLMs
May 13, 2026Dylan Zhang, Yanshan Lin, Zhengkun Wu +4AI Agent Reliability Persistent Memory for Language Models
University of Illinois Urbana-Champaign · IIIS, Tsinghua University
MEME: Multi-entity & Evolving Memory Evaluation
May 12, 2026Seokwon Jung, Alexander Rubinstein, Arnas Uselis +2Agent Memory Persistent Memory for Language Models
1KAIST AI · 2Tübingen AI Center, University of Tübingen · 3NAVER AI Lab
$δ$ -mem: Efficient Online Memory for Large Language Models
May 12, 2026Jingdi Lei, Di Zhang, Junxian Li +7Memory-Augmented Language Models Memorization in Language Models
Nanyang Technological University · Mind Lab · Fudan University +3
Portable Agent Memory: A Protocol for Cryptographically-Verified Memory Transfer Across Heterogeneous AI Agents
May 10, 2026Santhosh Kumar RavindranAgent Memory Persistent Memory for Language Models
Microsoft Corporation, Redmond, WA, USA
VORT: Adaptive Power-Law Memory for NLP Transformers
May 9, 2026Nabil MlaikiMemory-Augmented Language Models Transformer
Department of Mathematics and Sciences, Prince Sultan University, Riyadh, Saudi Arabia
Human-Inspired Memory Architecture for LLM Agents
May 8, 2026Doga Kerestecioglu, Alexei Robsky, Clemens Vasters +2Memorization in Language Models LLM Agent Memory
Microsoft
Storage Is Not Memory: A Retrieval-Centered Architecture for Agent Recall
May 6, 2026Joshua Adler, Guy ZehaviAgent Memory LLM Agent Memory
Sauron Labs
Memory as a Markov Matrix: Sample Efficient Knowledge Expansion via Token-to-Dictionary Mapping
May 5, 2026Kaustubh Pethkar, Ziyang Xiong, Zuofeng Shang +1Continual Learning for LLMs Memorization in Language Models
New Jersey Institute of Technology · University of California, Berkeley
MemFlow: Intent-Driven Memory Orchestration for Small Language Model Agents
May 5, 2026Jiayi Chen, Yingcong Li, Guiling WangLLM Agent Memory Persistent Memory for Language Models
New Jersey Institute of Technology, Newark, USA
MEMAUDIT: An Exact Package-Oracle Evaluation Protocol for Budgeted Long-Term LLM Memory Writing
May 4, 2026Nishant Bhargava, Rodrigo Sobral BarrentoPersistent Memory for Language Models LLM Agent Evaluation
Purdue University
Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance
May 3, 2026Anamika Paul Rupa, Anietie AndyMemorization in Language Models Neural Network Memorization
Howard University
GRAVITY: Architecture-Agnostic Structured Anchoring for Long-Horizon Conversational Memory
May 3, 2026Yushi Sun, Bowen Cao, Dong Fang +2LLM Agent Memory Persistent Memory for Language Models
LIGHTSPEED, Shenzhen, China · The Chinese University of Hong Kong, Hong Kong, China
MemORAI: Memory Organization and Retrieval via Adaptive Graph Intelligence for LLM Conversational Agents
May 2, 2026Hung Pham Van, Nguyen Manh Hieu, Khang Pham Tran Tuan +4Conversational Memory Graph Retrieval-Augmented Generation
1Independent Researcher · 2Hanoi University of Science and Technology · 3VNU University of Engineering and Technology +1
MemRouter: Memory-as-Embedding Routing for Long-Term Conversational Agents
May 1, 2026Tianyu Hu, Weikai Lin, Weizhi Zhang +2Persistent Memory for Language Models Long-Term Conversational Memory
University of Central Florida · University of Rochester · University of Illinois at Chicago +1
EviMem: Evidence-Gap-Driven Iterative Retrieval for Long-Term Conversational Memory
Apr 30, 2026Yuyang Li, Yime He, Zeyu Zhang +1Multi-Hop QA Persistent Memory for Language Models
The Australian National University · UNSW Sydney
Hierarchical Long-Term Semantic Memory for LinkedIn's Hiring Agent
Apr 29, 2026Zhentao Xu, Shangjin Zhang, Emir Poyraz +7LLM Agent Memory Persistent Memory for Language Models
LinkedIn Corporation Sunnyvale, CA, USA · LinkedIn Corporation New York, NY, USA
ZenBrain: A Neuroscience-Inspired 7-Layer Memory Architecture for Autonomous AI Systems
Apr 26, 2026Alexander BeringMemorization in Language Models Neural Processes
Zensation AI
Evolve: A Persistent Knowledge Lifecycle for Small Language Models
Apr 25, 2026Dikran HovagimianRetrieval-Augmented Generation Memory-Augmented Language Models
Independent Researcher
StructMem: Structured Memory for Long-Horizon Behavior in LLMs
Apr 23, 2026Buqiang Xu, Yijun Chen, Jizhan Fang +5Multi-Hop QA Temporal Reasoning
Zhejiang University · Zhejiang University - Ant Group Joint Laboratory of Knowledge Graph · Ant Group
Spatial Metaphors for LLM Memory: A Critical Analysis of the MemPalace Architecture
Apr 23, 2026Robin Dey, Panyanon ViradechaPersistent Memory for Language Models LLM Memory
OpenHub Research Chiang Mai, Thailand
EngramaBench: Evaluating Long-Term Conversational Memory with Structured Graph Retrieval
Apr 23, 2026Julian AcunaLLM Evaluation Memorization in Language Models
SCM: Sleep-Consolidated Memory with Algorithmic Forgetting for Large Language Models
Apr 22, 2026Saish Sachin ShindeMemory-Augmented Language Models Memorization in Language Models
Clyrai IP Studio
Absorber LLM: Harnessing Causal Synchronization for Test-Time Training
Apr 22, 2026Zhixin Zhang, Shabo Zhang, Chengcan Wu +2Memory-Augmented Language Models Long-Context Language Model Inference
1Peking University.
Sessa: Selective State Space Attention
Apr 20, 2026Liubomyr HorbatkoSelf-Attention Long-Context Language Modeling
WorldDB: A Vector Graph-of-Worlds Memory Engine with Ontology-Aware Write-Time Reconciliation
Apr 20, 2026Harish Santhanalakshmi GanesanEntity Resolution Persistent Memory for Language Models
Independent Researcher
HiGMem: A Hierarchical and LLM-Guided Memory System for Long-Term Conversational Agents
Apr 20, 2026Shuqi Cao, Jingyi He, Fei TanPersistent Memory for Language Models Hierarchical Memory
East China Normal University, Shanghai, China · Shanghai Jiao Tong University, Shanghai, China
AnchorMem: Anchored Facts with Associative Contexts for Building Memory in Large Language Models
Apr 19, 2026Zhanyu Shen, Sijie Cheng, Zhicheng Guo +3Memory-Augmented Language Models Memorization in Language Models
College of Computer Science and Software Engineering, Shenzhen University · Tsinghua University

May 14, 2026, cs.CVJ/K move · Enter open · S save

MemLens: Benchmarking Multimodal Long-Term Memory in Large Vision-Language Models

Xiyu Ren, Zhaowei Wang, Yiming Du, Zhongwei Xie+10

CSE Deparment, HKUST · CUHK · OmniMemory (Shenzhen) Intelligent Technology Co., Ltd.+1

VLM Evaluation Memory-Augmented VLMs Multimodal Memory Vision-Language Models Persistent Memory for Language Models Long-Context VLMs+2

Open paper AskPDF arXiv

Memory is essential for large vision-language models (LVLMs) to handle long, multimodal interactions, with two method directions providing this capability: long-context LVLMs and memory-augmented agents. However, no existing benchmark conducts a systematic comparison of the two on questions that genuinely require multimodal evidence. To close this gap, we introduce MEMLENS, a comprehensive benchmark for memory in multimodal multi-session conversations, comprising 789 questions across five memory abilities (information extraction, multi-session reasoning, temporal reasoning, knowledge update, and answer refusal) at four standard context lengths (32K-256K tokens) under a cross-modal token-counting scheme. An image-ablation study confirms that solving MEMLENS requires visual evidence: removing evidence images drops two frontier LVLMs below 2% accuracy on the 80.4% of questions whose evidence includes images. Evaluating 27 LVLMs and 7 memory-augmented agents, we find that long-context LVLMs achieve high short-context accuracy through direct visual grounding but degrade as conversations grow, whereas memory agents are length-stable but lose visual fidelity under storage-time compression. Multi-session reasoning caps most systems below 30%, and neither approach alone solves the task. These results motivate hybrid architectures that combine long-context attention with structured multimodal retrieval. Our code is available at https://github.com/xrenaf/MEMLENS.

Momentum

Related topics

Latest papers 190