Memory Management for LLM Agents

LLM: Large Language Model

Follow this topic Ask about this topic

Latest papers

58 papers19 papers in the last four weeks, up 375% on the four weeks before. 0.1% of all new papers.

TransMem: Transforming Hidden States into Memory for Large Language Models
Jul 31, 2026Haodong Lei, Junming Liu, Yirong Chen +4Memory-Augmented Language Models LLM Agent Memory
Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China
LazyMem: Retrieve Broadly, Construct Selectively for Efficient Long-Term Agent Memory
Jul 17, 2026Jing Yu, Yibo Zhao, Jiaming Zhang +1Persistent Memory for Language Models Long-Term Conversational Memory
School of Data Science and Engineering, East China Normal University
Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents
Jul 15, 2026Eric Hanchen Jiang, Zhi Zhang, Yuchen Wu +11Persistent Memory for Language Models Memory Management for LLM Agents
University of California Los Angeles · University of Washington · Northwestern University
Selective Memory Retention for Long-Horizon LLM Agents
Jun 28, 2026Pranath ReddyLLM Agent Memory Persistent Memory for Language Models
Independent Researcher, Huntsville, Alabama, USA.
SWE-MeM: Learning Adaptive Memory Management for Long-Horizon Coding Agents
Jun 26, 2026Shuzheng Gao, Wenhao Zeng, Zhaojian Yu +5Software Engineering Agents Memory Management for LLM Agents
The Chinese University of Hong Kong, China · Shanghai Jiao Tong University, China · Tsinghua University, China +1
Forget to Improve: On-Device LLM-Agent Continual Learning via Budget-Curated Memory
Jun 23, 2026Beining Wu, Zihao Ding, Jun Huang +1Continual Learning for LLM Agents LLM Agent Memory
Department of Electrical Engineering and Computer Science, South Dakota State University, Brookings, SD 57007, USA · Virginia Commonwealth University, Richmond, VA, USA
AdaMem: Learning What to Remember with Adaptive Memory Policies for Personalized Agents
Jun 19, 2026Xingyu Chen, Rui Wang, Zhaopeng Tu +1LLM Agent Memory Persistent Memory for Language Models
Shanghai Jiao Tong University, Tencent · Shanghai Jiao Tong University · Tencent
Closing the Feedback Loop: From Experience Extraction to Insight Governance in Verbal Reinforcement Learning
Jun 16, 2026Yanwei Cui, Xing Zhang, Yulong Zhang +4Continual Learning for LLM Agents Non-Stationary RL
AWS Generative AI Innovation Center · Amazon Web Services (AWS) · BingX Group Limited.
MemRefine: LLM-Guided Compression for Long-Term Agent Memory
Jun 11, 2026Minjae Kim, Jinheon Baek, Soyeong Jeong +1Persistent Memory for Language Models LLM Context Compression
Korea University · KAIST
Infini Memory: Maintainable Topic Documents for Long-Term LLM Agent Memory
Jun 9, 2026Suozhao Ji, Baodong Wu, Zehao Wang +8LLM Agent Memory Persistent Memory for Language Models
1Infinigence AI · 2Tsinghua University · 3Shanghai Jiaotong University
Rosetta Memory: Adaptive Memory for Cross-LLM Agents
Jun 5, 2026Hao Yang, Shiqi Shen, Haoxuan Li +3LLM Agent Memory Persistent Memory for Language Models
Gaoling School of Artificial Intelligence, Renmin University of China · Weixin, Tencent · Institute for Artificial Intelligence, Peking University
MemTrain: Self-Supervised Context Memory Training
Jun 2, 2026Ziheng Li, Xingrun Xing, Haoqing Wang +2LLM Agent Memory Persistent Memory for Language Models
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University · Samsung Research, Beijing, China
ElasticMem: Latent Memory as a Learnable Resource for LLM Agents
May 29, 2026Tao Feng, Chongrui Ye, Tianyang Luo +5LLM Agent Memory Persistent Memory for Language Models
University of Illinois Urbana-Champaign · Nanyang Technological University
RecMem: Recurrence-based Memory Consolidation for Efficient and Effective Long-Running LLM Agents
May 15, 2026Zijie Dai, Shiyuan Deng, Sheng Guan +4Persistent Memory for Language Models Long-Horizon LLM Agents
Department of Computer Science and Engineering, The Chinese University of Hong Kong · Huawei Cloud · School of Computer Science, Beijing University of Posts and Telecommunications +2
DimMem: Dimensional Structuring for Efficient Long-Term Agent Memory
May 15, 2026Wentao Qiu, Haotian Hu, Fanyi Wang +2LLM Agent Memory Persistent Memory for Language Models
1StepOS · 2Xiamen University · 3ShanghaiTech University
Useful Memories Become Faulty When Continuously Updated by LLMs
May 13, 2026Dylan Zhang, Yanshan Lin, Zhengkun Wu +4LLM Agent Reliability Persistent Memory for Language Models
University of Illinois Urbana-Champaign · IIIS, Tsinghua University
MEME: Multi-entity & Evolving Memory Evaluation
May 12, 2026Seokwon Jung, Alexander Rubinstein, Arnas Uselis +2Agent Memory Persistent Memory for Language Models
1KAIST AI · 2Tübingen AI Center, University of Tübingen · 3NAVER AI Lab
Human-Inspired Memory Architecture for LLM Agents
May 8, 2026Doga Kerestecioglu, Alexei Robsky, Clemens Vasters +2Agent Memory Management LLM Agent Memory
Microsoft
MemFlow: Intent-Driven Memory Orchestration for Small Language Model Agents
May 5, 2026Jiayi Chen, Yingcong Li, Guiling WangLLM Agent Workflow Optimization Persistent Memory for Language Models
New Jersey Institute of Technology, Newark, USA
Lightweight LLM Agent Memory with Small Language Models
Apr 9, 2026Jiaquan Zhang, Chaoning Zhang, Shuxu Chen +9Memory Management for LLM Agents Persistent Memory for Language Models
University of Electronic Science and Technology of China · Kyung Hee University · City University of Hong Kong +1
MemMachine: A Ground-Truth-Preserving Memory System for Personalized AI Agents
Apr 6, 2026Shu Wang, Edwin Yu, Oscar Love +4LLM Agent Memory Memory Management for LLM Agents
MemVerge, Inc.
LightThinker++: From Reasoning Compression to Memory Management
Apr 4, 2026Yuqi Zhu, Jintian Zhang, Zhenjie Wan +7Memory Management for LLM Agents Efficient Language Model Reasoning
Zhejiang University · Ant Group
Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memory
Mar 4, 2026Zhenting Wang, Huancheng Chen, Jiayun Wang +1LLM Agent Memory Memory Management for LLM Agents
Center for Advanced AI, Accenture
Towards Autonomous Memory Agents
Feb 25, 2026Xinle Wu, Rui Zhang, Mustafa Anis Hussain +1Memory-Augmented Language Model Agents Memory Management for LLM Agents
National University of Singapore, Singapore
Pancake: Hierarchical Memory System for Multi-Agent LLM Serving
Feb 25, 2026Zhengding Hu, Zaifeng Pan, Prabhleen Kaur +6Memory Management for LLM Agents Agent Memory Management
Computer Science and Engineering, University of California, San Diego
AMV-L: Lifecycle-Managed Agent Memory for Tail-Latency Control in Long-Running LLM Systems
Feb 22, 2026Emmanuel BamideleMemory Management for LLM Agents Agent Memory Management
Department of Computer Science, Georgia Institute of Technology
Agent Memory Below the Prompt: Persistent Q4 KV Cache for Multi-Agent LLM Inference on Edge Devices
Feb 17, 2026Yakov Pyotr ShkolnikovMemory Management for LLM Agents LLM Agent Memory
Beyond Static Summarization: Proactive Memory Extraction for LLM Agents
Jan 8, 2026Chengyuan Yang, Zequn Sun, Wei Wei +1LLM Agent Memory Persistent Memory for Language Models
State Key Laboratory for Novel Software Technology, Nanjing University, China · National Institute of Healthcare Data Science, Nanjing University, China

Jul 31, 2026J/K move · Enter open · S save

TransMem: Transforming Hidden States into Memory for Large Language Models

Haodong Lei, Junming Liu, Yirong Chen, Pinlong Cai+3

Southeast University, Nanjing, Jiangsu, China · Shanghai Artificial Intelligence Laboratory, Shanghai, China

Memory-Augmented Language Models LLM Agent Memory Persistent Memory for Language Models Memory-Augmented Language Model Agents Memory Management for LLM Agents

Open paper AskPDF arXiv

Large language model (LLM) agents increasingly operate over long interaction histories, where effective reasoning requires identifying and exploiting task-relevant evidence distributed across past observations and actions. However, useful information encoded in previously computed representations is often underutilized during subsequent generation. We propose TransMem, a lightweight inference-time parametric memory module that transforms sparse historical hidden states from a frozen LLM backbone into reusable memory representations. TransMem uses a lightweight gating network to dynamically apply the latent intervention to the current hidden states, without repeatedly encoding the preceding context. To learn transferable memory utilization rather than task-specific knowledge, we introduce evidence-conditioned self-distillation. A memory-augmented student processes the full context and matches the predictive distribution of an evidence-only teacher that shares the same frozen backbone. Experiments on LoCoMo, HotpotQA, and MemoryAgentBench demonstrate consistent improvements across different model architectures and scales. TransMem yields gains of 11.58--29.25

F_1

on LoCoMo and 10.20--13.03

F_1

on HotpotQA, while improving the average MemoryAgentBench accuracy from 29.54% to 40.00%. These results establish sparse historical hidden states as an effective and efficient memory substrate for long-context LLM agents. Our code is available at https://github.com/Haodong-Lei-Ray/TransMem.