LLM Memory

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 73

All topics

MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents
Oct 5, 2026Haozhen Zhang, Haodong Yue, Quanyu Long +6LLM Agent Memory LLM Memory
Nanyang Technological University · Tsinghua University · University of Illinois Urbana-Champaign
Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
Oct 1, 2026Arman Behnam, Binghui WangLLM Memory Causal Inference
Department of Computer Science Illinois Institute of Technology Chicago, IL
Learning What to Remember: Long-horizon Counterfactual Memory Optimization
Sep 29, 2026Jiaming Tang, Mingyan Liu, Armin SarabiMemory-Augmented Language Models Persistent Memory for Language Models
Department of Electrical Engineering and Computer Science, University of Michigan
FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models
Sep 28, 2026Bowen Yang, Jingbo Zhou, Qinghong Miao +1Memory-Augmented Language Models LLM Memory
Large Model Frontier Research Department, Baidu Inc., China · Nanyang Technological University
DPS: Dual-Mode Precision LLM Serving with Semi-Unified Memory
Sep 28, 2026Xuan Truong Nguyen, Tien Son Pham, Tuan Duc Chu +2LLM Serving LLM Inference
Department of Next Generation Semiconductor Convergence and Open Sharing System (COSS), Seoul National University, Seoul 08826, South Korea · Van-Lang Institute of Semiconductor Technology (VIST), Hanoi, Vietnam · Efficient Computation Research Group, Moreh Vietnam +1
Positions Are Not Facts: The Mismatch Between KV Caches and Memory
Sep 27, 2026Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5Knowledge Editing Knowledge Conflicts in Language Models
Fudan University · Baidu · Zhejiang University +2
Grounding Memory Summarization in Utility Intent
Sep 27, 2026Zhenyu Lei, Mingjia Shi, Xingbo Fu +3Conversational Memory LLM Memory
University of Virginia · Northeastern University
LSTMem: Hierarchical Long Short-Term Online Memory for Large Language Models
Sep 27, 2026Xianglong Shi, Ruijie Yang, Sirui Zhao +4Memory-Augmented Language Models Persistent Memory for Language Models
University of Science and Technology of China
Complementary Roles of Activation and Parametric Memory in Few-Shot Learning
Sep 23, 2026Miaohe Niu, Runsong Zhao, Xinyu Liu +5LLM Memory Few-Shot Learning
Northeastern University, Shenyang, China · NiuTrans Research, Shenyang, China
SpeakerMem-R1: Speaker-Centered Dual-Track Memory for Multi-Party Dialogue
Sep 22, 2026Haobo Zheng, Tan Tang, Yan Chen +2Conversational Memory LLM Memory
State Key Lab of CAD&CG, Zhejiang University
Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
Sep 14, 2026MyungHoon Ryu, XinYu Piao, Jong-Kook KimLLM Memory Long-Context Modeling
Korea University South Korea
The Cost of Compression: A Rate-Distortion Limit on Factual Hallucination
Sep 14, 2026Xi Wang, Shijia Xu, Rongfeng GuoMemorization in Language Models Hallucination in Language Models
Hefei Institutes of Physical Science, Chinese Academy of Sciences, China · University of Science and Technology of China, China · Chongqing University, China +1
Pull: Lazy Materialization of Working Memory for Stateful LLM Conversations
Sep 13, 2026Jiangang ChenLLM Inference Efficiency LLM Memory
Chengdu Beiluoshimen Technology Co., Ltd.
What It Costs to Compose, Rebuild, and Correct Precomputed Memory
Aug 31, 2026Asa ShepardLLM Inference Efficiency Memory-Augmented Language Models
Department of Computer Science, Williams College
Mitigating Over-Personalization in LLMs via Structured Memory
Aug 8, 2026Hakeem Hannoon, Andrew Zhao, Mihir Narayan +2LLM Sycophancy Persistent Memory for Language Models
University of Saskatchewan · University of California–Irvine · University of Wisconsin–Madison +2
PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents
Aug 7, 2026Mohammad Amanlou, Parham Abed Azad, Farbod Davoodi +3Cognitive Architectures for AI Agents LLM Agent Memory
School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran. · Department of Computer Engineering, Sharif University of Technology, Tehran, Iran. · Missouri University of Science and Technology, Rolla, MO, USA. +1
From Test-Time Scaling to Reusable Memory: Measuring Crystallization in Text-to-SQL
Aug 7, 2026Jiaqian Wang, Yutao Qi, Wenjin Hou +2LLM Memory Text-to-SQL
Xidian University · Xidian University Xi’an, Shaanxi, China · Shanghai Jiao Tong University +1
Runtime Observability for Heterogeneous Attention Memory
Aug 6, 2026Fanzhe Wei, Li Liu, Ziyang Wang +1KV Caching LLM Auditing
Metask Lab
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
Aug 3, 2026Zhichen Liu, Ruihan Sun, Hengjie Yang +4Memory-Augmented Language Models LLM Inference
Southern University of Science and Technology · Xidian University
V-Mem: Modality-Routed Retrieval for Long-Term Multimodal Agentic Memory
Aug 2, 2026Dingyi Kang, Dongming Jiang, Yi Li +2Multimodal IR Multimodal Memory
Department of Computer Science, The University of Texas at Dallas · Department of Electrical and Computer Engineering, University of Florida
$Σ$ -Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems
Jul 30, 2026Peilin Feng, Suorong Yang, Soujanya PoriaAI Agent Reliability Multi-Agent LLM Systems
1DeCLaRe Lab, Nanyang Technological University
ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangKnowledge Editing Continual Learning for LLMs
Department of Automation, University of Science and Technology of China, Hefei, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China.
Memory for Large Language Models
Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Memory-Augmented Language Models LLM Memory
Tsinghua University · National University of Singapore · Bosch AI
Eviction as Estimation: A Fixed-Lag Smoothing View of Test-Time Memory, and When Measuring Beats Accumulating
Jul 27, 2026Maruthi Vemula, Neeraj Praneeth GajulaKV Caching KV-Cache Eviction
University of North Carolina at Chapel Hill · New York University
From Observation to Intervention: Memory in Brains and Large Language Models
Jul 27, 2026Morteza Salehjahromi, Shayan A. Zadegan, Amgad Muneer +1LLM Memory
Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA · Department of Neurology, The University of Tennessee Health Science Center, Memphis, TN, USA · Department of Thoracic/Head and Neck Medical Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA +1
A Frozen 12B Beats Frontier Models on Verified Work: 100% Accuracy, 0 Tokens, Bit-Exact, Forever
Jul 26, 2026Sietse SchelpePersistent Memory for Language Models LLM Memory
Corbenic AI
Presentation, Not Mechanism: A Render Confound in Deprecation-Aware Memory Evaluation
Jul 17, 2026Zhaoyang Jiang, Zhizhong Fu, Zicheng Li +5LLM Memory Question Answering
School of Health & Wellbeing, University of Glasgow, Glasgow, UK · School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China · Institute of Health Informatics, University College London, London, UK +1
Creativity, honesty and designed forgetting emerge in small hyperbolic language models
Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinLLM Sycophancy Memory-Augmented Language Models
PolymathMinds Lab, Seoul, Republic of Korea. · Department of Chemical Engineering, POSTECH, Pohang, and aSSIST University, Seoul, Republic of Korea. · Korean Educational Development Institute, Jincheon, Republic of Korea.
What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiRate-Distortion Theory LLM Memory
University of California, Irvine Irvine, California, USA
MemDefrag: Latent Memory Defragmentation for Large Language Models
Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoContinual Learning for LLMs Memory-Augmented Language Models
Kyoto University · LIGHTSPEED · Independent Researcher
Multi-Head Recurrent Memory Agents
Jul 1, 2026Jiatong Li, Samuel Yeh, Sharon LiLLM Memory Long-Context Modeling
Department of Computer Science, University of Wisconsin-Madison
Beyond Perplexity: A Behavioral Evaluation Framework for Deployment-Memory Claims in LLM Test-Time Training
Jul 1, 2026Xiangchen Song, Zhenhao Chen, Lingjing Kong +4LLM Evaluation LLM Memory
Carnegie Mellon University · MBZUAI
ISM:Self-Improving Strategy Memory for Continual Mathematical Reasoning
Jun 30, 2026Prakhar Dixit, Tim OatesContinual Learning for LLMs Memory-Augmented Language Models
Department of Computer Science, University of Maryland, Baltimore County, Baltimore, Maryland, USA
The Past Is Prologue: A Plug-in Controller for Selective Updates in Sequentially Evolving LLM Memory
Jun 30, 2026Zihan Chen, Songwei Dong, Chengshuai Shi +4Continual Learning for LLM Agents Persistent Memory for Language Models
University of Virginia · Princeton University · University of Central Florida
MMLA: Memory-Mediated Learning Architecture for Predictive Dual-State Adaptation
Jun 27, 2026Junyi Zou, Avrova DonzContinual Learning for LLMs Test-Time Adaptation
1MMLA-org · 2Communication University of China (CUC), No. 1 Dingfuzhuang East Street, Chaoyang District, Beijing 100024, China
Reclaim Evaluation: A Lossy Memory Is Worse Than an Empty One
Jun 24, 2026Alex KwonLLM Evaluation Memory-Augmented Language Models
Independent Researcher
Towards Root Memories: Benchmarking and Enhancing Implicit Logical Memory Retrieval for Personalized LLMs
Jun 22, 2026Hongxun Ding, Xiang Yu, Chengbing Wang +4LLM Personalization Memory-Augmented Language Models
University of Science and Technology of China, China
User as Engram: Internalizing Per-User Memory as Local Parametric Edits
Jun 17, 2026Bojie LiKnowledge Editing LLM Personalization
Pine AI
The Reservoir Attention Network: Cross-Pass State in Pretrained Transformers via Content-Addressable Reservoir Injection
Jun 14, 2026Emma LeonhartMemory-Augmented Neural Networks Persistent Memory for Language Models
T-Mem: Memory That Anticipates, Not Archives
Jun 13, 2026Weidong Guo, Dakai Wang, Zixuan Wang +2Persistent Memory for Language Models LLM Memory
1Tencent · 2The Hong Kong University of Science and Technology (Guangzhou)
Learning What to Remember: A Cognitively Grounded Multi-Factor Value Model for Agentic Memory
Jun 11, 2026Zhibao Chen, Qian ChengLLM Agent Memory Persistent Memory for Language Models
Huatai Securities, Nanjing, China
Substrate Asymmetry in User-Side Memory: A Diagnostic Framework
Jun 10, 2026Youwang DengRetrieval-Augmented Generation LLM Personalization
EpistemicaLab — Independent Research
Position: Hippocampal Explicit Memory Is the Cornerstone for AGI
Jun 5, 2026Sangjun ParkMemory-Augmented Language Models LLM Memory
Department of Computer Science, University of Texas at Austin, TX, USA · Cognizant AI Labs, San Francisco, CA, USA
How LoRA Remembers? A Parametric Memory Law for LLM Finetuning
May 28, 2026Ziwen Xu, Haiwen Hong, Linsong Yu +4Memorization in Language Models LLM Fine-Tuning
Zhejiang University · Alibaba Group
VikingMem: A Memory Base Management System for Stateful LLM-based Applications
May 28, 2026Jiajie Fu, Junwen Chen, Mengzhao Wang +5Memory-Augmented Language Models Persistent Memory for Language Models
Zhejiang University · China · ByteDance
Code-QA-Bench: Separating Code Reasoning from Documentation Memorization in Repository-Level QA
May 28, 2026Jun Zhang, JianYing Qu, Hanwen Du +3Software Engineering Benchmarks LLM Memory
Baidu Inc.
MemTrace: Tracing and Attributing Errors in Large Language Model Memory Systems
May 27, 2026Xinle Deng, Ruobin Zhong, Hujin Peng +15LLM Evaluation Memory-Augmented Language Models
1Zhejiang University, 2Alibaba Group
MemFail: Stress-Testing Failure Modes of LLM Memory Systems
May 26, 2026Ishir Garg, Neel Kolhe, Dawn Song +1LLM Agent Memory LLM Memory
University of California, Berkeley
Simulating Human Memory with Language Models
May 25, 2026Qihan Wang, Nicholas Tomlin, Michael Hu +2LLM Evaluation Memory-Augmented Language Models
NYU · UMass Amherst
NGM: A Plug-and-Play Training-Free Memory Module for LLMs
May 16, 2026Yuwen Qu, Wenhui Dong, Chenyang Si +1Memory-Augmented Language Models Knowledge Augmentation for Language Models
Nanjing University
Is One Score Enough? Rethinking the Evaluation of Sequentially Evolving LLM Memory
May 14, 2026Songwei Dong, Zihan Chen, Chengshuai Shi +3Continual Learning for LLMs LLM Evaluation
University of Virginia · Princeton University
MeMo: Memory as a Model
May 14, 2026Ryan Wei Heng Quek, Sanghyuk Lee, Alfred Wei Lun Leong +6Retrieval-Augmented Generation Memory-Augmented Language Models
Institute of Data Science, National University of Singapore, Singapore · Integrative Sciences and Engineering Programme, NUSGS, Singapore · Agency for Science, Technology, Research (A*STAR), Singapore +6
EvolveMem:Self-Evolving Memory Architecture via AutoResearch for LLM Agents
May 13, 2026Jiaqi Liu, Xinyu Ye, Peng Xia +4LLM Agent Memory LLM Memory
UNC-Chapel Hill · UC Berkeley · UCSC
$δ$ -mem: Efficient Online Memory for Large Language Models
May 12, 2026Jingdi Lei, Di Zhang, Junxian Li +7Memory-Augmented Language Models Memorization in Language Models
Nanyang Technological University · Mind Lab · Fudan University +3
Structured Belief State and the First Precision-Aware Benchmark for LLM Memory Retrieval
May 11, 2026Jeffrey FlyntConversational Memory LLM Memory
Independent Researcher
WiCER: Wiki-memory Compile, Evaluate, Refine Iterative Knowledge Compilation for LLM Wiki Systems
May 8, 2026Juan M. HuertaKV Caching Counterexample-Guided Refinement
Zinnia Tech Solutions 600 Steamboat Road Greenwich, CT 06830, USA
Continual Knowledge Updating in LLM Systems: Learning Through Multi-Timescale Memory Dynamics
May 6, 2026Andreas Pattichis, Constantine DovrolisContinual Learning for LLMs LLM Memory
The Cyprus Institute, Nicosia, Cyprus · School of Computer Science, Georgia Institute of Technology, Atlanta, GA, USA.
The Dynamic Gist-Based Memory Model (DGMM): A Memory-Centric Architecture for Artificial Intelligence
May 4, 2026Terry Dorsey, Kevin HugginsMemory-Augmented Neural Networks LLM Interpretability
Harrisburg University of Science and Technology, USA
Probe-Geometry Alignment: Erasing the Cross-Sequence Memorization Signature Below Chance
May 3, 2026Anamika Paul Rupa, Anietie AndyMemorization in Language Models Neural Network Memorization
Howard University
From Unstructured Recall to Schema-Grounded Memory: Reliable AI Memory via Iterative, Schema-Aware Extraction
Apr 30, 2026Alex Petrov, Alexander Gusak, Denis Mukha +1LLM Memory Document Information Extraction
1xmemory

Oct 5, 2026, cs.CLJ/K move · Enter open · S save

MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents

Haozhen Zhang, Haodong Yue, Quanyu Long, Jianzhu Bao+5

Nanyang Technological University · Tsinghua University · University of Illinois Urbana-Champaign

LLM Agent Memory LLM Memory Agent Memory Management RL for LLM Agents

Open paper AskPDF arXiv

Memory has become integral to the LLM agent ecosystem, supporting information retention and reuse across interactions. However, most existing agent memory systems construct memory in a query-agnostic manner, which can incur unnecessary preprocessing cost and discard details that later prove essential. Recent studies have begun shifting memory processing toward runtime adaptation, but typically specialize in particular operations or fixed processing schemes, leaving flexible control over performance, cost, and latency largely underexplored. To address this challenge, we present \textbf{MemPilot}, a flexible framework that orchestrates on-demand memory curation under different performance--cost--latency preferences. Specifically, we optimize a multi-step LLM policy via reinforcement learning to iteratively choose between retrieving from query-agnostic memory and delegating query-specific curation of raw multimodal history to heterogeneous LLMs and VLMs. The policy jointly controls evidence amount, curation instructions, model selection, and visual access, enabling fine-grained allocation of runtime computation. To optimize this policy under competing objectives, we adapt objective-wise advantage decoupling by separately estimating each objective's advantage before aggregation. Moreover, we introduce prefix-based marginal utility estimation for fine-grained credit assignment across multi-step rollouts. Experiments on five multimodal agent-memory benchmarks demonstrate favorable performance--cost--latency trade-offs across optimization preferences, with preference sweeps yielding broader frontiers than existing trade-off-aware baselines.

Momentum

Related topics

Latest papers 73