LLM Memory

LLM: Large Language Model

Follow this topic Ask about this topic

Momentum

12 papers in the last four weeks, against 1 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 73

All topics

MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents
Oct 5, 2026Haozhen Zhang, Haodong Yue, Quanyu Long +6LLM Agent Memory LLM Memory
Nanyang Technological University · Tsinghua University · University of Illinois Urbana-Champaign
Causal Memory Policy: Making Memory Utility Identifiable by Intervening on Retrieval
Oct 1, 2026Arman Behnam, Binghui WangLLM Memory Causal Inference
Department of Computer Science Illinois Institute of Technology Chicago, IL
Learning What to Remember: Long-horizon Counterfactual Memory Optimization
Sep 29, 2026Jiaming Tang, Mingyan Liu, Armin SarabiMemory-Augmented Language Models Persistent Memory for Language Models
Department of Electrical Engineering and Computer Science, University of Michigan
FactorEngram: Factorized N-gram Memory with Basis-Level Gating for Language Models
Sep 28, 2026Bowen Yang, Jingbo Zhou, Qinghong Miao +1Memory-Augmented Language Models LLM Memory
Large Model Frontier Research Department, Baidu Inc., China · Nanyang Technological University
DPS: Dual-Mode Precision LLM Serving with Semi-Unified Memory
Sep 28, 2026Xuan Truong Nguyen, Tien Son Pham, Tuan Duc Chu +2LLM Serving LLM Inference
Department of Next Generation Semiconductor Convergence and Open Sharing System (COSS), Seoul National University, Seoul 08826, South Korea · Van-Lang Institute of Semiconductor Technology (VIST), Hanoi, Vietnam · Efficient Computation Research Group, Moreh Vietnam +1
Positions Are Not Facts: The Mismatch Between KV Caches and Memory
Sep 27, 2026Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5Knowledge Editing Knowledge Conflicts in Language Models
Fudan University · Baidu · Zhejiang University +2
Grounding Memory Summarization in Utility Intent
Sep 27, 2026Zhenyu Lei, Mingjia Shi, Xingbo Fu +3Conversational Memory LLM Memory
University of Virginia · Northeastern University
LSTMem: Hierarchical Long Short-Term Online Memory for Large Language Models
Sep 27, 2026Xianglong Shi, Ruijie Yang, Sirui Zhao +4Memory-Augmented Language Models Persistent Memory for Language Models
University of Science and Technology of China
Complementary Roles of Activation and Parametric Memory in Few-Shot Learning
Sep 23, 2026Miaohe Niu, Runsong Zhao, Xinyu Liu +5LLM Memory Few-Shot Learning
Northeastern University, Shenyang, China · NiuTrans Research, Shenyang, China
SpeakerMem-R1: Speaker-Centered Dual-Track Memory for Multi-Party Dialogue
Sep 22, 2026Haobo Zheng, Tan Tang, Yan Chen +2Conversational Memory LLM Memory
State Key Lab of CAD&CG, Zhejiang University
The Cost of Compression: A Rate-Distortion Limit on Factual Hallucination
Sep 14, 2026Xi Wang, Shijia Xu, Rongfeng GuoMemorization in Language Models Hallucination in Language Models
Hefei Institutes of Physical Science, Chinese Academy of Sciences, China · University of Science and Technology of China, China · Chongqing University, China +1
Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
Sep 14, 2026MyungHoon Ryu, XinYu Piao, Jong-Kook KimLLM Memory Long-Context Modeling
Korea University South Korea
Pull: Lazy Materialization of Working Memory for Stateful LLM Conversations
Sep 13, 2026Jiangang ChenLLM Inference Efficiency LLM Memory
Chengdu Beiluoshimen Technology Co., Ltd.
What It Costs to Compose, Rebuild, and Correct Precomputed Memory
Aug 31, 2026Asa ShepardLLM Inference Efficiency Memory-Augmented Language Models
Department of Computer Science, Williams College
Mitigating Over-Personalization in LLMs via Structured Memory
Aug 8, 2026Hakeem Hannoon, Andrew Zhao, Mihir Narayan +2LLM Sycophancy Persistent Memory for Language Models
University of Saskatchewan · University of California–Irvine · University of Wisconsin–Madison +2
PsychoAgent: An Affect-Sensitive Cognitive Architecture for Conflict-Aware Memory in LLM Agents
Aug 7, 2026Mohammad Amanlou, Parham Abed Azad, Farbod Davoodi +3Cognitive Architectures for AI Agents LLM Agent Memory
School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran. · Department of Computer Engineering, Sharif University of Technology, Tehran, Iran. · Missouri University of Science and Technology, Rolla, MO, USA. +1
From Test-Time Scaling to Reusable Memory: Measuring Crystallization in Text-to-SQL
Aug 7, 2026Jiaqian Wang, Yutao Qi, Wenjin Hou +2LLM Memory Text-to-SQL
Xidian University · Xidian University Xi’an, Shaanxi, China · Shanghai Jiao Tong University +1
Runtime Observability for Heterogeneous Attention Memory
Aug 6, 2026Fanzhe Wei, Li Liu, Ziyang Wang +1KV Caching LLM Auditing
Metask Lab
LiveMem: Maintaining Memory State Continuity in Long-Running LLM Inference
Aug 3, 2026Zhichen Liu, Ruihan Sun, Hengjie Yang +4Memory-Augmented Language Models LLM Inference
Southern University of Science and Technology · Xidian University
V-Mem: Modality-Routed Retrieval for Long-Term Multimodal Agentic Memory
Aug 2, 2026Dingyi Kang, Dongming Jiang, Yi Li +2Multimodal IR Multimodal Memory
Department of Computer Science, The University of Texas at Dallas · Department of Electrical and Computer Engineering, University of Florida
$Σ$ -Mem: An Online Reliability Memory for LLM-based Multi-Agent Systems
Jul 30, 2026Peilin Feng, Suorong Yang, Soujanya PoriaAI Agent Reliability Multi-Agent LLM Systems
1DeCLaRe Lab, Nanyang Technological University
ForgetBench: Benchmarking Forgetting Dynamics of Long-Term Parametric Memory in Language Models
Jul 29, 2026Ruxi Gu, Zhenliang Zhang, Wei WangKnowledge Editing Continual Learning for LLMs
Department of Automation, University of Science and Technology of China, Hefei, China · State Key Laboratory of General Artificial Intelligence, BIGAI, Beijing, China · School of Computer and Communication Engineering, University of Science and Technology Beijing, Beijing, China.
Memory for Large Language Models
Jul 28, 2026Sining Zhoubian, Dan Zhang, Evgeny Kharlamov +1Memory-Augmented Language Models LLM Memory
Tsinghua University · National University of Singapore · Bosch AI
Eviction as Estimation: A Fixed-Lag Smoothing View of Test-Time Memory, and When Measuring Beats Accumulating
Jul 27, 2026Maruthi Vemula, Neeraj Praneeth GajulaKV Caching KV-Cache Eviction
University of North Carolina at Chapel Hill · New York University
From Observation to Intervention: Memory in Brains and Large Language Models
Jul 27, 2026Morteza Salehjahromi, Shayan A. Zadegan, Amgad Muneer +1LLM Memory
Department of Imaging Physics, The University of Texas MD Anderson Cancer Center, Houston, TX, USA · Department of Neurology, The University of Tennessee Health Science Center, Memphis, TN, USA · Department of Thoracic/Head and Neck Medical Oncology, The University of Texas MD Anderson Cancer Center, Houston, TX, USA +1
A Frozen 12B Beats Frontier Models on Verified Work: 100% Accuracy, 0 Tokens, Bit-Exact, Forever
Jul 26, 2026Sietse SchelpePersistent Memory for Language Models LLM Memory
Corbenic AI
Presentation, Not Mechanism: A Render Confound in Deprecation-Aware Memory Evaluation
Jul 17, 2026Zhaoyang Jiang, Zhizhong Fu, Zicheng Li +5LLM Memory Question Answering
School of Health & Wellbeing, University of Glasgow, Glasgow, UK · School of Life Science and Technology, University of Electronic Science and Technology of China, Chengdu, China · Institute of Health Informatics, University College London, London, UK +1
Creativity, honesty and designed forgetting emerge in small hyperbolic language models
Jul 10, 2026Kwan Soo Shin, In Seok Kang, Yunkyung MinLLM Sycophancy Memory-Augmented Language Models
PolymathMinds Lab, Seoul, Republic of Korea. · Department of Chemical Engineering, POSTECH, Pohang, and aSSIST University, Seoul, Republic of Korea. · Korean Educational Development Institute, Jincheon, Republic of Korea.
What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents
Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiRate-Distortion Theory LLM Memory
University of California, Irvine Irvine, California, USA
MemDefrag: Latent Memory Defragmentation for Large Language Models
Jul 7, 2026Ruiyi Yan, Zhuoyuan Mao, Yiwen GuoContinual Learning for LLMs Memory-Augmented Language Models
Kyoto University · LIGHTSPEED · Independent Researcher

Oct 5, 2026, cs.CLJ/K move · Enter open · S save

MemPilot: Orchestrating On-Demand Multimodal Memory Curation for LLM Agents

Haozhen Zhang, Haodong Yue, Quanyu Long, Jianzhu Bao+5

Nanyang Technological University · Tsinghua University · University of Illinois Urbana-Champaign

LLM Agent Memory LLM Memory Agent Memory Management RL for LLM Agents

Open paper AskPDF arXiv

Memory has become integral to the LLM agent ecosystem, supporting information retention and reuse across interactions. However, most existing agent memory systems construct memory in a query-agnostic manner, which can incur unnecessary preprocessing cost and discard details that later prove essential. Recent studies have begun shifting memory processing toward runtime adaptation, but typically specialize in particular operations or fixed processing schemes, leaving flexible control over performance, cost, and latency largely underexplored. To address this challenge, we present \textbf{MemPilot}, a flexible framework that orchestrates on-demand memory curation under different performance--cost--latency preferences. Specifically, we optimize a multi-step LLM policy via reinforcement learning to iteratively choose between retrieving from query-agnostic memory and delegating query-specific curation of raw multimodal history to heterogeneous LLMs and VLMs. The policy jointly controls evidence amount, curation instructions, model selection, and visual access, enabling fine-grained allocation of runtime computation. To optimize this policy under competing objectives, we adapt objective-wise advantage decoupling by separately estimating each objective's advantage before aggregation. Moreover, we introduce prefix-based marginal utility estimation for fine-grained credit assignment across multi-step rollouts. Experiments on five multimodal agent-memory benchmarks demonstrate favorable performance--cost--latency trade-offs across optimization preferences, with preference sweeps yielding broader frontiers than existing trade-off-aware baselines.

Momentum

Related topics

Latest papers 73