cs.AIMar 8, 2026

Memory for Autonomous LLM Agents:Mechanisms, Evaluation, and Emerging Frontiers

Authors: Pengfei Du

Organizations: Hong Kong Research Institute of Technology, HongKong, China

Abstract

Large language model (LLM) agents increasingly operate in settings where a single context window is far too small to capture what has happened, what was learned, and what should not be repeated. Memory -- the ability to persist, organize, and selectively recall information across interactions -- is what turns a stateless text generator into a genuinely adaptive agent. This survey offers a structured account of how memory is designed, implemented, and evaluated in modern LLM-based agents, covering work from 2022 through early 2026. We formalize agent memory as a write--manage--read loop tightly coupled with perception and action, then introduce a three-dimensional taxonomy spanning temporal scope, representational substrate, and control policy. Five mechanism families are examined in depth: context-resident compression, retrieval-augmented stores, reflective self-improvement, hierarchical virtual context, and policy-learned management. On the evaluation side, we trace the shift from static recall benchmarks to multi-session agentic tests that interleave memory with decision-making, analyzing four recent benchmarks that expose stubborn gaps in current systems. We also survey applications where memory is the differentiating factor -- personal assistants, coding agents, open-world games, scientific reasoning, and multi-agent teamwork -- and address the engineering realities of write-path filtering, contradiction handling, latency budgets, and privacy governance. The paper closes with open challenges: continual consolidation, causally grounded retrieval, trustworthy reflection, learned forgetting, and multimodal embodied memory.

Figures & tables

Explore similar work

CardsList
  1. EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective

    May 18, 2026Yuyao Wang, Zhongjian Zhang, Mo Chi +7LLM Agent MemoryLLM Agent Evaluation

  2. Memory as a Controlled Process: Learned Adaptive Memory Management for LLM Agents

    Jul 15, 2026Eric Hanchen Jiang, Zhi Zhang, Yuchen Wu +11Persistent Memory for Language ModelsAgent Memory Management

  3. Anatomy of Agentic Memory: Taxonomy and Empirical Analysis of Evaluation and System Limitations

    Feb 22, 2026Dongming Jiang, Yi Li, Songtao Wei +8Agent MemoryAgent Memory Management