Overview

These benchmarks test whether agents can remember facts and experiences across sessions and use them to answer questions, personalize responses, or guide actions. They compare long-context prompting and retrieval-augmented generation with external memory such as summaries, profiles, timelines, and graphs, often in interactive, streaming, or multimodal settings. Tests increasingly probe temporal updates, conflicting evidence, forgetting, privacy, and the separate stages of memory formation, retrieval, and use, while also measuring cost and latency. Results show that no single approach works reliably across tasks: simple retrieval and long-context baselines remain competitive, and accurately retrieving information does not guarantee that an agent will recognize when it is relevant, current, or safe to use.

Latest papers

CardsList

183 papers26 papers in the last four weeks, down 43% on the four weeks before. 0.2% of all new papers.

  1. Evaluating Memory Structure in LLM Agents

    Feb 11, 2026Alina Shutova, Alexandra Olenina, Ivan Vinogradov +1LLM Agent MemoryLLM Agent Evaluation

  2. EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agents

    Jan 23, 2026Xinze Li, Ziyue Zhu, Siyuan Liu +4Episodic MemoryLong-Horizon Agent Evaluation

  3. Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions

    Jul 7, 2025Yuanzhe Hu, Yu Wang, Julian McAuleyLLM Agent MemoryLLM Agent Evaluation