Overview

These benchmarks test whether agents can remember facts and experiences across sessions and use them to answer questions, personalize responses, or guide actions. They compare long-context prompting and retrieval-augmented generation with external memory such as summaries, profiles, timelines, and graphs, often in interactive, streaming, or multimodal settings. Tests increasingly probe temporal updates, conflicting evidence, forgetting, privacy, and the separate stages of memory formation, retrieval, and use, while also measuring cost and latency. Results show that no single approach works reliably across tasks: simple retrieval and long-context baselines remain competitive, and accurately retrieving information does not guarantee that an agent will recognize when it is relevant, current, or safe to use.

Latest papers

CardsList

164 papers42 papers in the last four weeks, up 100% on the four weeks before. 0.2% of all new papers.

  1. When Retrieval Is Not Enough: Obsolete Facts in Agent Memory

    Oct 26, 2026Oleeviya Babu Poikarayil, Tony Basil Babu, Abdulrahman Nahhas +4Agent MemoryMemory Consolidation for LLM Agents

  2. BehaviorMem: Building and Evaluating User Memory from Real-World E-Commerce Behavior Streams

    Oct 26, 2026Sizhe Wang, Xinghao Fang, Rui Qiu +4Agent MemoryMemory Agent Benchmarks

  3. The Right Fact, the Wrong Decision: SciValidityBench for Scientific Agent Memory

    Oct 26, 2026Yuexi Pan, Yongchao ChenScientific Agent BenchmarksMemory Agent Benchmarks

  4. Memory Tax: Dissecting the Net Value of Agent Memory

    Oct 25, 2026Xuan He, Sining Zhoubian, Ruozhen Yang +8LLM Agent MemoryLLM Memory

  5. Is Complex Agentic Memory Always Needed? Naive RAG Is Stronger Than We Thought

    Oct 22, 2026Zhengye Bao, Shengtao Zhang, Haokai Zhang +3Conversational QAMemory Management for LLM Agents

  6. Why Bother Me Again? Benchmarking Personal Agent Memory for Interaction Preferences

    Oct 21, 2026Jialin Li, Zhenhao Chen, Hanjun Luo +1Memory Agent BenchmarksPersonal AI Agents

  7. ProactEgoMem: Benchmarking Proactive Memory in Streaming Egocentric Video

    Oct 21, 2026Ruotong Liao, Meikel Kokowski, Xiaoxiao Sun +6Agent MemoryMemory Agent Benchmarks

  8. DuplexLedger: Benchmarking Transactional Memory in Full-Duplex Speech Agents

    Oct 20, 2026Yuxuan Li, Xiangchen Guan, Kunrong Li +7Memory Management for LLM AgentsMemory Agent Benchmarks

  9. MemDev-Bench: Does Memory Help Code Agents?Benchmarking Memory Systems over Real Repository Histories

    Oct 20, 2026Guorui Chen, Tao Liu, Zhenzhen Huang +9Memory Agent BenchmarksMemory-Augmented Agents

  10. MemDerive: A Diagnostic Benchmark for Agent Memory over Evolving Data

    Oct 18, 2026Sen Gao, Yongan Li, Han Chen +5Agent MemoryMemory Agent Benchmarks

  11. MemBubble: Benchmarking How Agent Memory Shapes LLM Response Diversity

    Oct 18, 2026Jiajun Tan, Fei Sun, Xinyu Ma +6LLM Agent MemoryOutput Diversity in Language Models

  12. Do Conversational Agents Need Explicit Memory? A Controlled Comparison with Raw-History Retrieval

    Oct 17, 2026Yongjie Zhou, Shuai Wang, Bevan Koopman +1LLM Agent MemoryLong-Term Conversational Memory

  13. HABIT-Bench: Evaluating Habit Induction from Longitudinal Weak Evidence in Agent Memory

    Oct 17, 2026Junming Zhang, Rubin Wei, Xu Cheng +7LLM Agent MemoryMemory Agent Benchmarks

  14. Can Agents Keep Secrets They Were Never Told? Benchmarking Latent Privacy Risks Across Sessions with MemJoin

    Oct 17, 2026Qishun Yang, Shu Yang, Difei Xu +2Memory Agent BenchmarksData Leakage

  15. Beyond Marginal Influence: Interaction-Aware Memory Selection for LLM Agents

    Oct 16, 2026BHVSP Subrahmanyam, Neeraj ChoudharyMemory Management for LLM AgentsMemory Agent Benchmarks

  16. Spatial Memory by Agents, for Agents

    Oct 15, 2026Qianwei Wang, Ce Zhang, Zhanpeng Luo +3Robotic Spatial MemoryAgent Memory

  17. MemoProAgent: Toward Memory-Driven Proactive Assistance

    Oct 15, 2026Shenglai Zeng, Xiao Yang, Tiffany Ma +15Proactive AgentsProactive Assistance

  18. Beyond Downstream QA: Rethinking How We Evaluate Agent Memory

    Oct 15, 2026Sebastian-Antonio Toma, Jean de Kernier, Mike Ply +1Agent MemoryLLM Agent Memory

  19. When Agent Memory Needs to Compute: Evidence Access and Executable Aggregation

    Oct 14, 2026Zerui Yang, Quan Xue, Chaorui Zhang +8Agent MemoryAgent Memory Management

  20. Can Agents Forget When Asked? A Benchmark for Memory Unlearning in LLM Agents

    Oct 13, 2026Bofan Xie, Chaokun Wang, Guanchen Ge +4LLM Agent MemoryMemory Agent Benchmarks

  21. Memory Echo in Single-Agent Long-Term Memory: Lifecycle Evaluation and Provenance-Guided Mitigation

    Oct 13, 2026Yufeng Li, Sheng Yao, Peng Zeng +5Agent Memory ManagementLong-Term Conversational Memory

  22. VitaBench: Memory Lifecycles Beyond Retrieval

    Oct 10, 2026Muquan Yu, Dihan HuMemory Agent BenchmarksAgent Memory Management

  23. MemForm: Benchmarking Memory Formation Poisoning in LLM Agents

    Oct 10, 2026Haowen Pan, Pengyang Shao, Yunshan Ma +4Agent Memory PoisoningPersistent Memory for Language Models

  24. What Should Embodied Agents Remember? Benchmarking and Evaluating Memory Modality for Embodied Agents

    Oct 8, 2026Junxiang Wang, Yuchen Liu, Yi Wu +6Long-Term Memory for Embodied AgentsAgent Memory

  25. MemoWM: How World Models Change What Agents Need to Remember

    Oct 7, 2026Bingfan Zeng, Zhisheng Chen, Chenbo Sang +6Memory CompressionAgent Memory Management

  26. DSV-Mem: Evaluating Multimodal Memory in Professional Workflows for MLLM Agents

    Oct 6, 2026Jike Zhong, Ritwick Chaudhry, Xuanbai Chen +4Multimodal MemoryMemory Agent Benchmarks