Memory Agent Benchmarks

Follow this topic Ask about this topic

Momentum

16 papers in the last four weeks, up 167% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 90

All topics

StreamMemBench: Streaming Evaluation of Agent Memory for Future-Oriented Assistance
Jun 12, 2026Guanming Liu, Yuqi Ren, Hansu Gu +5Agent Memory Long-Horizon Agent Evaluation
1Fudan University · 2Amazon
M $^3$ Exam: Benchmarking Multimodal Memory for Realistic User-Agent Interactions
Jun 5, 2026Zhengjun Huang, Wenxuan Liu, Zhoujin Tian +6Multimodal Grounding Efficient Multimodal Inference
The Hong Kong University of Science and Technology · Peng Cheng Laboratory · Beijing University of Chemical Technology +4
Less Context, More Accuracy: A Bi-Temporal Memory Engine for LLM Agents Where a Lean Retrieved Context Beats the Full History
Jun 5, 2026Liuyin WangLong-Context QA LLM Agent Memory
Independent Researcher
SubtleMemory: A Benchmark for Fine-Grained Relational Memory Discrimination in Long-Horizon AI Agents
Jun 4, 2026Wenxuan Wang, Haoyu Sun, Fukuan Hou +4Persistent Memory for Language Models Long-Horizon Agent Evaluation
Harbin Institute of Technology · Shanghai AI Laboratory · Tongji University +4
LifeSide: Benchmarking Agents as Lifelong Digital Companions
Jun 3, 2026Yuqian Wu, Zhijie Deng, Wei Chen +8Long-Horizon Agent Evaluation AI Companions
Hong Kong University of Science and Technology (Guangzhou) · Tencent · Hong Kong University of Science and Technology
eMEM: A Hybrid Spatio-Temporal Memory System For Embodied Agents
Jun 2, 2026A. Haroon Rasheed, Maria KabtoulLLM Agent Memory Memory Agent Benchmarks
MIND · Automatika Robotics Inria, France · CHROMA
Momento: Evaluating Persistent Memory and Reasoning with Multi-Session Agentic Conversations
May 30, 2026Adril Putra Merin, David Anugraha, Ayu Purwarianti +1Agent Memory Temporal Reasoning
Institut Teknologi Bandung · Stanford University · Capital One
EGOSTREAM: A Diagnostic Benchmark for Streaming Episodic Memory in Egocentric Vision
May 29, 2026Rosario Forte, Giuseppe Lando, Antonino FurnariVLM Evaluation Streaming Video Understanding
Department of Mathematics and Computer Science University of Catania
Selective QA over Conflicting Multi-Source Personal Memory: A Diagnostic Testbed and Method Comparison
May 28, 2026Tiancheng Yang, Matthias Schonlau, Ilia SucholutskyConversational Memory Question Answering
Entity-Collision: A Stratified Protocol for Attributing Retrieval Lift in Agent Memory
May 28, 2026Youwang DengAgent Memory Text Embedding Evaluation
Independent Researcher
WorldMemArena: Evaluating Multimodal Agent Memory Through Action-World Interaction
May 28, 2026Chengzhi Liu, Yuzhe Yang, Sophia Xiao Pu +14Multimodal Memory LLM Agent Memory
University of California, Santa Barbara · Johns Hopkins University · Carnegie Mellon University +3
MemFail: Stress-Testing Failure Modes of LLM Memory Systems
May 26, 2026Ishir Garg, Neel Kolhe, Dawn Song +1LLM Agent Memory LLM Memory
University of California, Berkeley
Personalize-then-Store: Benchmarking and Learning Personalized Memory for Long-horizon Agents
May 25, 2026Yeonjun In, Wonjoong Kim, Sangwu Park +2Memorization in Language Models Persistent Memory for Language Models
KAIST
MemGym: a Long-Horizon Memory Environment for LLM Agents
May 20, 2026Wujiang Xu, Yu Wang, Kai Mei +8LLM Agent Memory LLM Agent Evaluation
1Rutgers University · 2Capital One · 3Princeton University +1
MINTEval: Evaluating Memory under Multi-Target Interference in Long-Horizon Agent Systems
May 18, 2026Hyunji Lee, Justin Chih-Yao Chen, Joykirat Singh +3Agent Memory Long-Horizon Agent Evaluation
UNC Chapel Hill · The University of Texas at Austin
EvoMemBench: Benchmarking Agent Memory from a Self-Evolving Perspective
May 18, 2026Yuyao Wang, Zhongjian Zhang, Mo Chi +7LLM Agent Memory LLM Agent Evaluation
Hong Kong University of Science and Technology (Guangzhou) · Beijing University of Posts and Telecommunications · Beijing Institute of Technology +1
SocialMemBench: Are AI Memory Systems Ready for Social Group Settings?
May 18, 2026Olukunle OwolabiAgent Memory Conversational Memory
Independent Researcher
GroupMemBench: Benchmarking LLM Agent Memory in Multi-Party Conversations
May 14, 2026Jingbo Yang, Kwei-Herng Lai, Xiaowen Wang +3Conversational Memory LLM Agent Evaluation
UC Santa Barbara · Microsoft
LongMemEval-V2: Evaluating Long-Term Agent Memory Toward Experienced Colleagues
May 12, 2026Di Wu, Zixiang Ji, Asmi Kawatkar +4Computer-Use Agent Benchmarks Retrieval-Augmented Generation
University of California, Los Angeles
MEME: Multi-entity & Evolving Memory Evaluation
May 12, 2026Seokwon Jung, Alexander Rubinstein, Arnas Uselis +2Agent Memory Persistent Memory for Language Models
1KAIST AI · 2Tübingen AI Center, University of Tübingen · 3NAVER AI Lab
MedMemoryBench: Benchmarking Agent Memory in Personalized Healthcare
May 12, 2026Yihao Wang, Haoran Xu, Renjie Gu +10Agent Memory Healthcare
Zhejiang University · Ant Group · Alibaba Group +1
Structured Belief State and the First Precision-Aware Benchmark for LLM Memory Retrieval
May 11, 2026Jeffrey FlyntConversational Memory LLM Memory
Independent Researcher
When Stored Evidence Stops Being Usable: Scale-Conditioned Evaluation of Agent Memory
May 8, 2026Jiaqi Shao, Yiyi Lu, Yunzhen Zhang +1Agent Memory AI Agent Evaluation
Hong Kong University of Science and Technology, Hong Kong · Duke Kunshan University, China
STALE: Can LLM Agents Know When Their Memories Are No Longer Valid?
May 7, 2026Hanxiang Chao, Yihan Bai, Rui Sheng +2Agent Memory LLM Agent Evaluation
Wuhan University1, Wuhan, China1 · The Hong Kong University of Science and Technology3, Hong Kong, China23 · The Chinese University of Hong Kong2, Hong Kong, China23
Trojan Hippo Bench: A Dynamic Benchmark for Persistent Memory Attacks and Defenses in LLM Agents
May 3, 2026Debeshee Das, Julien Piet, Darya Kaviani +3LLM Agent Security AI Agent Security Benchmarks
ETH Zürich · UC Berkeley · Snyk
EngramaBench: Evaluating Long-Term Conversational Memory with Structured Graph Retrieval
Apr 23, 2026Julian AcunaLLM Evaluation Memorization in Language Models
From Recall to Forgetting: Benchmarking Long-Term Memory for Personalized Agents
Apr 21, 2026Md Nayem Uddin, Kumar Shubham, Eduardo Blanco +2Long-Horizon Agent Evaluation AI Agent Benchmarks
Arizona State University · Genies · University of Arizona
Evaluating Memory Structure in LLM Agents
Feb 11, 2026Alina Shutova, Alexandra Olenina, Ivan Vinogradov +1LLM Agent Memory LLM Agent Evaluation
HSE University · Yandex · YSDA +1
EMemBench: Interactive Benchmarking of Episodic Memory for VLM Agents
Jan 23, 2026Xinze Li, Ziyue Zhu, Siyuan Liu +4Episodic Memory Long-Horizon Agent Evaluation
Nanyang Technological University · Shanghai AI Laboratory · Fudan University
Evaluating Memory in LLM Agents via Incremental Multi-Turn Interactions
Jul 7, 2025Yuanzhe Hu, Yu Wang, Julian McAuleyLLM Agent Memory LLM Agent Evaluation
University of California, San Diego

Jun 12, 2026, cs.AIJ/K move · Enter open · S save

StreamMemBench: Streaming Evaluation of Agent Memory for Future-Oriented Assistance

Guanming Liu, Yuqi Ren, Hansu Gu, Peng Zhang+4

1Fudan University · 2Amazon

Agent Memory Long-Horizon Agent Evaluation AI Agent Benchmarks Memory Agent Benchmarks Agent Benchmarks

Open paper AskPDF arXiv

A central role of personal-agent memory is to turn stored information and prior interactions into future-oriented assistance. In daily use, useful cues come from what the agent observes and how the user interacts with the agent, and the agent must carry them forward from the current request to similar future tasks. Existing memory benchmarks usually test dialogue recall or task improvement in isolation, leaving the trajectory from streaming observations to later assistance largely untested. We introduce StreamMemBench, a streaming benchmark that constructs a two-step task sequence around each evidence anchor from EgoLife egocentric streams. The initial task tests evidence use, while the follow-up task tests whether feedback and interaction experience are reused. Four metrics diagnose evidence recall, initial evidence use, feedback incorporation, and follow-up reuse. Experiments with eight memory systems across two backbones show that current systems often fail to use observed evidence or turn feedback into reliable follow-up behavior, even when evidence is stored or feedback is incorporated locally. StreamMemBench is publicly available at https://github.com/landian60/StreamMemBench.

Momentum

Related topics

Latest papers 90