cs.CLNov 4, 2026

Twists and Turns: A Graph-Based Benchmark and Framework for Long-Term Memory in Exploration Tasks

Authors: Chongyuan Dai, Yaling Shen, Zirui Song, Junfeng Liao, Jinpeng Hu, Xiuying Chen

Organizations: Mohamed bin Zayed University of Artificial Intelligence (MBZUAI) · Monash University · Hefei University of Technology

Abstract

Long-term problem-solving processes, such as scientific research and software development, proceed along an evolving trial-and-error trajectory toward a central goal. We term these exploration tasks, which require models to remember not only facts but also how solutions are tested against intermediate outcomes and early attempts are continually revised or revived. However, existing long-term memory research focuses on factual recall and updates, overlooking the interconnected nature of exploration. We observe that exploration processes naturally form graphs, with branching approaches linked by revisions and reconsiderations. Motivated by this, we propose LExMem, a graph-guided benchmark designed to evaluate Memory in Long-term Exploration tasks. We model exploration processes as graphs and introduce an evolutionary mechanism to increase their structural complexity, yielding 224 dialogues and 2,018 question-answer instances derived from graph structures. Building on the same insight, we propose LExGraph, a graph-based memory framework that incrementally organizes dialogues into interconnected memory nodes and retrieves evidence through hybrid retrieval and neighbor expansion. Extensive experiments demonstrate that LExMem poses a significant challenge to existing retrieval- and memory-based systems, whereas LExGraph achieves superior performance and generalizes effectively to external benchmarks. Codes and datasets are available at https://github.com/mbzuai-nlp/LExMem.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Selective Forgetting: A Graph-Based Memory Framework for Long-Term LLM Agents

    Aug 29, 2026Theo Rusu, Sourena Khanzadeh, Manar AlalfiGraph-Based Agent MemoryLong-Term Conversational Memory

  2. REAL: A Reasoning-Enhanced Graph Framework for Long-Term Memory Management of LLMs

    Jun 9, 2026Keer Lu, Liwei Chen, Guoqing Jiang +3Conversational MemoryPersistent Memory for Language Models