cs.CLNov 18, 2026

Forget Freely, Grep Later: Lossless, Index-Free Memory for Long-Horizon LLM Agents

Authors: Ziyan Yang, Taiwei Shi, Jieyu Zhao

Organizations: University of Southern California

Abstract

Long-horizon LLM agents often exceed their context windows, forcing them to discard information that may be needed later. Existing context management strategies rely on summarization, masking, or structured memory, requiring decisions about what to preserve or how to retrieve it before future needs are known. However, these methods can introduce lossy compression, potentially discarding details needed for future tasks. To address this limitation, we introduce GrepMem, a simple, lossless, and index-free memory mechanism built on two components: an append-only plain-text log of the agent's complete history and a regular-expression search tool for on-demand recall. Unlike structured memory systems, GrepMem requires no embeddings, retrieval index, memory extraction, or additional models. We train Qwen3.5-9B with reinforcement learning under five context management strategies and evaluate on multi-question research sessions, long-stream recall, and agent-trajectory question answering. GrepMem achieves 95-97% accuracy on ContextBench, versus at most 21% for lossy baselines, and outperforms SUPO's summarization by 8.8 percentage points on BCP-Multi. GrepMem scales effectively to increasingly long input streams while remaining on the accuracy-token-cost Pareto frontier across all five evaluation tasks. Our results show that a plain-text log and grep provide a simple but competitive approach to long-horizon agent memory, without requiring complex structured memory infrastructure.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Memex(RL): Scaling Long-Horizon LLM Agents via Indexed Experience Memory

    Mar 4, 2026Zhenting Wang, Huancheng Chen, Jiayun Wang +1LLM Agent MemoryMemory Management for LLM Agents

  2. MemTrain: Self-Supervised Context Memory Training

    Jun 2, 2026Ziheng Li, Xingrun Xing, Haoqing Wang +2LLM Agent MemoryPersistent Memory for Language Models

  3. MEMENTO: Learning Context Management for Long Context Processing Agents

    Oct 30, 2026Yunfan Zhang, Taehoon Hwang, Kathleen McKeown +1LLM Context ManagementContext Compaction for LLM Agents