cs.AINov 17, 2026

EvoDisco: Strategy Discovery for Evolving Agent Memory

Authors: Mingyang Liu, Qingcan Kang, Shixiong Kai, Kaichao Liang, Xiaojin Fu, Tao Zhong, Linqi Song

Organizations: City University of Hong Kong · Huawei Technologies Ltd.

Abstract

Large language model agents accumulate experience in memory, and how that memory evolves during interaction is as important as what it stores. Recent methods update memory online, yet both the operators that transform memory and the rules that select them remain fixed by design. We propose EvoDisco, which formulates agent memory evolution as evolutionary strategy discovery: the agent must discover which operator to apply, when to apply it, and how to instantiate it, rather than rewriting memory under a static operator schedule. A learnable policy conditions on the current memory state and recent task history, then selects and instantiates one of four semantic operators---Abstract, Refine, Bridge, and Reframe---which respectively compress related memories, decompose overloaded entries, connect weakly linked experiences, and reorganize retrieved reasoning chains. The policy is updated with a bi-level fitness. An inner signal scores each transformation using a retrieval-quality improvement regularized by memory complexity. An outer signal scores strategic efficacy over a window of past decisions, combining historical operator-utility regret, utility-prediction error, and selection diversity. Under a one-pass online plus frozen-transfer protocol on ALFWorld, WebShop, and LifelongAgentBench (OS and DB), EvoDisco improves over strong memory baselines including MemP and MemRL. The largest gains are on ALFWorld (+8.8+8.8 online / +12.9+12.9 frozen-transfer points over MemP; +16.4+16.4 / +17.9+17.9 over MemRL). Ablations attribute these gains to both fitness levels and the operator library.

Figures & tables

Appendix figures & tables10 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. OPD-Evolver: Cultivating Holistic Agent Evolver via On-Policy Distillation

    Jun 16, 2026Guibin Zhang, Xun Xu, Yanwei Yue +4LLM Agent MemoryMemory-Augmented Agents

  2. MemSkill: Learning and Evolving Memory Skills for Self-Evolving Agents

    Feb 2, 2026Haozhen Zhang, Quanyu Long, Jianzhu Bao +4Memory Management for LLM AgentsMemory Consolidation for LLM Agents

  3. From Reflection to Co-Evolution: Self-Evolving Agents with Locally Verified Memory

    Nov 7, 2026Xinxiang Yin, Xinglang Zhang, Haodong Chen +7Memory Management for LLM AgentsExperience Learning for LLM Agents