cs.AIOct 3, 2026

Principles that Guide, Actions that Inform: Agent Evolution via Knowledge Abstraction

Authors: Bowen Ye, Yongchao Xu, Junkai Ma, Xiang Yin, Wenzhao Li

Abstract

Large language model (LLM) agents have demonstrated strong capabilities in interactive environments, yet their ability to continually evolve from experience remains limited. Although fine-tuning enables adaptation, its dependence on parameter access and high computational costs restrict its flexibility, especially for large-scale and closed-source LLMs. External memory offers an alternative by allowing agents to accumulate experience without modifying model parameters. However, existing methods mainly focus on experience representation and organization, while the acquired knowledge remains tightly coupled with specific tasks and contexts, limiting generalization. A key challenge is how to transform concrete interactions into abstract and reusable knowledge that guides future decisions beyond individual experiences. To address this challenge, we propose SAGA (\underline{\textbf{S}}elf-evolving \underline{\textbf{A}}gents through Experience-\underline{\textbf{G}}rounded \underline{\textbf{A}}bstraction), a framework for experience-grounded knowledge abstraction and utilization in LLM agents. SAGA progressively transforms interaction trajectories into episodic descriptions, reusable procedures, and principles with explicit applicability conditions, while maintaining links to execution evidence. Retrieved principles are instantiated into task-specific guidance and used to refine candidate actions through corrective feedback and resampling. This creates an execution--abstraction feedback loop, where accumulated knowledge guides future interactions and new experiences continuously update hierarchical memory. Experiments on ScienceWorld and ALFWorld demonstrate improved task performance, with ablation studies highlighting the importance of contextual instantiation and action regulation for leveraging principle-level knowledge.

Explore similar work

CardsList
  1. Use and Disuse: Intent-Structured Experience Consolidation for Memory and Learning in LLM Agents

    Oct 8, 2026Xiangyi Zeng, Baihang Liu, Xutong Wang +3Memory-Augmented Language Model AgentsContinual Learning for LLM Agents

  2. Role-Agent: Bootstrapping LLM Agents via Dual-Role Evolution

    Jun 9, 2026Xucong Wang, Ziyu Ma, Shidong Yang +4LLM Agent Self-ImprovementLLM Agent Training

  3. MetaEvo: A Meta-Optimization Framework for Experience-Driven Agent Evolution

    May 29, 2026Bowen Ren, Heyan Huang, Yinghao Li +1Continual Learning for LLM AgentsLLM Agent Self-Improvement