Self-Evolving Agents

Ask about this topic

Overview

Self-evolving agents are systems that use experience from task execution to change how they solve future tasks, rather than relying only on a fixed model or hand-designed workflow. Common approaches store and refine reusable skills or memories, optimize prompts and agent harnesses, train policies with reinforcement learning, or co-evolve task generators, environments, and teams of agents. These methods are tested in settings such as web and GUI use, coding, embodied robotics, scientific workflows, and reasoning benchmarks, with feedback ranging from execution outcomes to verifiers and paired validation. A central challenge is making improvements transfer to new tasks without forgetting earlier abilities or introducing unsafe behavior; reliable evaluation, update verification, and long-term monitoring remain open problems.

Latest papers

CardsList

427 papers104 papers in the last four weeks, up 148% on the four weeks before. 0.6% of all new papers.

  1. UI-Voyager: A Self-Evolving GUI Agent Learning via Failed Experience

    Mar 25, 2026Zichuan Lin, Feiyu Liu, Yijun Yang +9Mobile GUI AgentsLLM Agent Training

    Tencent Hunyuan

  2. Self-Evolving Multi-Agent Framework for Efficient Decision Making in Real-Time Strategy Scenarios

    Mar 25, 2026Li Ma, Hao Peng, Yiming Wang +6Game-Playing AgentsSelf-Evolving Agents

    School of Cyber Science and Technology, Beihang University, Beijing 100191, China · Naval Aviation University, Yantai 264001, China · Military Science Academy, Beijing 100091, China +3

  3. A Blueprint for Self-Evolving Coding Agents in Vehicle Aerodynamic Drag Prediction

    Mar 23, 2026Jinhui Ren, Huaiming Li, Yabin Liu +9Automotive AerodynamicsSurrogate Modeling

    Famou Agent Team, Baidu AI Cloud · IAT AI Team

  4. STEM Agent: A Self-Adapting, Tool-Enabled, Extensible Architecture for Multi-Protocol AI Agent Systems

    Mar 22, 2026Alfred Shen, Aaron ShenAgentic AISelf-Evolving Agents

  5. Hyperagents

    Mar 19, 2026Jenny Zhang, Bingchen Zhao, Wannan Yang +5Self-Improving AgentsRecursive Self-Improvement

    University of British Columbia · Vector Institute · University of Edinburgh +4

  6. AgentFactory: A Self-Evolving Framework Through Executable Subagent Accumulation and Reuse

    Mar 18, 2026Zhang Zhang, Shuqi Lu, Hongjin Qian +2Self-Evolving AgentsLLM Agent Skill Learning

    Peking University · Beijing Academy of Artificial Intelligence · Hong Kong Polytechnic University

  7. Universe Routing: Why Self-Evolving Agents Need Epistemic Control

    Mar 16, 2026Zhaohui Geoffrey WangSelf-Evolving AgentsLifelong Learning Agents

    USC Viterbi School of Engineering University of Southern California Los Angeles, CA 90089, USA

  8. Loosely-Structured Software: Engineering Context, Structure, and Evolution Entropy in Runtime-Rewired Multi-Agent Systems

    Mar 16, 2026Weihao Zhang, Yitong Zhou, Huanyu Qu +1Context EngineeringSoftware Engineering

    The Hong Kong University of Science and Technology, Hong Kong SAR, China · AI Chip Center for Emerging Smart Systems, Hong Kong SAR, China · University of Macau, Macau SAR, China +1

  9. MineEvolve: Self-Evolution with Accumulated Knowledge for Long-Horizon Embodied Minecraft Agents

    Mar 13, 2026Zhengwei Xie, Zhisheng Chen, Ziyan Weng +7Self-Evolving AgentsLong-Horizon Agent Tasks

    USTC · NTU · CityU-DG +4

  10. Emulating Clinician Cognition via Self-Evolving Deep Clinical Research

    Mar 11, 2026Ruiyang Ren, Yuhao Wang, Yunsen Liang +8Medical DiagnosisClinical Decision Support

    Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China. · Peking University Third Hospital, Beijing, China. · Baidu Inc., Beijing, China. +2

  11. Safe and Scalable Web Agent Learning via Recreated Websites

    Mar 11, 2026Hyungjoo Chae, Jungsoo Park, Alan RitterWeb AgentsLLM Agent Training

    School of Interactive Computing, Georgia Institute of Technology

  12. AutoAgent: Evolving Cognition and Elastic Memory Orchestration for Adaptive Agents

    Mar 10, 2026Xiaoxing Wang, Ning Liao, Shikun Wei +2Self-Evolving AgentsMemory-Augmented Language Model Agents

    MemTensor (Shanghai) Technology Co., Ltd. · Institute for Advanced Algorithms Research, Shanghai. · Shanghai Jiao Tong University

  13. EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

    Mar 9, 2026Yougang Lyu, Xi Zhang, Yuyue Zhao +11Multi-Agent LLM SystemsAI Agents for Scientific Discovery

    Huawei Technologies Co., Ltd. · Vrije Universiteit Amsterdam

  14. Evolving Medical Imaging Agents via Experience-driven Self-skill Discovery

    Mar 6, 2026Lin Fan, Pengyu Dai, Zhipeng Deng +4Self-Evolving AgentsLLM Agent Skill Learning

    Southwest Jiaotong University, China · The University of Tokyo, Japan · RIKEN, Japan +2

  15. Tool-Genesis: A Task-Driven Tool Creation Benchmark for Self-Evolving Language Agent

    Mar 5, 2026Bowei Xia, Mengkang Hu, Shijian Wang +5Tool-Using AgentsAI Agent Benchmarks

    UESTC · The University of Hong Kong · Xiaohongshu Inc.

  16. EvoTool: Self-Evolving Tool-Use Policy Optimization in LLM Agents via Blame-Aware Mutation and Diversity-Aware Selection

    Mar 5, 2026Shuo Yang, Soyeon Caren Han, Xueqi Ma +3Policy OptimizationLLM Agent Self-Improvement

    School of Computing and Information Systems, The University of Melbourne

  17. SEA-TS: Self-Evolving Agent for Autonomous Code Generation of Time Series Forecasting Algorithms

    Mar 5, 2026Longkun Xu, Xiaochun Zhang, Qiantu Tuo +1Time Series ForecastingCode Generation

    Ecoflow Inc.

  18. Preventing Curriculum Collapse in Self-Evolving Reasoning Systems

    Mar 3, 2026Vaibhav MishraMathematical Problem GenerationLanguage Model Self-Improvement

  19. EvoSkill: Automated Skill Discovery for Multi-Agent Systems

    Mar 3, 2026Salaheddin Alzubi, Noah Provenzano, Jaydon Bingham +2Agent Skill LearningLLM Agent Self-Improvement

    Sentient · Virginia Tech

  20. AutoSkill: Experience-Driven Lifelong Learning via Skill Self-Evolution

    Mar 1, 2026Yutao Yang, Junsong Li, Qianjun Pan +9LLM Agent Skill LearningLifelong Learning Agents

    School of Computer Science and Technology, East China Normal University · Shanghai AI Laboratory

  21. K^2-Agent: Co-Evolving Know-What and Know-How for Hierarchical Mobile Device Control

    Feb 28, 2026Zhe Wu, Donglin Mo, Hongjin Lu +7LLM Agent Skill LearningRL for GUI Agents

    Department of Computer Science and Technology, Tsinghua University · Huawei Noah’s Ark Lab · Institute of Automation, Chinese Academy of Sciences

  22. Agentic AI-RAN: Enabling Intent-Driven, Explainable and Self-Evolving Open RAN Intelligence

    Feb 27, 2026Zhizhou He, Yang Luo, Xinkai Liu +4Network SlicingWireless Communications

    5G/6GIC, Institute for Communication Systems (ICS), University of Surrey, Guildford, UK · 6G Research Center, Khalifa University, Abu Dhabi, UAE

  23. Tool-R0: Self-Evolving LLM Agents for Tool-Learning from Zero Data

    Feb 24, 2026Emre Can Acikgoz, Cheng Qian, Jonas Hübotter +3LLM Agent TrainingSelf-Evolving Agents

    UIUC · ETH Zurich

  24. PEPA: a Persistently Autonomous Embodied Agent with Personalities

    Feb 21, 2026Kaige Liu, Yang Li, Lijun Zhu +1Cognitive Architectures for AI AgentsEmbodied AI

    School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China, and also with Shanghai Innovation Institute, Shanghai 200231, China · School of Computer Science, Shanghai Jiao Tong University, Shanghai 200240, China · School of Artificial Intelligence and Automation, Huazhong University of Science and Technology, Wuhan 430074, China, and also with the State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan 430074, China +1

  25. Learning Beyond Optimization: Stress-Gated Dynamical Regime Regulation in Autonomous Systems

    Feb 20, 2026Sheng RanAdaptive LearningSelf-Evolving Agents

    Department of Physics, Washington University in St. Louis, St. Louis, MO 63130, USA · Reconstructing Future Research Initiative

  26. EvoDesign: Agentic Editable Diagram Creation via Design Expertise Evolution

    Feb 20, 2026Tianfu Wang, Leilei Ding, Ziyang Tao +12Self-Evolving Agents

    Hong Kong University of Science and Technology (Guangzhou) · University of Science and Technology of China · Peking University +1

  27. OpenSage: Self-programming Agent Generation Engine

    Feb 18, 2026Hongwei Li, Zhun Wang, Qinrun Dai +11LLM Agent OrchestrationSelf-Evolving Agents

    UC Santa Barbara · UC Berkeley · University of Colorado Boulder +4

  28. Zombie Agents: Persistent Control of Self-Evolving LLM Agents via Self-Reinforcing Injections

    Feb 17, 2026Xianglin Yang, Yufei He, Shuo Ji +2Prompt Injection Attacks on AI AgentsAgent Memory Poisoning

    School of Computing National University of Singapore

  29. ST-EVO: Towards Generative Spatio-Temporal Evolution of Multi-Agent Communication Topologies

    Feb 16, 2026Xingjian Wu, Xvyuan Liu, Junkai Lu +6Multi-Agent Communication TopologyMulti-Agent LLM Systems

    East China Normal University

  30. Survival is the Only Reward: Sustainable Self-Training Through Environment-Mediated Selection

    Jan 18, 2026Jennifer Dodgson, Alfath Daryl Alhajir, Michael Joedhitya +6Self-TrainingSelf-Improving Agents