Overview

Self-evolving agents are systems that use experience from task execution to change how they solve future tasks, rather than relying only on a fixed model or hand-designed workflow. Common approaches store and refine reusable skills or memories, optimize prompts and agent harnesses, train policies with reinforcement learning, or co-evolve task generators, environments, and teams of agents. These methods are tested in settings such as web and GUI use, coding, embodied robotics, scientific workflows, and reasoning benchmarks, with feedback ranging from execution outcomes to verifiers and paired validation. A central challenge is making improvements transfer to new tasks without forgetting earlier abilities or introducing unsafe behavior; reliable evaluation, update verification, and long-term monitoring remain open problems.

Latest papers

CardsList

451 papers45 papers in the last four weeks, down 55% on the four weeks before. 0.3% of all new papers.

  1. Skill-V: Verifiable Self-Evolving Skill Library for Interactive Agents

    Oct 8, 2026Jie Ma, Zhipeng Qian, Yufei Ma +6LLM Agent Skill LearningLLM Agent Skill Retrieval

  2. SynCo: Data Synthesis Co-Training for Self-Evolving LLMs via Multi-Agent Reinforcement Learning

    Oct 8, 2026Wei Yang, Shawn Li, Yuehan Qin +8Self-Evolving AgentsSynthetic Data Generation for Language Models

  3. EvoSim: Learning to Model, Modeling to Learn

    Oct 8, 2026Yun-Wei Song, Jinkai Tao, Jun-Dong Zhang +3Autonomous Scientific DiscoveryPhysics-Based Simulation

  4. EmbodiedRSI: Active Continual Robot Learning Through Hypothesis-Guided Co-Evolution

    Oct 7, 2026Python Song, Zhixuan Liang, Kelsey Fu +3Continual Robot LearningRobot Skill Learning

  5. SkillSandbox: Skill Verification via Dynamic Scenario Synthesis

    Oct 7, 2026Serin Kim, Kwangwook Seo, Dokyung Song +2Agent Skill LearningSelf-Evolving Agents

  6. Self-Evolve With a Reference:Anchored Training of Tool-Integrated Agents

    Oct 7, 2026Wenjie Liao, Liangjie Zhao, Zehong CaoLLM Agent Self-ImprovementSelf-Evolving Agents

  7. RLDISCOVER: LLM-driven co-evolution of reinforcement learning algorithms

    Oct 6, 2026Haoran Li, Zengle Ge, Xiaomin Yuan +14Automated Algorithm DiscoveryEvolutionary RL

  8. FreeEvolve: Learning to Evolve Beyond Fixed Loops

    Oct 6, 2026Lecheng Kong, Like Hui, Nikos Kanakaris +3Self-Evolving AgentsLLM Agent Self-Improvement

  9. PhysEvo: Astra Can Act, Let It

    Oct 6, 2026Wenqing Tian, Zeyu Zhang, Zhaocheng Liu +3Self-Evolving AgentsRobot Policy Adaptation

  10. ScienceClaw: Benchmarking Continual Self-Evolution of AI-for-Science Agents Across the Natural and Social Sciences

    Oct 6, 2026Mingda Zhang, Wenjin Liu, Tiesunlong Shen +6Scientific Agent BenchmarksSelf-Evolving Agents

  11. EMHO: EMbodied Agent Harness Optimization via Experience Traces

    Oct 6, 2026Hyun Jung Lee, Jungtaek Kim, Jongwon Jeong +3Agent Harness OptimizationEmbodied AI

  12. MedZERO: Self-Evolving Agents for Open-Ended Medical Reasoning Through Controlled Knowledge Accumulation

    Oct 6, 2026Xilin Dang, Weilin Ruan, Xue Yang +4Self-Evolving AgentsMedical LLMs

  13. Capability-Driven Self-Evolution of Agent Memory

    Oct 5, 2026Yaoqi Chen, Yuru Feng, Qianxi Zhang +8Agent MemorySelf-Evolving Agents

  14. VERA: Scaling Verifiable Environments for Agentic co-Evolution

    Oct 5, 2026Junqi Liu, Yongyang Pan, Zhuosong Jiang +14Reinforcement Learning with Verifiable RewardsLong-Horizon LLM Agents

  15. Communication Shapes Collective Inference in Self-Adapting LLM Societies: Evidence from Mafia

    Oct 4, 2026Haonan Huang, Joey XiaoImperfect-Information GamesSocial Deduction Games

  16. Principles that Guide, Actions that Inform: Agent Evolution via Knowledge Abstraction

    Oct 3, 2026Bowen Ye, Yongchao Xu, Junkai Ma +2LLM AgentsSelf-Evolving Agents

  17. TRIZa\mathrm{TRIZ}^{a}: Guiding Agent Evolution from Pattern Recognition to Solution Invention

    Oct 3, 2026Wenyin Liu, Yiheng Huang, Kai WangAutomated Algorithm DiscoverySelf-Evolving Agents

  18. Evolutionary Computation for Trustworthy AI: From Attacks and Defenses to Self-Evolving Era

    Oct 2, 2026Junhao Dong, Chenkai Wang, Xuanhui Lin +8Trust in AIAI Agent Safety

  19. Self-Evolving Coding Rules for AI Coding Agents

    Sep 30, 2026Zhengyuan Jiang, Reachal Wang, Yuepeng Hu +3Evolutionary OptimizationCoding Agents

  20. Do Self-Evolving Skills Generalize to Held-Out Tasks?

    Sep 30, 2026Xihao Piao, Zifeng Wang, Zhen ChenAgent Skill LearningSelf-Evolving Agents

  21. False Frontiers: Diagnosing and Mitigating Co-Cheating in Self-Evolving Search Agents

    Sep 30, 2026Meijia Chen, Hao Li, Zheng Lu +12Cross-FittingAgentic Search

  22. STRATA: Self-Learning Through Role-Aligned Tiered Agents for Real-Time Strategy Games

    Sep 30, 2026Xinhe Tian, Xiaoyue Zhang, Ziyou Zhang +4Multi-Agent CoordinationGame-Playing Agents

  23. Self-Evolving Algorithm-Design Agents: Escaping In-Context Evolutionary Stagnation via Population-Curated Policy Optimization

    Sep 30, 2026Chen Lu, Ke Xue, Siyuan Xu +2Automated Algorithm DiscoveryLarge Language Model-Guided Optimization

  24. EvoSteer: Online Self-Evolving Graph Orchestration via Reference-Anchored Credit Assignment

    Sep 29, 2026Mingda Zhang, Hanwen Zhang, Qiang Huang +5Multi-Agent OrchestrationAgent Skill Learning

  25. Authorization for Self-Modifying AI Agent Populations: Conserving Authority across Replacement, Forking, and Rollback

    Sep 29, 2026Genliang Zhu, Chu WangAI Agent SecurityRuntime Enforcement for AI Agents