Overview

Self-evolving agents are systems that use experience from task execution to change how they solve future tasks, rather than relying only on a fixed model or hand-designed workflow. Common approaches store and refine reusable skills or memories, optimize prompts and agent harnesses, train policies with reinforcement learning, or co-evolve task generators, environments, and teams of agents. These methods are tested in settings such as web and GUI use, coding, embodied robotics, scientific workflows, and reasoning benchmarks, with feedback ranging from execution outcomes to verifiers and paired validation. A central challenge is making improvements transfer to new tasks without forgetting earlier abilities or introducing unsafe behavior; reliable evaluation, update verification, and long-term monitoring remain open problems.

Latest papers

CardsList

451 papers45 papers in the last four weeks, down 55% on the four weeks before. 0.3% of all new papers.

  1. MetaShare: Failure-Aware Collective Self-Improvement for Open-Ended Agents

    Oct 15, 2026Vishal Bhutani, Prasang Gupta, Sumanth Chundru +1Self-Improving AgentsSelf-Evolving Agents

  2. RSIFlow: Adaptive Self-Improvement Workflows with an Evolving Meta-Agent

    Oct 15, 2026Huan Zhang, Mingju Chen, Dongxu Zhou +4LLM Agent Self-ImprovementSelf-Evolving Agents

  3. MemScope: Evolving Agent Memory Architectures through Localized Code Repair

    Oct 15, 2026Miao Su, Yucan Guo, Zixuan Li +4LLM Agent MemorySelf-Evolving Agents

  4. EvolvingBrain: An Adaptive Skill System for Multi-modal Agents Self-Evolution in Open Worlds

    Oct 14, 2026Runxuan Liu, Jingqi Shi, Baoxin Wang +10Self-Evolving AgentsAgent Skill Learning

  5. SwarmRSI: Recursive Self-Improvement through Evolving Scientific Agent Swarm

    Oct 14, 2026Qianru Meng, Xi Zhang, Konstantinos Papakostas +9AI Agents for Scientific DiscoveryRecursive Self-Improvement

  6. Reflect After Failure: Brain-Inspired Self-Evolving Agents for Embodied Spatial Intelligence

    Oct 14, 2026Xin Li, Xiaohuan Gu, Yifan Wang +6Embodied Spatial ReasoningSelf-Evolving Agents

  7. When Non-Adversarial Noise Hurts Learning: Benchmarking Skill Self-Evolution in Agents

    Oct 14, 2026Tao Yu, Zhongtian Luo, Yuchen Long +19Agent Skill LearningSelf-Evolving Agents

  8. AdCoEvo: A Co-Evolving Multi-Agent Advertising Delivery System

    Oct 14, 2026Tianzhu Hu, Hang Yu, Zeyuan Zhao +9Online AdvertisingSelf-Evolving Agents

  9. Self-Evolving Agent Harness

    Oct 13, 2026Chuyang Wei, Haoxiang Guan, Minghang Zhu +5Agent Harness Self-EvolutionSelf-Evolving Agents

  10. SEAR: Self-Evolving Agentic Robotics

    Oct 13, 2026Xinyi Wang, Bangzheng Li, Hanyu Wang +5Agentic AI for RoboticsRobot Learning

  11. Origin Attribution for Unsafe Behavior in Self-Evolving Multi-Agent Coding Systems

    Oct 12, 2026Hanyi Yu, Jiaming CuiAI Agent SecurityMulti-Agent Coding

  12. EvoSpatial: Experience-Driven Skill and Tool Evolution for Spatial Reasoning Agents

    Oct 12, 2026Bin Yu, Shijie Lian, Zhaolong Shen +10Tool-Using AgentsSpatial Reasoning

  13. EAU: Environment-Agent-User Co-evolution for Training User-Centric Agents

    Oct 12, 2026Min Cai, Dan Zhang, Gao Xing +3LLM Agent TrainingRL for LLM Agents

  14. Small but Mighty: Test Suites as Improvement Signals for Self-Evolving Agents

    Oct 11, 2026Yutong Cheng, Wei Cheng, Wenchao Yu +2Automated Test GenerationLLM Agent Self-Improvement

  15. VideoEvoHarness: Self Evolving Agent Harness from Unlabeled Videos for Video Understanding

    Oct 11, 2026Weixin Xu, Yifan Liu, Yi Wang +5Agent Harness OptimizationSelf-Evolving Agents

  16. EvolvAttack: Backdooring self Evolving VLM Agents

    Oct 11, 2026Chuan Zou, Yang Xiang, Zexin Li +2Backdoor AttacksBackdoor Attacks on VLMs

  17. HarnessNet: Feedback-driven Hierarchical Joint Harness Evolution for Multi-agent Systems

    Oct 10, 2026Zhaoyuan Qiu, Sachith Seneviratne, Yu Xia +1Agent Harness OptimizationSelf-Evolving Agents

  18. Harmony Harness: Multi-Objective Self-Evolution of Agent Harnesses

    Oct 10, 2026Weichen Yu, Lesly Miculicich, Bhavana Dalvi Mishra +5Agent Harness OptimizationAgent Harness Self-Evolution

  19. EnactOpt: Diagnosis-Guided Harness Evolution for Embodied Agents

    Oct 10, 2026ZhiYuan Feng, Zhuoshi Pan, Zhaolu Kang +5Agent Harness OptimizationEmbodied AI

  20. SEPM: Self-Evolving Procedural Memory Grounded in Task Graphs for Multi-Agent Collaboration

    Oct 10, 2026Yi Liu, Junwei Zhao, Li Sun +2Agent MemoryMulti-Agent Collaboration

  21. AutoEnvScaling: Automating the Data Flywheel with Terminal Agents

    Oct 9, 2026Simon Yu, Baolin Peng, Bo Liu +8LLM Agent TrainingSelf-Evolving Agents

  22. X-AgentRed: Red-Teaming Personal Agents in Evolving Multi-Service Ecosystems

    Oct 9, 2026Yeonsung Jung, Zhiyuan Wang, Zifan Wang +5Automated Red TeamingAI Agent Security

  23. JANUS: Enhancing Long-Horizon Autonomous Research with Co-Evolving World Models

    Oct 9, 2026Mengdi Liu, Chenghao Jia, Hong Chang +3Autonomous Research AgentsSelf-Evolving Agents

  24. Evo2^2: Evolving the Evolver through Weight-Harness Co-Evolution

    Oct 9, 2026Chejian Xu, Shujian Zhang, Wenxuan Zhou +5Agent Harness Self-EvolutionSelf-Evolving Agents

  25. EmbodiedCLBench: Evaluating Continual Learning for Self-Evolving Embodied Agents

    Oct 9, 2026Jie Huang, Yanan Chen, Ruixun Liu +6Continual Robot LearningAI Agent Benchmarks

  26. EvoBelief: Falsifiable World Models for Self-Improving LLM Agents

    Oct 8, 2026Janet Wang, Jiang Guo, Yi Xiang +6World ModelsBelief Updating in LLMs

  27. AgentGarten: Code Worlds for Evolving Agents

    Oct 8, 2026Jiawei Chi, Shangchen Miao, Zhiyuan Shi +12Self-Evolving AgentsNeural Rendering

  28. EvoAlloc: A Self-Evolving Resource Allocation Agent for Efficient Program Evolution

    Oct 8, 2026Yanning Dai, Yuhui Wang, Nanbo Li +2Large Language Model-Guided OptimizationSelf-Evolving Agents