Overview

Self-evolving agents are systems that use experience from task execution to change how they solve future tasks, rather than relying only on a fixed model or hand-designed workflow. Common approaches store and refine reusable skills or memories, optimize prompts and agent harnesses, train policies with reinforcement learning, or co-evolve task generators, environments, and teams of agents. These methods are tested in settings such as web and GUI use, coding, embodied robotics, scientific workflows, and reasoning benchmarks, with feedback ranging from execution outcomes to verifiers and paired validation. A central challenge is making improvements transfer to new tasks without forgetting earlier abilities or introducing unsafe behavior; reliable evaluation, update verification, and long-term monitoring remain open problems.

Latest papers

451 papers45 papers in the last four weeks, down 55% on the four weeks before. 0.3% of all new papers.

Apr 7, 2025

Generalising from Self-Produced Data: Model Training Beyond Human Constraints

Current large language models (LLMs) are constrained by human-derived training data and limited by a single level of abstraction that impedes definitive truth judgments. This paper introduces a novel framework in which AI models autonomously generate and validate new knowledge through direct interaction with their environment. Central to this approach is an unbounded, ungamable numeric reward - such as annexed disk space or follower count - that guides learning without requiring human benchmarks. AI agents iteratively generate strategies and executable code to maximize this metric, with successful outcomes forming the basis for self-retraining and incremental generalisation. To mitigate model collapse and the warm start problem, the framework emphasizes empirical validation over textual similarity and supports fine-tuning via GRPO. The system architecture employs modular agents for environment analysis, strategy generation, and code synthesis, enabling scalable experimentation. This work outlines a pathway toward self-improving AI systems capable of advancing beyond human-imposed constraints toward autonomous general intelligence.