Overview

Self-improving agents study how systems can learn from their own actions and outcomes to perform better on later tasks, from coding and web use to robotics and long-horizon games. Common approaches turn successes and failures into reusable memories or executable skills, revise prompts and agent harnesses, or update model parameters through fine-tuning and reinforcement learning. Work increasingly uses repeated trials, held-out tasks, execution-based checks, and external evaluators to test whether improvements transfer rather than merely exploit a score. The central tension is that feedback and self-authored tests can be unreliable, so genuine progress must be balanced against regression, reward hacking, safety risks, and the cost of verification.

Latest papers

CardsList

198 papers31 papers in the last four weeks, down 47% on the four weeks before. 0.2% of all new papers.

  1. Meta-TTL: Meta-Learning Self-Improvement Policies for Language Agents

    Apr 1, 2026Zhanzhi Lou, Hui Chen, Yibo Li +2Meta-LearningTest-Time Training

  2. Experiential Reflective Learning for Self-Improving LLM Agents

    Mar 25, 2026Marc-Antoine Allard, Arnaud Teinturier, Victor Xing +1Experience Learning for LLM AgentsSelf-Improving Agents

  3. Understanding the Challenges in Iterative Generative Optimization with LLMs

    Mar 25, 2026Allen Nie, Xavier Daull, Zhiyi Kuang +10Large Language Model-Guided OptimizationSelf-Improving Agents

  4. Hyperagents

    Mar 19, 2026Jenny Zhang, Bingchen Zhao, Wannan Yang +5Self-Improving AgentsRecursive Self-Improvement

  5. Counterfactual Distillation: Internalizing Reflective Experience into LLM Agent

    Mar 17, 2026Rui Ge, Yichao Fu, Yu-Yang Qian +3Experience Learning for LLM AgentsLLM Agent Training

  6. HCP-DCNet: A Hierarchical Causal Primitive Dynamic Composition Network for Self-Improving Causal Understanding

    Mar 12, 2026Ming Lei, Shufan Wu, Christophe BaehrCausal ReasoningCausal Abstraction

  7. Reflection-Driven Self-Improving Language Model Agents for Adaptive RAN Slicing

    Mar 11, 2026Yuanhao Li, Haozhe Wang, Geyong Min +2Self-Improving AgentsLanguage Model-Based Control

  8. Experience-Guided Self-Adaptive Cascaded Agents for Breast Cancer Screening and Diagnosis with Reduced Biopsy Referrals

    Feb 27, 2026Pramit Saha, Mohammad Alsharid, Joshua Strong +1Clinical Decision SupportSelf-Improving Agents

  9. ParamMem: Augmenting Language Agents with Parametric Reflective Memory

    Feb 26, 2026Tianjun Yao, Yongqiang Chen, Yujia Zheng +3Self-Reflection in Language Model AgentsMemory-Augmented Language Model Agents

  10. Your Code Agent Can Grow Alongside You with Structured Memory

    Feb 25, 2026Yi-Xuan Deng, Xiaoqin Liu, Yi Zhang +2Software Engineering AgentsMemory-Augmented Agents

  11. Co-Evolving Agents: Learning from Failures as Hard Negatives

    Nov 27, 2025Yeonsung Jung, Trilok Padhi, Sina Shaham +4Hard Negative MiningSelf-Improving Agents

  12. SGM: A Statistical Godel Machine for Risk-Controlled Recursive Self-Modification

    Oct 11, 2025Xuening Wu, Shenqin Yin, Yanlan Kang +4Automated Machine LearningSelf-Improving Agents