Self-Improving Agents

Momentum

13 papers in the last four weeks, up 117% on the four weeks before. 0.2% of all new papers.

Jul 6Week of Sep 21

Latest papers 64

All topics
CardsList
  1. Not All Experience Belongs in the Weights: Component Routing for Self-Improving GUI Agents

    Oct 1, 2026Beining Wu, Zihao Ding, Jun HuangSelf-Improving AgentsGraphical User Interface Agents

  2. ReSAIL: Mitigating Collapse in Iterative Agent Self-Distillation

    Sep 30, 2026Shengjie Jin, Hengbo Xu, Zelong Sun +2Self-Improving AgentsRecursive Self-Improvement

  3. RSIGame: Autonomous Agentic Game Development with Recursive Self-improvement

    Sep 30, 2026Wenyi Wu, Minghao Fu, Jieyu You +10Self-Improving AgentsRecursive Self-Improvement

  4. From Solo to Social Learning: Characterizing Recursive Social Improvement in LLMs

    Sep 29, 2026Kunal Jha, Max Kleiman-Weiner, Natasha JaquesSelf-Improving AgentsLarge Language Model Agents

  5. Skill-Space Shooting for Autonomous Robot Policy Improvement

    Sep 29, 2026Zihang Rui, Renhao Wang, Haoxu Huang +1Self-Improving AgentsRobot Systems

  6. AREX-2: Advancing Self-Improving Agents through Long-Horizon Reflective Tasks

    Sep 29, 2026Hongjin Qian, Chaofan Li, Kun Luo +11Self-Improving AgentsLong-Horizon Trajectories

  7. SelfSearch: Reward-Free Search for Self-Improving Agents

    Sep 29, 2026Jungwoo Yang, Injin Kong, Yohan JoSelf-Improving AgentsSelf-Evolving Agents

  8. Harness Evolution as Learning: Approximation, Generalization, and Optimization Limits of Self-Improving Personal Agents

    Sep 29, 2026Zeyu Gan, Zixuan Gong, Yong LiuEvolving HarnessSelf-Improving Agents

  9. MERID: Multimodal Exploration via Recursive Self-Improvement Agents for Major Depression Analysis

    Sep 28, 2026Lei Liu, Zhaokang Liang, Qingcheng Zeng +4DepressionSelf-Improving Agents

  10. Shockingly Simple Self-retrospection Improves Agentic Models Without RL

    Sep 28, 2026Jonathan Light, Christopher Zhang Cui, Jeonghye Kim +7Self-Improving AgentsReward-Only Policy Optimization Variants

  11. Towards Certificate-Driven Software Porting: A Self-Improving Agentic Harness for Scientific Program Optimization

    Sep 28, 2026Piyush Jha, Aishik Ghosh, Vijay GaneshEvolutionary SearchCode Optimization

  12. Self-Designed Evaluators and Warm Memory for Long-Horizon Agents

    Sep 27, 2026Saeid Asgari, Emre Kiciman, Leonardo de Oliveira Nunes +1Self-Improving AgentsLong-Horizon Agents

  13. Breaking the Environment Wall: A Unified Framework for Preparing and Evolving Agent-Native Environments

    Sep 24, 2026Yukai Wu, Yuanjing Yang, Le Zhou +8Self-Improving AgentsLarge Language Model Agents

  14. Recursive self-improvement of AI research agents

    Sep 22, 2026Dhruv Srikanth, Bingchen Zhao, Dixing Xu +2Self-Improving AgentsRecursive Self-Improvement

  15. RRSI: Regularized Recursive Self-Improvement of Agent Harnesses

    Sep 21, 2026Peng Xia, Rujun Han, Zifeng Wang +11Self-Improving AgentsRecursive Self-Improvement

  16. DENSE: Distilling Agent Trajectories into Evidence-Grounded Shortcut Trees for Self-Refinement

    Sep 18, 2026Siyuan Liu, Fan Yu, Dongyu Ru +5Self-Improving AgentsRetrying

  17. VideoResearcher: Self-Improving Tool Design for Long-Video Understanding

    Sep 17, 2026Dingqiang Ye, Dongdi Zhao, Kaishen Wang +11Video AgentVideo Understanding

  18. RSIAgent: Autonomous Exploration for Recursive Self-improvement in New Environments

    Sep 14, 2026Sibo Zhu, Shicheng Fan, Xinyue Wang +3Self-Improving AgentsMixture-Of-Agents

  19. Dream-RSI: Recursive Self-Improvement through Evolving Worlds

    Sep 14, 2026Tong Zheng, Xidong Wu, Zheng Zhang +14Stochastic ExplorationSelf-Improving Agents

  20. ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement

    Sep 14, 2026Siwei Wu, Jincheng Ren, Yizhi Li +11Evolving HarnessSelf-Improving Agents

  21. Harness-of-Harness: Multi-Day Autonomous Software Development with Continual Improvement

    Sep 1, 2026Haoyang Yan, Min-le Su, Hangfan Zhang +6Self-Improving AgentsCoding Agents

  22. CineForge: Self-Improving Agents for Long-Horizon Video Generation

    Aug 30, 2026Junxiang Liu, Lin Wang, Haiyu Shi +10Video AgentVideo Generation

  23. Better, Faster, Stronger: Programmatic Skill Learning Best Reduces Agent Cost

    Aug 11, 2026Zixi Huang, Xiheng Wang, Andrew Wang +4SkillsSelf-Improving Agents

  24. Mendel Gödel Machine: Recursive Self-Improving Coding Agents via Comparative Evolution

    Aug 7, 2026Changzhi Liu, Yilun Liu, Sikuan Yan +2Self-Improving AgentsModifications

  25. InsightEmb: Learning Action-Intent Embeddings for Agentic Insight Retrieval

    Aug 5, 2026Tsz Ting Chung, Jiangnan Li, Jie Zhou +1Agentic ReasoningInsights

  26. Self-Authored Verification Is Unreliable in Heuristic Self-Improving Agents

    Jul 27, 2026Diandian Guo, Cong Cao, Fangfang Yuan +3Self-Improving AgentsBoltzmann Policies

  27. AREX: Towards a Recursively Self-Improving Agent for Deep Research

    Jul 23, 2026Shuqi Lu, Chaofan Li, Kun Luo +21Self-Improving AgentsDeep Research

  28. Knowledge-Centric Self-Improvement

    Jul 21, 2026Xuefei Julie Wang, Lauren Hyoseo Yoon, Chengrui Qu +4Self-Improving AgentsRecursive Self-Improvement

  29. Why Does Feedback-Augmented Self-Distillation Fail to Improve Retrieval-Interleaved Search Agents?

    Jul 20, 2026Fan Yang, Rui Meng, Yuxin WenSelf-Distillation FrameworkSelf-Teacher

  30. Self-Improvements in Modern Agentic Systems: A Survey

    Jul 14, 2026Zhe Ren, Yimeng Chen, Dandan Guo +9Self-Improving AgentsRecursive Self-Improvement

  31. DeepSearch-World: Self-Distillation for Deep Search Agents in a Verifiable Environment

    Jul 8, 2026Xinyu Geng, Xuanhua He, Sixiang Chen +7Search AgentsSelf-Improving Agents

  32. SelfMem: Self-Optimizing Memory for AI Agents

    Jul 4, 2026Shu Yang, Junchao Wu, Derek F. Wong +1Self-Improving AgentsSemantic Memory

  33. Learning from Failure: Inference-Time Self-Improvement for Computer-Use Agents

    Jun 30, 2026Xueqiao Sun, Xiaohan Wang, Ludwig Schmidt +2Self-Improving AgentsRecursive Self-Improvement

  34. Experience Graphs: The Data Foundation for Self-Improving Agents

    Jun 29, 2026Gang Liao, Yujia He, Abdullah Ozturk +22Large DatabasesGraph-Structured Memories

  35. The Red Queen Gödel Machine: Co-Evolving Agents and Their Evaluators

    Jun 24, 2026Alex Iacob, Andrej Jovanović, William F. Shen +10Self-Improving AgentsSelf-Evolving Agents

  36. Skill-Guided Continuation Distillation for GUI Agents

    Jun 17, 2026Zhimin Fan, Hongwei Yu, Yeqing Shen +9Unsupervised Skill DiscoveryGraphical User Interface Agents

  37. Retrospective Progress-Aware Self-Refinement for LLM Agent Training

    Jun 12, 2026Xinbei Ma, Congmin Zheng, Jiyang Qiu +10Self-Improving AgentsLarge Language Model Agents

  38. EEVEE: Towards Test-time Prompt Learning in the Real World for Self-Improving Agents

    Jun 9, 2026Weixian Xu, Shilong Liu, Mengdi WangLarge Language Model AgentsSelf-Improving Agents

  39. Self-Harness: Harnesses That Improve Themselves

    Jun 8, 2026Hangfan Zhang, Shao Zhang, Kangcong Li +5Agent HarnessSelf-Improving Agents

  40. Evolving Agents in the Dark: Retrospective Harness Optimization via Self-Preference

    Jun 4, 2026Wenbo Pan, Shujie Liu, Chin-Yew Lin +5Self-Improving AgentsSelf-Evolving Agents

  41. SAGE: A Quantitative Evaluation of Socialized Evolution in Agent Ecosystems

    Jun 2, 2026Linyue Pan, Yaoming Zhu, Lin Qiu +2Self-Evolving AgentsSelf-Improving Agents

  42. CoMAP: Co-Evolving World Models and Agent Policies for LLM Agents

    Jun 1, 2026Youwei Liu, Jian Wang, Hanlin Wang +1Large Language Model AgentsSelf-Improving Agents

  43. SkillSmith: Co-Evolving Skills and Tools for Self-Improving Agent Systems

    May 31, 2026Yangbo Wei, Zhen Huang, Shaoqiang Lu +4Skill EvolutionSelf-Evolving Agents

  44. GRASP: Gated Regression-Aware Skill Proposer for Self-Improving LLM Agents

    May 28, 2026Johannes Moll, Jean-Philippe Corbeil, Jiazhen Pan +4Self-Improving AgentsLarge Language Model Agents

  45. Echo: Learning from Experience Data via User-Driven Refinement

    May 21, 2026Hande Dong, Xiaoyun Liang, Jiarui Yu +15Self-Improving AgentsAgentic Learning

  46. Training Language Agents to Learn from Experience

    May 19, 2026Yuval Shalev, Zifeng Ding, Mateja JamnikSelf-Improving AgentsMultilingual Agents

  47. ASH: Agents that Self-Hone in Long-Horizon Worlds

    May 14, 2026Benjamin Schneider, Xavier Schneider, Victor Zhong +1Self-Improving AgentsInverse Dynamics

  48. Continual Harness: Online Adaptation for Self-Improving Foundation Agents

    May 11, 2026Seth Karten, Joel Zhang, Tersoo Upaa +5Self-Improving AgentsEvolving Harness

  49. OPT-BENCH: Evaluating the Iterative Self-Optimization of LLM Agents in Large-Scale Search Spaces

    May 9, 2026Xiaozhe Li, Jixuan Chen, Xinyu Fang +4Self-Improving AgentsLarge Language Model Agents

  50. SkillMaster: Toward Autonomous Skill Mastery in LLM Agents

    May 9, 2026Min Yang, Jinghua Piao, Xu Xia +4SkillsSelf-Improving Agents

  51. The Essence of Balance for Self-Improving Agents in Vision-and-Language Navigation

    Apr 21, 2026Zhen Liu, Yuhan Liu, Jinjun Wang +3Vision-Language NavigationSelf-Improving Agents