cs.AINov 6, 2026

Flex-RSI: Benchmarking Recursive Self-Improvement of Frontier Agents

Authors: Jingdong Zhang, Jionghao Wang, Zhengming Yu, Yancheng Cai, Wei Chow, Chris Choy, Zhiyang Dou, Hang Hua, 

Abstract

Frontier language models are increasingly deployed as agents, and how well an agent performs depends not only on its model but also on its harness: the prompts, tools, memory, and control loop through which the model acts. When an agent is applied to a new problem, a natural question is whether it can use the feedback of the task to improve the way it works, and not merely its answer. Most existing benchmarks keep the agent's harness fixed and score the solution it produces, or target large-scale model training. We introduce Flex-RSI, a benchmark for the recursive self-improvement of agents on vision and robotics tasks under a fixed budget. In each round, an executor improves the task solution, which is kept only if it scores higher on held-out validation data, and an improver then revises the harness, including the executor and itself. Every run starts from the same general-purpose harness, and the final solution is scored on hidden test data. Evaluating closed-source and open-weight models on tasks spanning perception, reasoning, robot action, 3D reconstruction, visual creation, and infrastructure, we find that self-improvement helps most when the agent builds its own solution, that feedback recording only success or failure holds back open-weight models, and that open-weight models fall furthest behind where outputs must pass strict checks of physical stability or exact correctness. Paired runs further show that editing the harness itself contributes to the gains.

Figures & tables

Appendix figures & tables34 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RSI-Env: An Open-Ended Environment for Recursive Self-Improvement of Agents

    Nov 1, 2026Wanying Qu, Zhiyuan Fan, Jiyao Liu +4LLM Agent Self-ImprovementRecursive Self-Improvement

  2. RRSI: Regularized Recursive Self-Improvement of Agent Harnesses

    Sep 21, 2026Peng Xia, Rujun Han, Zifeng Wang +11OOD GeneralizationAgent Harness Optimization

  3. RSI-Forge: From Research Papers to Environments for Recursive Self-Improvement

    Oct 7, 2026Renxiong Wang, Darvin Yi, Abril Herrlein +16Self-Improving AgentsRecursive Self-Improvement