cs.AINov 2, 2026

SelfImprove-Bench: Evaluating Generalization in Self-Improving Agents

Authors: Bangrui Xu, Jie Yang, Sidi Chen, Xuanhe Zhou, Jiantao Qiu, Qianyu Yang, Zijie Wang, Fan Wu, 

Organizations: Shanghai Jiao Tong University · Theseus Labs · Humanlaya · Shanghai AI Lab

Abstract

Recursively self-improving (RSI) systems are increasingly viewed as a promising means of accelerating progress toward artificial general intelligence. They aim to autonomously improve their capabilities by refining their working pipelines and recursively improving the strategies that guide subsequent refinements, with gains generalizing to unseen scenarios.However, existing evaluations lack reliable metrics to distinguish capability gains from scenario fitting, sustainable and extensible protocols for unseen tasks and difficulties, and fine-grained attribution of improvement to evolution traces. To this end, we propose SelfImprove-Bench,an RSI evaluation framework that organizes tasks into three primary capabilities (i.e., Exploring, Planning, Reasoning) as scenarios for guiding model evolution. We instantiated the tasks on games for controllability and reproducibility, and pairs them with scalable generation and orchestration driven by task templates and difficulty coefficients. Beyond task-level scores, SelfImprove-Bench organizes evaluation into generalization ladder levels G0 to G4 that measure how far gains transfer from training conditions. Experiments reveal that the evolutionary gains of existing RSI methods are inconsistent across generalization levels.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RSI-Env: An Open-Ended Environment for Recursive Self-Improvement of Agents

    Nov 1, 2026Wanying Qu, Zhiyuan Fan, Jiyao Liu +4LLM Agent Self-ImprovementRecursive Self-Improvement

  2. ModularRSI: Modular and Generalizable Recursive Harness Self-Improvement

    Sep 14, 2026Siwei Wu, Jincheng Ren, Yizhi Li +12Coding AgentsAgent Harness Optimization