cs.LGNov 17, 2026

Do LLM Agents Still Need to Be Told How to Self-Improve?

Authors: Shobhita Sundaram, Cansu Sancaktar, Phillip Isola

Organizations: MIT CSAIL · University of Tübingen

Abstract

LLM agents increasingly drive their own learning. Self-improvement methods delegate various components of model optimization to the models themselves. As models become more capable, this motivates a basic question: do these increasingly capable models still need us to specify how they should self-improve? In this paper we study an autonomous paradigm in which, given basic primitives, resources, and a general goal for self-improvement, agents construct their own self-learning algorithm for context-based optimization. Using the setting of gameplay as a testbed, a frozen LLM agent is given a compute budget and tools for collecting experience and updating text documents, and allowed to freely experiment without an externally imposed loop or access to real-world data. We find that sufficiently capable models do self-improve under these conditions, demonstrating strategies that align with classic cognitive frameworks for self-regulated learning and constructs from machine learning literature on self-generated curricula. Furthermore, we study the extent to which the learned text artifacts transfer to external benchmarks, observing improvement across different game horizons, mechanics, and 3D navigation.

Figures & tables

Appendix figures & tables26 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. AEL: Agent Evolving Learning for Open-Ended Environments

    Apr 23, 2026Wujiang Xu, Jiaojiao Han, Minghao Guo +4LLM Agent Self-ImprovementLLM Agents

  2. Self-Harness: Harnesses That Improve Themselves

    Jun 8, 2026Hangfan Zhang, Shao Zhang, Kangcong Li +5Agent Harness OptimizationLLM Agent Self-Improvement