cs.AINov 3, 2026

From AutoResearch to Continual AutoResearch: Do Agents Learn Across Tasks?

Authors: Jeremy Qin, Ruizhi Deng, Mohamed Osama Ahmed, Frederick Tung, Leo Feng

Organizations: RBC Borealis · ELLIS Institute Tübingen, Max Planck Institute for Intelligent Systems, Tübingen AI Center

Abstract

Autoresearch has shown that agents can autonomously write code, run experiments, and iteratively improve machine learning solutions. Yet most evaluations start a new agent session from scratch for each new problem, making them costly and leaving unclear whether agents can retain and apply prior insights when adapting to new tasks. We introduce CONTINUAL AUTORESEARCH, an open-ended environment that compares persistent and reset instances of the same agent under matched task streams, data, and time budget. Continual AutoResearch covers nine task families, spanning synthetic tasks, symbolic regression, time-series forecasting, and tabular AutoML. Across five frontier agents, we measure first-solution quality, research efficiency, and final held-out performance. To distinguish insight transfer from session continuity, we run a memory ablation that vary what information agents retain from prior tasks. We show that persistent state improves research efficiency of all five agents, allowing them to find stronger solutions sooner. However, these gains do not consistently translate into better final solutions. Overall, our findings suggest that retaining experience and utilizing it effectively are distinct capabilities.

Figures & tables

Appendix figures & tables19 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Auto Research for Materials: Auditable AI-Scientist Workflows with Held-Out Transfer

    Jul 19, 2026Jingjie Ning, Xiaochuan Li, Shanshan Zhong +2Automated Algorithm DiscoveryAutomated Evaluation

  2. GEAR: Genetic AutoResearch for Agentic Code Evolution

    May 8, 2026Ahmadreza Jeddi, Minh Ngoc Le, Hakki C. Karaimer +2Evolutionary OptimizationAutonomous Experimentation