cs.AINov 9, 2026

SciMARS: Multi-Agent Recursive Self-Improvement for Closed-Loop Scientific Discovery

Authors: Weimin Wu, Han Liu

Organizations: Department of Computer Science, Northwestern University · Department of Statistics and Data Science, Northwestern University

Abstract

We propose SciMARS, a framework for recursive task-local adaptation of multi-agent harnesses in closed-loop scientific discovery. Multi-agent systems coordinate analysis, experimental design, and verification as scientific evidence evolves. However, two problems limit their effectiveness: (i) without shared memory, agents lose observations and repeat work; (ii) fixed role procedures, handoffs, and memory policies perpetuate mistakes despite retained evidence. We address these problems with a shared evidence graph and separate component editors. SciMARS adapts roles and coordination; SciMARS + Memory adds a third editor for how agents record, retrieve, and receive evidence. Candidate probes guide composition and selection of the next harness. We evaluate scientific discovery through experimental-data replay and a digital twin. SciMARS + Memory resolves 12/18 GPT-6-Astra and 2/18 GLM-5.3 attempts on Autonomous Science Bench, compared with 8/18 and 1/18 for the base multi-agent team. On ScienceAgentBench and AppWorld, it solves 14/38 and 11/20 tasks, compared with 11/38 and 5/20 for the base team. These results support combining shared memory with harness adaptation across scientific and interactive tasks.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. EvoScientist: Towards Multi-Agent Evolving AI Scientists for End-to-End Scientific Discovery

    Mar 9, 2026Yougang Lyu, Xi Zhang, Yuyue Zhao +11Multi-Agent LLM SystemsAI Agents for Scientific Discovery