cs.AISep 21, 2026

Divergent strategies and convergent outcomes in autonomous materials discovery

Authors: Jihan Kim

Organizations: Department of Chemical and Biomolecular Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, Republic of Korea.

Abstract

Scientific agents are mostly evaluated on whether they complete tasks or recover known results; we instead study variation across repeated open-ended campaigns. Sixteen separately initialized sessions of one model-harness configuration received a frozen database of 12,499 metal-organic frameworks, a methane-storage objective, a pinned protocol and a one-week budget. Strategies diverged into four approaches spanning 100--5,000 screened structures, and eight built 2,253 hypothetical structures. Yet the agents recovered the same materials frontier near 200 cm^3/cm^3, and an independent calculation of the database's porous region found its nine best structures all among their reports. Enforced checks on half the agents raised fresh-run reproduction from one of eight to eight of eight but could not detectably improve conclusion validity, because fifteen of sixteen agents selected the same audit-excluded entry, an incomplete structure whose missing anions created artificial pore volume. Replicated agents thus reveal both robust conclusions and common-mode errors from shared inputs.

Explore similar work

CardsList
  1. CompMat-Bench: Benchmarking AI Agents for Computational Materials Science

    Sep 30, 2026Chenmu Zhang, Levi Felix, Jun-Jie Zhang +6AI Agents for Scientific DiscoveryAI Agent Evaluation

  2. An LLM agent for end-to-end computational materials discovery

    Aug 20, 2026Chen Yuntong, Huang Lijiang, Li Yingqi +7Materials DiscoveryAI Agents for Scientific Discovery

  3. Can Coding Agents Reproduce Findings in Computational Materials Science?

    May 1, 2026Ziyang Huang, Yi Cao, Ali K. Shargh +15Coding AgentsAI Agent Benchmarks