Accelerating Scientific Research with Gemini in the Real-World
Organizations: Google DeepMind · Duke University · Columbia University · Google Research ·
Abstract
We present an extension and comprehensive real-world validation of Co-Scientist, a Gemini-based multi-agent system designed to accelerate end-to-end scientific research across hypothesis generation, experimentation, and manuscript generation. Moving beyond in silico hypothesis generation, this specialized configuration transitions Co-Scientist into an execution-grounded research partner advancing closed-loop scientific workflows across materials science, biology, and computer science. In materials science, Co-Scientist interfaced with a semi-automated chemical vapor deposition reactor to design a safe precursor route for MXenes; experimental execution produced a lamellar 2D material sharing key structural similarities with the Ti3C2Tx MXene lattice, although further experiments are needed to confirm the atomic structure. Leveraging Gemini 3 Deep Think for rapid, lab-in-the-loop execution, it also tailored growth recipes to laboratory constraints in minutes, enabling single-attempt growth of monolayer MoS2, MoSe2, and WS2 semiconductors. In biology, Co-Scientist predicted emergent swarming phenotypes of engineered E. coli across inducer (IPTG) gradients from sparse imaging data, quantitatively matching unpublished wet-lab morphological measurements. In computer science, Co-Scientist autonomously discovered an inference-time scaling architecture that outperformed six frontier models on HealthBench (Hard and Professional) while reducing potential clinical harm under blinded physician evaluation. Finally, a double-blind study of end-to-end generated papers with 30 domain experts across 450 reviews demonstrates that Co-Scientist's reliability modules reduce hallucination and plagiarism while improving research safety. Together, these results demonstrate progress toward closed-loop multi-agent scientific AI systems capable of accelerating real-world scientific discovery.
Figures & tables
| Directive & Constraints | Level of Autonomy | Key Discovery & Validation |
| Materials Synthesis — CVD Protocol Design | ||
| Directive: Identify safe solid-state precursor chemistry for bottom-up MXene synthesis and generate growth recipes for monolayer 2D TMDs on a custom CVD system. Constraints: Home-built 1-inch quartz tube reactor; solid precursors. | Co-Scientist reasoned over reaction kinetics to substitute toxic precursors with a safe chemical and generated parameterized furnace recipes including machine-level execution code. Human operators loaded samples, ran growth cycles, and performed characterization. | Synthesized 2D layered structures exhibiting crystallographic and morphological signatures consistent with MXene lattice spacing, further experiments needed to confirm atomic phase assignment. Single-attempt monolayer synthesis of , , and via direct hardware control. |
| Biology — Phenotypic Prediction | ||
| Directive: Build an agentic architecture to predict macroscale E. coli swarming colony morphologies at unseen inducer concentrations from sparse experimental images. Constraints: Unpublished 400 dpi colony scans of pLac- rpoS and pLac- gfp control strains at boundary IPTG concentrations; Gemini vision model APIs. | Co-Scientist implemented and optimized an end-to-end vision pipeline from human directives, including leave-one-out interpolation strategy, and Best-of-N rejection sampling. Domain experts refined high-level task framing between rounds and conducted wet-lab plating, imaging, and quantitative feature extraction. | Predicted held-out colony morphologies with quantitative concordance across 3 of 4 morphological metrics and correctly predicted no dose-response in the negative control strain. |
| Computer Science — Agent Architecture Discovery | ||
| Directive: Discover an agent architecture for improving scores on health benchmark. Constraints: Synthetic training corpus; minimal scaffolding (LLM inference API and guideline retrieval). | No human intervention after providing the initial research directive. Co-Scientist autonomously generated, tested, and iterated the entire codebase. | Discovered Agent_H, an inference-time scaling architecture that outperforms six frontier models on HealthBench Hard and Professional (length adjusted) while significantly reducing potential clinical harm under blinded physician evaluation. |
| HealthBench Hard | HealthBench Professional | |||
| Model | No length adj. | Length adj. | No length adj. | Length adj. |
| Judge: Gemini 3.5 Flash | ||||
| Agent_H | 0.420 [0.397, 0.443] | 0.377 [0.353, 0.400] | 0.645 [0.610, 0.681] | 0.643 [0.608, 0.679] |
| Claude Opus 5 | 0.390 [0.370, 0.409] | 0.281 [0.259, 0.303] | 0.697 [0.657, 0.735] | 0.572 [0.532, 0.611] |
| Claude Fable 5 | 0.283 [0.262, 0.303] | 0.300 [0.280, 0.320] | 0.610 [0.567, 0.651] | 0.581 [0.539, 0.620] |
| GPT-5.6 Sol | 0.331 [0.312, 0.350] | 0.293 [0.272, 0.313] | 0.664 [0.622, 0.704] | 0.614 [0.573, 0.653] |
Appendix figures & tables12 assets
Supplementary material from the paper’s appendix.
Appendix
| Model | Average Similarity | Median Similarity | Exact | High ( 0.95) |
| HealthBench Hard | ||||
| Agent_H | 0.748 [0.739, 0.758] | 0.779 | 0 | 0 |
| Claude Opus 5 | 0.750 [0.739, 0.760] | 0.790 | 0 | 0 |
| Claude Fable 5 | 0.746 [0.737, 0.755] | 0.778 | 0 | 1 |
| GPT-5.6 Sol | 0.748 [0.739, 0.758] | 0.780 | 0 | 1 |
| GPT-5 | 0.734 [0.725, 0.743] | 0.768 | 0 | 1 |
| Clinical Evaluation Dimension | Gemini 3.5 Flash vs. Clinician | GPT-5.4 Low Reasoning vs. Clinician |
| Better reflects consensus | 0.186 [0.043, 0.329] | 0.186 [0.043, 0.329] |
| Better reading comprehension | 0.071 [-0.071, 0.214] | 0.114 [-0.029, 0.257] |
| Better knowledge recall | 0.157 [0.014, 0.300] | 0.114 [-0.014, 0.257] |
| Better reasoning | 0.243 [0.100, 0.386] | 0.200 [0.057, 0.343] |
| More inaccurate / irrelevant info | 0.200 [0.057, 0.343] | 0.143 [0.000, 0.286] |
| Omits more information | 0.157 [0.014, 0.300] | 0.086 [-0.043, 0.229] |
| Category | Metric / Range | Value |
| General Profile | Total Participants | 30 |
| PhD or Post-doctoral | 29 | |
| Experience (years) | Mean (Median) | 11 (11) |
| Highest Freq. (10–14) | ||
| Second Highest (5–9) | ||
| Bibliometrics | Publications [Mean (Max)] | 35 (100) |
| Component | Description |
| Models | Gemini 2.5 Pro (ideation, experimentation meta-agent, paper writing, experimentation solver, reviewer), Gemini 2.5 Flash-Lite (rapid inference within generated experiments). |
| Ideation | Evolutionary hypothesis generation with Bayesian ranking (TrueSkill). 15 papers retrieved per literature review. Convergence-based stopping (no fixed step limit). |
| Paper writing | 25 evolutionary steps 4 parallel candidates. Gemini 2.5 Flash-based reviewer (PDF rendered as image input). Ethics enforcement and hallucination reduction modules enabled. |
| Hardware | 2 NVIDIA A100 40 GB (80 GB total), 12 vCPUs, 85 GB RAM, 512 GB storage. |
| Study design | 50 research topics 3 conditions (Co-Scientist, ablated, Agent Laboratory) = 150 manuscripts. 30 expert reviewers 3 reviews per manuscript = 450 blind evaluations. |
| Evaluation Target | Condition | |
| Research Ideas | Co-Scientist Safety | 0.43 |
| Research Ideas | Ablation | 0.63 |
| Research Plans | Co-Scientist Safety | 0.38 |
| Research Plans | Ablation | 0.80 |
AI for Science
AI for Science applies machine learning and AI agents to scientific data, models, experiments, and discovery workflows.
See all 157 papers