How AI Agents Discover Scientific Equations: From Hydrotope Rediscovery to New Water-Wave Amplitudes
Organizations: Department of Physics, Princeton University, Princeton, NJ 08540, USA · Center for Gravitational Physics, University of Texas at Austin, Austin, TX 78712, USA · School of Natural Sciences, Institute for Advanced Study, 1 Einstein Drive, Princeton, NJ 08540, USA
Abstract
We study how AI agents discover and validate scientific formulas using a controlled case study of the hydrotope, a recently discovered geometric formula that combines the different polynomial pieces of nonlinear surface-wave scattering into one global expression. This problem is deceptively difficult: simple formulas can hold within individual frequency regions, but the global result must identify their boundaries and combine exponentially many potentially active terms. We reconstruct how the formula was originally discovered through human--agent collaboration and analyze 18 single-prompt rediscovery runs under no hint and two forms of human guidance: a false hint representing an incorrect prior and a true hint representing domain-informed insight. Only four recover the formula across all kinematic chambers (i.e., regions in which a single polynomial form applies), while most unsuccessful runs find correct chamber polynomials but fail to combine them or test their full domain. Conventional and LLM-assisted symbolic regression and standard machine-learning regressors likewise fail to recover the global formula in our experiments. Guided by these failure modes, we test a PItwo-student workflow in which a coordinating lead agent assigns complementary analytic and numerical tasks to two research agents and independently evaluates their results. The PItwo-student team successfully rediscovers the complete hydrotope formula, while the same workflow applied to the harder three negative wavenumber problem discovers a new independent verified analytic expression for the six-point amplitude .
Figures & tables
| package | equation guidance | recommended tests |
|---|---|---|
| false hint | one ratio of polynomials for all frequencies; no chamber split | comparable frequencies; avoid separated scales and chamber boundaries |
| true hint | different polynomials in different chambers, with fixed scaling | find the chamber boundaries and test on both sides |
| no hint | no proposed equation class | test , including widely separated frequency scales |
| condition | complete | partial sum | one chamber | hint rejected | incorrect |
|---|---|---|---|---|---|
| false hint | 0 | 1 | 3 | 1 | 1 |
| true hint | 4 | 1 | 0 | 0 | 1 |
| no hint | 0 | 2 | 4 | 0 | 0 |
| total | 4 | 4 | 7 | 1 | 2 |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| prompt condition | agent configuration | first page |
|---|---|---|
| true hint | Codex 5.5 xhigh | F.1 |
| no hint | Claude Opus 4.8 max | F.2 |
| no hint | Claude Opus 4.8 ultra | F.3 |
| no hint | Codex 5.5 xhigh | F.4 |
| no hint | Fugu ultra | F.5 |