hep-thOct 9, 2026

TheoPhysEval: Assessing AI agents at autonomous theoretical physics problem solving

Authors: A. Ramesh Chandra, Aaghaz Mahajan, Ainesh Sanyal, Mianqi Wang, Shubhadeep Chakraborty, Sudip Chakraborty, Shailesh Chandrasekharan, Rama Govindarajan, 

Organizations: International Centre for Theoretical Sciences · Tata Institute of Fundamental Research · University of Texas at Austin · Kavli IPMU (WPI), The University of Tokyo · 

Abstract

We present a suite of 50 unpublished research-level theoretical physics problems with verifiable answers. Without AI assistance, a typical problem in our collection could be solved by a world expert in about a day or less but would take considerably longer for experts in adjacent specialties. We test the ability of off-the-shelf AI agents to tackle these problems autonomously, without human hints. When given access to tools available in a realistic setting, including the ability to search the literature and write scripts for numerical and symbolic work, the best-performing agent, GPT-6-Astra harnessed in Codex, obtains the final answers with a near-perfect accuracy of 98% at an average cost under USD 3 per problem. On average, agents show only small changes in accuracy when denied web search and access to background research papers, suggesting significant memorization of the literature. These results suggest that state-of-the-art agents can accurately perform concrete calculations required across theoretical physics research. We comment on the broader implications of these findings and discuss possible explanations for the current lack of agent-led breakthroughs in theoretical physics despite their outstanding problem-solving abilities.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. OpenProblemBench: Benchmarking AI on Open Problems in the Foundational Theoretical Sciences

    Oct 8, 2026Zhiyi Li, Sihan Hu, Tianning Xiao +4AI for ScienceScientific Reasoning in Language Models