Scientific Agent Benchmarks

Latest papers

CardsList

56 papers23 papers in the last four weeks, up 283% on the four weeks before. 0.2% of all new papers.

  1. MineralExp: Benchmarking LLM Agents for Experimental Design in Real-World Mineral Exploration

    Nov 13, 2026Bing Wang, Mingyang Wang, Yuanhang Mi +8Active Experimental DesignScientific Agent Benchmarks

  2. NIBench: benchmarking autonomous AI agents for execution, skill evolution and scientific judgment in neuroimaging

    Nov 11, 2026Lujia Zhong, Yihao Xia, Jianwei Zhang +8Scientific Agent BenchmarksProcess-Based Agent Evaluation

  3. ARE-bench: Benchmarking Agents' Research Ability in Real-World Researcher Sessions and Workspaces

    Nov 10, 2026Jiahang Lin, Wanying Ren, Wanghan Xu +24Agent EvaluationScientific Agent Benchmarks

  4. BioXArena-Pro: a research-grade benchmark for autonomous biomedical machine learning agents

    Nov 10, 2026Loka Li, Duzhen Zhang, Xingbo Du +3Scientific Agent BenchmarksAI Agent Benchmarks

  5. Can Frontier Auto Researchers Reconstruct Human Research Decisions in AI?

    Nov 9, 2026Shengyun Si, Junjie Chu, Ye Leng +1Autonomous Research AgentsAutomated Agent Evaluation

  6. Benchmarking language models and agents for scientific reasoning in evolving materials laboratories

    Nov 9, 2026Xuyu Dong, Yixuan Li, Jianguo Huang +5Scientific Reasoning in Language ModelsScientific Agent Benchmarks

  7. Publications as benchmarks: auditing AI agents on spatial transcriptomics alignment

    Nov 9, 2026Yiqun T. Chen, Jan Matthias, Jianing Yao +2Scientific Agent BenchmarksAI Agent Auditing

  8. DFT-Agent Bench: Scaffold Effects and Execution Provenance in Autonomous DFT

    Nov 7, 2026Shijie Liu, Jin Yang, Weilin Wan +3Scientific Agent BenchmarksComputational Materials Science

  9. ScienceCUA: Resource-to-Skill Construction and Execution-Guided Skill Evolution for Scientific Computer Use Agents

    Nov 2, 2026Daiqiang Li, Jingyi Peng, Rui Hu +7Computer-Use AgentsAgent Skill Learning

  10. From Tool State to Scientific Action: Auditing Decision Provenance in Biomedical Research Agents

    Nov 1, 2026Xingyu Yi, Xinya Zhang, Yunshen Zhou +1AI Agent AuditingData Provenance

  11. Unsatz: Evaluating Scientific Discovery Without a Given Ansatz

    Oct 31, 2026Ethan Ji, Wei Wang, Yizhou SunScientific DiscoveryLarge Language Model-Guided Scientific Discovery

  12. Do Language Models Know What Compelling Scientific Evidence Looks Like?

    Oct 29, 2026Conor Igoe, Gabriel Grand, Zane Koch +6Scientific Reasoning in Language ModelsEvidence-Grounded Reasoning

  13. Does Recursive Knowledge Construction Help Agents Verify Consensus Claims in Science?

    Oct 29, 2026Lun Ai, Yu-Heng Wu, Jonathan Schaul +6Scientific Claim VerificationScientific Agent Benchmarks

  14. Evaluating and improving AI agents for sequencing protocol understanding

    Oct 27, 2026Chi-Lam Poon, Michael Goneos, Zezheng Song +1Scientific Agent BenchmarksScientific Reasoning in Language Models

  15. The Right Fact, the Wrong Decision: SciValidityBench for Scientific Agent Memory

    Oct 26, 2026Yuexi Pan, Yongchao ChenScientific Agent BenchmarksMemory Agent Benchmarks

  16. SlowLab: Benchmarking Autonomous AI Agents on a Year of Experiments They Cannot Undo

    Oct 26, 2026Ningpei Ding, Zai Wen FengScientific Agent BenchmarksAutonomous Experimentation

  17. BenchBench-Cloning: Evaluating Molecular Cloning Design and Protocol Development

    Oct 23, 2026Aditya Sivakumar, Peter Ciaccia, Hassaan Qadir +2AI-Assisted Scientific ResearchLLM Evaluation

  18. SCI-AGENT-EXAM: Benchmarking Agents on Scientific Research Tasks

    Oct 23, 2026Tianyun Zhong, Wei Wang, Jialin Li +17Scientific Agent BenchmarksLLM Agent Evaluation

  19. PersonaScienceBench: Evaluating Scientific Agents with Diverse Simulated Researchers

    Oct 23, 2026Siyang Wu, Weizhi Zhang, Chen Yang +34Scientific Agent BenchmarksLLM Agent Evaluation

  20. From Research Goals to Scientific Closure: Evaluating Agents Through Evidence-Supported Physics Research

    Oct 15, 2026Yijia Mao, Song Dai, Tao Chen +14Scientific Agent BenchmarksAI Agents for Scientific Discovery

  21. Into the Unknown: Benchmarking AI agents on open scientific research problems

    Oct 13, 2026Seungone Kim, Jiayi Geng, Young-Jun Lee +25Scientific Agent BenchmarksAI-Assisted Scientific Research