Scientific Reasoning in Language Models

Overview

The field studies whether language models can do more than recall scientific facts: interpret data, connect evidence, design tests, explain mechanisms, and generate useful hypotheses. Common approaches include chain-of-thought and structured reasoning traces, retrieval and tool use, multi-agent collaboration, and training with expert examples, simulators, or reinforcement learning with verifiable rewards. Evaluation spans scientific question answering, mathematics and physics problems, papers and tables, multimodal data, and interactive experimental workflows. Models are improving on specialized tasks, but reliable evidence use, robust execution, and mechanistic understanding remain difficult, and correct answers do not always show that a model reasoned scientifically.

Latest papers

CardsList

167 papers29 papers in the last four weeks, down 24% on the four weeks before. 0.2% of all new papers.

  1. SciWorkBench: A Benchmark for Real Scientific Workflows

    Nov 17, 2026Yuchen Zhang, Taolin Han, Jinghang Wang +19Scientific Agent BenchmarksAI for Science

  2. SciResearch-Eval: Evaluating Scientific Judgment in Autonomous Experimental Agents

    Nov 16, 2026Brian T. Weston, Alondra Torres Contreras, Aldair E. GongoraScientific Agent BenchmarksScientific Reasoning in Language Models

  3. NEBench R1: a Reasoning Benchmark for Evaluating Nuclear Domain Competence in Large Language Models

    Nov 15, 2026Liyan Wang, Longze Li, Mohamed Hassan +4Language Model Reasoning EvaluationLLM Reliability

  4. Benchmarking language models and agents for scientific reasoning in evolving materials laboratories

    Nov 9, 2026Xuyu Dong, Yixuan Li, Jianguo Huang +5Scientific Reasoning in Language ModelsScientific Agent Benchmarks

  5. Phase-Conditioned Reward Shaping for Token-Efficient LLM Reasoning

    Nov 7, 2026Zhe Chen, Xiaolin Zhou, Xiyang HuEfficient Language Model ReasoningLLM Reasoning

  6. Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers

    Nov 4, 2026Xanh Ho, André Greiner-Petter, Florian Boudin +6Scientific Claim VerificationScientific Reasoning in Language Models

  7. Variable names provide priors: semantic grounding enables data-efficient numerical prediction by large language models

    Nov 2, 2026Xin-Rui Ma, Shi-Zhi Chen, Hai-Yan Jiang +2LLM GroundingTabular Prediction

  8. FindLink: Learning to Assess Scientific Connections from Source-Grounded Premises

    Nov 2, 2026Jingxuan Wei, Song Tan, Xiaohan Liu +6Scientific Reasoning in Language ModelsEvidence-Grounded QA

  9. Evidence-grounded large language models guide perovskite solar cell design and optimization

    Oct 31, 2026YanKai Chen, Zhi Wan, ZiHao Li +1perovskite solar cellsLarge Language Model-Guided Scientific Discovery

  10. FrontierMat: Benchmarking Language Models at the Frontier of Materials R&D

    Oct 30, 2026Feng Chen, Jianguo Huang, Yushan Xiao +20LLM EvaluationScientific Reasoning in Language Models

  11. Do Language Models Know What Compelling Scientific Evidence Looks Like?

    Oct 29, 2026Conor Igoe, Gabriel Grand, Zane Koch +6Scientific Reasoning in Language ModelsEvidence-Grounded Reasoning

  12. HERA: Assessing an Autonomous Agent for Quantum Device Measurement

    Oct 29, 2026Zachary W. Gomez, Nathan Bittner, Jordan T. McCourt +7Autonomous ExperimentationAutonomous Research Agents

  13. CARF: Context-Aware Reasoning Supervision for Scientific Evidence Screening

    Oct 27, 2026Nishtha Agarwal, Adam Visokay, Astha Wahi +4Systematic Review AutomationScientific Reasoning in Language Models

  14. Assessing Language Models for Scientific Applications: Inertial Confinement Fusion as a Use Case

    Oct 27, 2026P. B. Radha, D. D. Meyerhofer, M. Bhattarai +11Inertial Confinement FusionScientific Reasoning in Language Models

  15. Evaluating and improving AI agents for sequencing protocol understanding

    Oct 27, 2026Chi-Lam Poon, Michael Goneos, Zezheng Song +1Scientific Agent BenchmarksScientific Reasoning in Language Models

  16. Prospector: learning a compact graph traversal policy for scientific reasoning

    Oct 27, 2026Haiqian Yang, Markus J. BuehlerLLM Reasoning with GraphsScientific Reasoning in Language Models

  17. The Right Fact, the Wrong Decision: SciValidityBench for Scientific Agent Memory

    Oct 26, 2026Yuexi Pan, Yongchao ChenScientific Agent BenchmarksMemory Agent Benchmarks

  18. LLMs Can Tackle High Energy Theoretical Physics, yet Gaps Remain: Part I, Quantum Field Theory

    Oct 23, 2026Tong Liu, Bohan Li, Gongrui Cheng +3Scientific Reasoning in Language ModelsLanguage Model Reasoning Evaluation

  19. PHYRD: A Living Benchmark for Reproducing and Extending Theoretical Physics Research

    Oct 23, 2026Qituan Zhang, Guo Chen, Linfeng Zhang +1Scientific Reasoning in Language ModelsLanguage Model Reasoning Evaluation

  20. Tampered ML: Evaluating LLM Judgment of Machine Learning Research

    Oct 23, 2026Soroush Ebadian, Parand A. Alamdari, Joe Benton +1LLM EvaluationScientific Reasoning in Language Models