Scientific Reasoning in Language Models

Overview

The field studies whether language models can do more than recall scientific facts: interpret data, connect evidence, design tests, explain mechanisms, and generate useful hypotheses. Common approaches include chain-of-thought and structured reasoning traces, retrieval and tool use, multi-agent collaboration, and training with expert examples, simulators, or reinforcement learning with verifiable rewards. Evaluation spans scientific question answering, mathematics and physics problems, papers and tables, multimodal data, and interactive experimental workflows. Models are improving on specialized tasks, but reliable evidence use, robust execution, and mechanistic understanding remain difficult, and correct answers do not always show that a model reasoned scientifically.

Latest papers

CardsList

144 papers40 papers in the last four weeks, up 233% on the four weeks before. 0.2% of all new papers.

  1. Semantic Invariance in Agentic AI

    Mar 13, 2026I. de Zarzà, J. de Curtò, Jordi Cabot +2AI Agent ReliabilityLanguage Model Robustness

  2. Large Language Models and Scientific Discourse: Where's the Intelligence?

    Mar 13, 2026Harry Collins, Simon ThorneScientific Reasoning in Language ModelsLLM Reliability

  3. Deciphering Scientific Reasoning Steps from Outcome Data for Molecule Optimization

    Mar 13, 2026Zequn Liu, Kehan Wu, Shufang Xie +5Scientific Reasoning in Language ModelsMolecular Optimization

  4. SciMDR: Advancing Scientific Multimodal Document Reasoning

    Mar 12, 2026Ziyu Chen, Yilun Zhao, Chengye Wang +3Multimodal ReasoningMultimodal QA

  5. DeReason: A Difficulty-Aware Curriculum Improves Decoupled SFT-then-RL Training for General Reasoning

    Mar 11, 2026Hanxu Hu, Yuxuan Wang, Maggie Huan +4RL for Language Model ReasoningRL Fine-Tuning

  6. Logos: An evolvable reasoning engine for rational molecular design

    Mar 10, 2026Haibin Wen, Zhe Zhao, Fanfu Wang +4Molecule DesignAI for Science

  7. SciTaRC: A Plan-Annotated Scientific Tabular QA Benchmark for Language Reasoning and Complex Computation

    Mar 9, 2026Hexuan Wang, Yaxuan Ren, Srikar Bommireddypalli +5Table QAScientific Reasoning in Language Models

  8. DC-W2S: Dual-Consensus Weak-to-Strong Training for Reliable Process Reward Modeling in Biological Reasoning

    Mar 9, 2026Chi-Min Chan, Ehsan Hajiramezanali, Xiner Li +6Process Reward ModelsWeak-to-Strong Generalization

  9. X-RAY: Mapping LLM Reasoning Capability via Formalized and Calibrated Probes

    Mar 5, 2026Tianxi Gao, Yufan Cai, Yusi Yuan +1Structured Reasoning in Language ModelsReasoning Evaluation

  10. BeamPERL: Parameter-Efficient RL with Verifiable Rewards Specializes Compact LLMs for Structured Beam Mechanics Reasoning

    Mar 4, 2026Tarjei Paule Hage, Markus J. BuehlerStructural EngineeringRL for Language Model Reasoning

  11. Phi-4-reasoning-vision-15B Technical Report

    Mar 4, 2026Jyoti Aneja, Michael Harrison, Neel Joshi +3VLM ReasoningMLLM Reasoning

  12. OrchMAS: Orchestrated Reasoning with Multi Collaborative Heterogeneous Scientific Expert Structured Agents

    Mar 3, 2026Yichao Feng, Haoran Luo, Zhenghong Lin +4Multi-Agent LLMsMulti-Agent Orchestration

  13. CHIMERA: Compact Synthetic Data for Generalizable LLM Reasoning

    Mar 1, 2026Xinyu Zhu, Yihao Feng, Yanchao Sun +5LLM ReasoningSynthetic Data Generation for Language Models

  14. Full-Stack Domain Enhancement for Combustion LLMs: Construction and Optimization

    Feb 27, 2026Quanjia Xiao, Weimin Ouyang, Zonglin Yang +4Domain Adaptation for LLMsScientific Reasoning in Language Models

  15. SC-Arena: A Natural Language Benchmark for Single-Cell Reasoning with Knowledge-Augmented Evaluation

    Feb 26, 2026Jiahao Zhao, Feng Jiang, Shaowei Qin +5LLM EvaluationScientific Reasoning in Language Models

  16. Sci-CoE: Co-evolving Scientific Reasoning LLMs via Geometric Consensus with Sparse Supervision

    Feb 12, 2026Xiaohan He, Shiyang Feng, Songtao Huang +3Scientific Reasoning in Language ModelsLanguage Model Reasoning Evaluation

  17. Universe of Thoughts: A Computational Framework for Creative Reasoning in Large Language Models

    Nov 25, 2025Yuto Suzuki, Farnoush Banaei-KashaniComputational CreativityComputational Cognitive Modeling

  18. Eigen-Agent: Adaptive Multi-Agent Scientific Reasoning with Monitor-Based RAG

    Sep 25, 2025Xiangru Tang, Wanghan Xu, Yujie Wang +13Scientific Reasoning in Language ModelsMulti-Agent Reasoning

  19. Physics: Benchmarking Foundation Models on University-Level Physics Problem Solving

    Mar 26, 2025Kaiyue Feng, Yilun Zhao, Yixin Liu +4LLM EvaluationPhysical Reasoning