Scientific Claim Verification

Overview

The field studies how to determine whether scientific claims follow from research papers, datasets, figures, code, and other evidence. Common approaches retrieve relevant passages, break claims into atomic parts, and apply natural-language inference or language models; newer systems add multimodal tools, selective full-text search, and code or experiment checks. Benchmarks span biomedical and climate claims, scientific tables and charts, and evidence chains linking data to conclusions. Strong results on familiar tasks do not always transfer across domains or expose errors in complex claims, leaving open how to evaluate genuine synthesis, uncertainty, and end-to-end evidential support.

Latest papers

CardsList

63 papers12 papers in the last four weeks, up 71% on the four weeks before. 0.1% of all new papers.

  1. SMART: State-based Multi Agent Reasoning Traces for Verification-oriented Problem-Solving

    Nov 5, 2026Sai Vallurupalli, Francis FerraroMulti-Agent LLM SystemsLLM Agent Verification

  2. Overview of the NTCIR-19 SciClaimEval Task: Cross-modal Claim Verification in Scientific Papers

    Nov 4, 2026Xanh Ho, André Greiner-Petter, Florian Boudin +6Scientific Claim VerificationScientific Reasoning in Language Models

  3. Embodied AI for Scientific Discovery: From Physical Action to Scientific Evidence

    Nov 3, 2026Wenhao Xu, Changwei Wang, Shunpeng Chen +6AI for ScienceAutonomous Experimentation

  4. An Experimental Study of Hybrid Retrieval, NLI and Open-source LLMs for Scientific Claim Verification

    Nov 2, 2026Lakshmi Narayanan P, Narenkarthik K, Naren Kumar CScientific Claim VerificationLLM Evaluation

  5. CONFIRM: Governing Scientific Reporting for Trustworthy Agentic Neuroimaging

    Nov 1, 2026Yuxiang Wei, Lijing Zhu, Qizhen Lan +2AI Agents for Scientific DiscoveryScientific Claim Verification

  6. Does Recursive Knowledge Construction Help Agents Verify Consensus Claims in Science?

    Oct 29, 2026Lun Ai, Yu-Heng Wu, Jonathan Schaul +6Scientific Claim VerificationScientific Agent Benchmarks

  7. Testimony from Timelines: Evidence-Grounded Significance Testing of Temporal Clinical Hypotheses

    Oct 29, 2026Chengyang He, Wenlong Zhang, Koduvayur Subbalakshmi +1Scientific Claim VerificationClinical Language Model Evaluation

  8. ScienceJudge: Pattern Perturbation Augmentation for Sentence-Level Scientific Claim Verification

    Oct 29, 2026Chuhai Cai, Xin Chen, Min Yang +1Claim VerificationScientific Claim Verification

  9. VerifiedLab: Harnessing Knowns for Unknowns

    Oct 27, 2026Yu Yao, Jiayi Dong, Yang Yang +2perovskite solar cellsLLM Agent Harnesses

  10. From Prose to Properties: Testing Research Claims with ARATest for Agent-Native Science

    Oct 21, 2026Yifeng He, Jiachen Liu, Hao ChenProperty-Based TestingScientific Claim Verification

  11. TCMScience: An Autonomous Scientist for Traditional Chinese Medicine

    Oct 17, 2026Yanlan Kang, Ruiqi Liu, Xinpei Gu +4AI Agents for Scientific DiscoveryScientific Workflow Automation

  12. When Evidence Changes the Subject: Subject-Typed Claim Licensing for Learned Routing

    Sep 27, 2026Jian Chen, Zixuan YuanEvidence-Grounded ReasoningScientific Claim Verification

  13. RINI: Seeing the Prior Is Not Enough

    Sep 27, 2026Hongyi Du, Tianyi Zhang, Heng Wang +7Novelty SearchAI-Assisted Scientific Research

  14. PaperDoctor: Evidence-Grounded and Actionable Feedback for Scientific Papers in Progress

    Sep 15, 2026Kevin Qinghong Lin, Siyuan Hu, Pan Lu +14AI-Assisted Scientific ResearchScientific Reproducibility

  15. SciTrue: Reliable Scientific Claim Validation with Frontier and Open Language Models at the NTCIR SciClaimEval Task

    Sep 1, 2026Qiming Bao, Neşet Özkan Tan, Siyuan Wang +1label leakageDocument Understanding

  16. How Robust Are Automated Fact-Checking Systems? A Cross-Benchmark Evaluation

    Aug 26, 2026Aida Usmanova, Zangir Iklassov, Markus Leippold +1Automated Fact-CheckingScientific Claim Verification

  17. When Does AI for PDEs Yield Scientific Evidence?

    Aug 23, 2026Wenshuo WangScientific Claim VerificationBenchmark Validity

  18. TRACES: A Benchmark for Epistemic Reliability in Scientific Reasoning by LLMs

    Aug 11, 2026Valentin Rodionov, Shamil AssylbekovLLM EvaluationLLM Reliability

  19. HNR-DAC: Hard-Negative Reranking and Distribution-Aligned Classification for Scientific Claim Verification

    Aug 7, 2026Zhenchao Wang, Xin Chen, Luoxi Zhang +2Claim VerificationDistribution Shift

  20. When Retrieval Helps and Distracts: Evaluating Evidence-Generating LLMs for Biomedical Claim Verification

    Aug 2, 2026Pritam Deka, Prabhjot SinghExplainable Artificial IntelligenceAutomated Fact-Checking

  21. Auditing Discovery Claims: A Two-Sided Criterion for Agentic Science, with the Negative Side Decidable

    Aug 2, 2026Wenhui Chen, Jianlin Chen, Ziyao Lin +1Reward HackingAI for Science

  22. Opaque Epistemic Mediation: How LLM Deployment Configurations Shape the Validation of Pseudo-Science

    Jul 24, 2026Davide Scarso, Hugo Noronha de Almeida, Joaquim PinaLLM EvaluationLLM Auditing