cs.CLNov 17, 2026

Large Language Models Have Not Yet Transformed Science

Authors: Ron Bekkerman, Nichole Li, Bahareh Kargar, Mark Somers

Organizations: New Jersey Institute of Technology, Newark, NJ, USA

Abstract

The emergence of large language models (LLMs) in late 2022 has raised questions about the future of science, but assessing their impact requires understanding how scientific practices were already evolving. We analyze 2.5 million full-text papers across five disciplines from 2015 to 2025, tracing trends over a broad spectrum of lexical, structural, epistemological, and social dimensions. Aside from frequency shifts in some words, most pre-2023 trends continued with limited detectable breaks. Among the notable exceptions, growth in computer science coauthor teams accelerated significantly in Asia, while apparent declines in biomedical topic diversity largely reflected standardization in article formats. Our study establishes an empirical foundation for monitoring the health of global science as LLM adoption deepens.

Explore similar work

CardsList
  1. Scientific exploration, collaboration and labor division in the large language model era

    Jul 23, 2026Xiang Zheng, Xi Hong, Jialin Liu +1Scientific DiscoveryAI-Assisted Scientific Research

  2. Large language models reshape the language of science

    Apr 10, 2025Dingkang Lin, Naixuan Zhao, Dan Tian +1AI-Assisted Scientific ResearchScientific Communication