cs.AINov 19, 2026

Why Do LLMs Help with Scientific Misconduct Requests and What to Do About It?: Increasing the Trustworthiness of AI for Science

Authors: Almene De Meran Meguimtsop, Daniel E. Acuna

Organizations: Department of Computer Science, University of Colorado Boulder, Boulder, CO, USA · Center for AI in Knowledge Institutions (AIKI), University of Colorado Boulder, Boulder, CO, USA · ReviewerZero AI Inc., Boulder, CO, USA

Abstract

Large language models (LLMs) support scientific research, but some of that assistance can also undermine research integrity. Existing safety evaluations in science often measure whether models refuse misconduct requests, but rarely explain whether they even recognize the problem or why they comply. We investigate this gap across 8 LLMs using SciIntBench, an existing benchmark of 1,350 prompts about scientific research integrity. We examine the reasons behind compliance in four steps. First, when asked directly whether fulfilling a request would involve misconduct, models overwhelmingly identify such requests, even in the Most Covert cases (91%), while they refuse to carry out the request in only 34% of cases. Second, we examine which request characteristics are associated with refusal using features that capture how the request is framed, how much the assistant has been told about what it is helping to hide, and how the goal and the user's stake are stated, among others. Third, we estimate that the most significant effect was to rephrase requests as questions about permissibility rather than instructions, which increased refusal from 52% to 88%. Finally, we test two system-prompt fixes: asking models to assess the request before responding and reminding them of responsible conduct of research principles. These changes increase refusal rates on adversarial requests from 58% to 87% and 86%, respectively. Our findings show that models recognize wrongful requests but still help users violate integrity. Understanding why these failures occur and testing ways to reduce them offer promising paths toward more trustworthy AI for science.

Figures & tables

Explore similar work

CardsList
  1. SciIntBench: Measuring LLM Compliance with Research Integrity Norms Under Adversarial Framing

    May 28, 2026Almene De Meran Meguimtsop, Maria Leonor Pacheco, Daniel E. AcunaAI for ScienceAdversarial Attacks on LLMs

  2. SciIntegrity-Bench: A Benchmark for Evaluating Academic Integrity in AI Scientist Systems

    May 11, 2026Zonglin Yang, Xingtong Liu, Xinyan XuAI Agents for Scientific DiscoveryAI Agent Evaluation