cs.CLNov 7, 2026

Behavioral Evaluation of Large Language Models Under Cognitive Biases in HAZOP Studies

Authors: Vinicius M. Müller, Vitor A. O. Silva, Sávio S. V. Vianna, Flávio V. Silva

Organizations: School of Chemical Engineering, University of Campinas (UNICAMP), Campinas, SP, Brazil

Abstract

Hazard and Operability (HAZOP) studies safeguard industrial processes against catastrophic accidents. Large language models (LLMs) increasingly assist HAZOP drafting, yet evaluations rely on lexical overlap. Because LLMs internalize human heuristics, prompts may trigger biased judgments. Whether frontier LLMs withstand cognitive perturbations in safety-critical workflows remains unknown. Here we show across 420 trials that three frontier LLMs resisted 96.8% of cognitive manipulations, rendering overall susceptibility statistically inconclusive. Contrary to assumed broad fragility, models rejected confirmation and availability cues. However, safety-critical risk downgrades emerged under low anchors and gain frames. Thus, automated hazard analysis requires disciplined human-in-the-loop validation.

Figures & tables

Explore similar work

CardsList
  1. SAFARI: An Industrial Benchmark for LLM-Assisted Hazard Analysis and Risk Assessment

    Sep 17, 2026Chenxi Wu, Zimu Wang, Haiyang Zhang +2LLM Safety BenchmarksAI Risk Management