cs.CYJan 30, 2026

Eroding the Truth-Default: A Causal Analysis of Human Susceptibility to Foundation Model Hallucinations and Disinformation in the Wild

Authors: Alexander Loth, Martin Kappes, Marc-Oliver Pahl

Organizations: Frankfurt University of Applied Sciences, Frankfurt am Main, Germany · IMT Atlantique, UMR IRISA, Chaire Cyber CNI, Rennes, France

Abstract

As foundation models (FMs) approach human-level fluency, distinguishing synthetic from organic content has become a key challenge for Trustworthy Web Intelligence. This paper presents JudgeGPT and RogueGPT, a dual-axis framework that decouples "authenticity" from "attribution" to investigate the mechanisms of human susceptibility. Analyzing 918 evaluations across five FMs (including GPT-4 and Llama-2), we employ Structural Causal Models (SCMs) as a principal framework for formulating testable causal hypotheses about detection accuracy. Contrary to partisan narratives, we find that political orientation shows a negligible association with detection performance (r=−0.10r=-0.10). Instead, "fake news familiarity" emerges as a candidate mediator (r=0.35r=0.35), suggesting that exposure may function as adversarial training for human discriminators. We identify a "fluency trap" where GPT-4 outputs (HumanMachineScore: 0.20) bypass Source Monitoring mechanisms, rendering them indistinguishable from human text. These findings suggest that "pre-bunking" interventions should target cognitive source monitoring rather than demographic segmentation to ensure trustworthy information ecosystems.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Can Humans Tell? A Dual-Axis Study of Human Perception of LLM-Generated News

    Apr 4, 2026Alexander Loth, Martin Kappes, Marc-Oliver PahlAI-Generated Text DetectionLLM Evaluation

  2. Many Ways to Be Fake: Benchmarking Fake News Detection Under Strategy-Driven AI Generation

    Apr 10, 2026Xinyu Wang, Sai Koneru, Wenbo Zhang +3Fake News DetectionSynthetic Benchmark Generation

  3. A misinformation playbook sharpens judgement without breeding cynicism

    Oct 15, 2026Tong Guo, Teng Ye, Yutong Xie +1Fake News Detection