cs.CYMar 30, 2026

Coherent Without Grounding, Grounded Without Success: Observability and Epistemic Failure

Authors: Camilo Chacón Sartori

Organizations: Institut Català de Nanociència i Nanotecnologia (ICN2). · Artificial Intelligence Research Institute (IIIA-CSIC), Barcelona, Spain.

Abstract

When an agent can articulate why something works, we typically take this as evidence of genuine understanding. This presupposes that effective action and correct explanation covary, and that coherent explanation reliably signals both. I argue that this assumption fails for contemporary Large Language Models (LLMs). I introduce what I call the Bidirectional Coherence Paradox: competence and grounding not only dissociate but invert across epistemic conditions. In low-observability domains, LLMs often act successfully while misidentifying the mechanisms that produce their success. In high-observability domains, they frequently generate explanations that accurately track observable causal structure yet fail to translate those diagnoses into effective intervention. In both cases, explanatory coherence remains intact, obscuring the underlying dissociation. Drawing on experiments in compiler optimization and hyperparameter tuning, I develop the Epistemic Triangle, a model of how priors, signals, and domain knowledge interact under varying observability. The results suggest that neither behavioral success nor explanatory accuracy alone suffices for attributing understanding. I argue that evaluating artificial epistemic agents requires a tripartite framework -- coherence, grounding, and a proper basing relation linking explanation to action. The systematic separation of knowing-that and knowing-how in LLMs thus challenges assumptions inherited from both epistemology and current AI evaluation practice.

Explore similar work

CardsList
  1. AI scientists produce results without reasoning scientifically

    Apr 20, 2026Martiño Ríos-García, Nawaf Alampara, Chandan Gupta +5AI Agent ReliabilityScientific Reasoning

  2. From Plausible to Actionable: A Position on LLM Self-Explanations

    Jul 17, 2026Elize Herrewijnen, Benedetta Muscato, Gizem Gezici +1CoT FaithfulnessFaithfulness of Language Model Explanations

  3. Probing an Embodied LLM: When Higher Observation Fidelity Hurts Problem Solving

    May 19, 2026Oussama Zenkri, Oliver BrockLarge Language Model-Based Robot PlanningLLM Agent Evaluation