cs.CYOct 18, 2026

Assessing the Empirical Evidence for Loss of Control from Agentic General-Purpose AI

Authors: Risto Uuk, Santeri Koivula, Lorenzo Pacchiardi, Rokas Gipiškis, Laura Caroli, Kamaria Horton

Organizations: Future of Life Institute; KU Leuven; London School of Economics and Political Science · Future of Life Institute; ETH Zurich · University of Cambridge · Future of Life Institute; AI Standards Lab; Vilnius University · 

Abstract

Theoretical literature warns that advanced generalist agentic systems might pursue instrumental goals that are misaligned with human preferences, thus posing risks of irreversible loss of human control. The EU's Code of Practice for General-Purpose AI lists loss of control as a systemic risk that must be assessed, yet no structured assessment of the quality of the empirical evidence for this risk exists. This study fills that gap. We evaluate 19 recent empirical studies across eight properties identified from threat models (such as strategic deception, situational awareness, and autonomous replication), assessing the quality of evidence across three dimensions: construct validity, content validity, and external validity. Our central finding is that the current body of evidence supports a judgment of loss of control as "weakly plausible." In our framework, 'plausibility' denotes the strength and direction of available evidence, not a probability estimate. Emerging evidence exists across multiple properties. No study clears the validity thresholds for a stronger judgment that a property is present; a single study clears them only for a negative-direction judgment (against situational awareness). Validity gaps, particularly in external validity, are widespread. Therefore, our findings highlight the need for more rigorous evaluations of agentic general-purpose AI systems. However, for the most dangerous properties, high external validity may be structurally unachievable under responsible research practices, reflecting a ceiling on feasible evidence rather than absence of the capability. Furthermore, as AI capabilities advance rapidly, empirical assessments may systematically lag behind the capability frontier. Our framework provides a structured baseline for ongoing monitoring as capabilities advance.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Reframing AI Loss of Control: What It Is, How to Have It, How to Lose It

    May 19, 2026Ze Shen Chin, Maurice Chiodo, Dennis Müller +1AI Risk ManagementAI Governance

  2. Testing and Evaluation of Agentic AI Systems In Military Command and Control

    Aug 20, 2026Ulysse Richard, Heather Frase, Sarah Cao +3AI Agent EvaluationAI Assurance