cs.AINov 9, 2026

Do AI Agents need Preventive Care? An Epidemiologic Cohort Design for Agentic AI

Authors: Shu Jiang, Graham A. Colditz

Organizations: Division of Public Health Sciences, Department of Surgery, Washington University School of Medicine in St. Louis, St. Louis, MO, USA.

Abstract

As AI agents increasingly perform tasks autonomously across sectors, including healthcare and biomedical research, understanding how their behaviors develop and influence outcomes over time becomes increasingly important. Existing evaluations largely focus on model capabilities and performance on predefined tasks. Here, we propose an epidemiologic cohort design for studying agentic AI, drawing on principles established in human population studies. The framework treats individual agents as members of a cohort, their underlying model as genetic makeup, accumulated work as their time scale, and naturally occurring behaviors as exposures that may influence subsequent outcomes. By following agents longitudinally, this approach enables investigation of behavioral determinants of adverse events, estimation of their potential preventable burden under causal assumptions, and characterization of behavioral changes over an agent's work life. We illustrate the design through two prospective observational cohorts examining curiosity and probing as a safety question, and data checking and analytical accuracy as a reliability question. Together, the framework and illustrative studies provide a generalizable blueprint for designing epidemiologic cohorts of AI agents.

Explore similar work

CardsList
  1. Knowing When to Intervene: Causal Evaluation of AI Agents

    Nov 6, 2026Ayush Sawarni, Wenqian Xing, Tijana Zrnic +2AI Agent EvaluationAI Agent Auditing

  2. A Framework for Longitudinal Health AI Agents

    Apr 13, 2026Georgianna Lin, Rencong Jiang, Noémie Elhadad +1Long-Horizon Agent TasksHealthcare

  3. A Diagnostic Framework for AI Agent Behavior

    Jul 19, 2026Xichen Zhang, Yingjie Zhang, Tianshu SunAI Agent EvaluationAI Agent Governance