cs.AIOct 21, 2026

A Three-Pillar Governance Framework for Safe and Trustworthy AI Agents

Authors: Edward C. Cheng, Jeshua Cheng, Alice Siu

Organizations: Management Science & Engineering, Stanford University, Stanford, California, United States · AI Laboratory, Inquiryon, Inc., South San Francisco, California, United States · Deliberative Democracy Lab, Stanford University, Stanford, California, United States

Abstract

AI agents capable of autonomous decision-making introduce significant challenges related to safety, alignment, accountability, and human oversight. Existing Human-in-the-Loop (HITL) and responsible AI approaches provide important foundations, but many remain fragmented across system design, governance, and operational deployment. This paper presents a Three-Pillar (3P) model and framework for developing safe and trustworthy AI agents through transparency, accountability, and trustworthiness. The framework defines an evolutionary path in which increasing agent autonomy is introduced through progressive validation, structured human oversight, and auditable operational controls. We further describe how the model supports agent lifecycle monitoring, decision traceability, escalation management, and human-agent collaboration within enterprise agentic environments. By integrating oversight principles with operational mechanisms, the proposed framework provides a practical foundation for deploying AI agents that remain aligned with human intent while enabling controlled progression toward higher autonomy.

Explore similar work

CardsList
  1. Think Before You Act -- A Neurocognitive Governance Model for Autonomous AI Agents

    Apr 28, 2026Eranga Bandara, Ross Gore, Asanga Gunaratna +12Cognitive Architectures for AI AgentsAI Agent Governance

  2. Trustworthy Agentic AI: Failure Modes, Mitigation Strategies, and a Lifecycle Framework for Autonomous LLM Systems

    Sep 19, 2026Fayeq Jeelani Syed, Rehan Ahmad, Ali Al Bataineh +1LLM Agent SecurityLLM Agents