AI Agent Governance

Ask about this topic

Overview

AI agent governance asks who may delegate authority to agents, which actions they can take, and how people can detect, contest, or remedy harmful behavior. Technical approaches include runtime policy enforcement, capability-based access, contracts and formal verification, human approval gates, and auditable records of actions, identity, and delegation. Other work examines governance of persistent memory and agent collectives, alongside legal responsibility, institutional design, and standards for interoperable systems. The field is developing practical architectures and benchmarks, but a central tension remains: stronger controls can reduce risk while limiting autonomy and usefulness, and bounded tests do not yet establish reliable governance in open-ended deployments.

Latest papers

CardsList

446 papers37 papers in the last four weeks, down 36% on the four weeks before. 0.2% of all new papers.

  1. Agentic process evidence

    Oct 29, 2026Yuval Kainan, Carmit HershmanAI Agent GovernanceAI Agent Auditing

    JFrog

  2. Constraining the Commit Boundary: A DIO/ODI-Informed Authorization Guardrail for Agentic Entity Resolution

    Oct 27, 2026Daniel BeránekEntity ResolutionAI Agent Governance

    Independent Researcher, Brno, Czech Republic

  3. Aligning Institutional Power and Operational Ability

    Oct 27, 2026Andrea Marino, Giovanni Sileno, Thomas van Binsbergen +1AI Agent GovernanceMulti-Agent Systems

    Informatics Institute, University of Amsterdam, The Netherlands

  4. Data Governance for Generative and Agentic AI : Technology, Law, Economics, and Security

    Oct 24, 2026Narayana Darapaneni, Padmaja K, Gnana Chaithra DAI GovernanceAI Agent Governance

  5. From Intelligence to Autonomy: Foundations and Construction of Autonomous Agents for Future Intelligent Systems

    Oct 24, 2026Hongda Zhang, Ziqing Zhou, Yuning Chen +5Agentic AISelf-Improving Agents

    Fudan University · Jiangsu Chuangling Intelligent Technology Co., Ltd.

  6. Responsibility Boundaries for Agentic Systems: A Comparative Evaluation of Probabilistic Agentic Programming

    Oct 23, 2026Khadim Lo, Soukaina Alaoui Ismaili, Jean-Sébastien DessureaultAI Agent GovernanceRuntime Enforcement for AI Agents

    Electrical & Computer Engineering, LSSI, UQTR · Mathematics & Computer Science, LSSI, UQTR

  7. Operationalizing Governed Agentic Workflows in Regulated Finance: A Customer Zero Case Study using Zafin AIOS

    Oct 23, 2026Shahir Daya, Rob Dunlap, Alexandre Boulenger +2Agentic WorkflowsAI-Assisted Software Development

    Chief Technology Officer, Zafin, Toronto, Ontario, Canada. · Chief Product Officer, Zafin, Toronto, Ontario, Canada. · Head of AIOS Product Innovation, Zafin, Dubai, Dubai, United Arab Emirates (UAE). +1

  8. CRM-Agent-Bench: Benchmarking Tool-Using Agents in Stateful Enterprise Environments

    Oct 23, 2026Monojit Banerjee, Zhujun Lan, Defu CaoAI Agent BenchmarksEnterprise AI Agents

    Salesforce, Inc.

  9. Contestable Agents for Data Governance: Recording Human Stewardship of AI-Generated Metadata Across Structured and Unstructured Systems

    Oct 22, 2026Humza Akhtar, Brian FreemanAI Agent GovernanceAI Governance

    Industry Solutions, MongoDB, Inc. · Advanced Concepts & Capabilities, Trane Technologies

  10. Superintelligent Software Engineering: Governance That Scales with Capability

    Oct 22, 2026Mohammad Mehdi GholinejadSoftware EngineeringAI Agent Governance

    OSTEON Labs

  11. SCOPE: Compiling Natural-Language Policies into Neurosymbolic Predicate Programs

    Oct 22, 2026Arnon Mazza, Elad LeviLLM Safety MonitoringAI Agent Governance

    Plurai

  12. Governed Self-Evolution for Autonomous Investing: A Multi-Agent LLM System with an Invariant Core

    Oct 22, 2026Yebo Feng, Jingyang Dai, Liangrui Pan +3Self-Evolving AgentsMulti-Agent LLM Systems

    Nanyang Technological University Singapore, Singapore · University College London London, United Kingdom

  13. A Three-Pillar Governance Framework for Safe and Trustworthy AI Agents

    Oct 21, 2026Edward C. Cheng, Jeshua Cheng, Alice SiuAI Agent GovernanceAI Agent Safety

    Management Science & Engineering, Stanford University, Stanford, California, United States · AI Laboratory, Inquiryon, Inc., South San Francisco, California, United States · Deliberative Democracy Lab, Stanford University, Stanford, California, United States

  14. Agentic Architecture of Information Systems. The AAM/5C Model: A Reference Model for Distributed Autonomy

    Oct 21, 2026Laurent GoujonAI Agent GovernanceDistributed Control

    IBM France

  15. Proof-Carrying Contracts: Commitments AI Agents Cannot Break

    Oct 20, 2026Carlo Ciliberto, Alessandro Rudi, Enrico TassiRuntime Enforcement for AI AgentsAI Agent Safety

    AI Centre, Computer Science Department, University College London, London, UK · Praxis Lab, The Italian Institute of Artificial Intelligence (AI4I), Turin, Italy · SDA Bocconi School of Management. Milano, Italy +1

  16. Recoverability and Verifier Strength: Two Measured Preconditions for Unattended Agent Self-Improvement

    Oct 20, 2026De Wang, Peng QiLLM Agent Self-ImprovementSelf-Improving Agents

    Uniphore

  17. TCMScience: An Autonomous Scientist for Traditional Chinese Medicine

    Oct 17, 2026Yanlan Kang, Ruiqi Liu, Xinpei Gu +4AI Agents for Scientific DiscoveryScientific Workflow Automation

    Institute of Medical Philosophy & Future AI (IMPF-AI) · Shanghai Medical College, Fudan University · Guangdong Provincial Key Laboratory of New Drug Screening and Guangdong–Hong Kong–Macao Joint Laboratory for New Drug Screening, School of Pharmaceutical Sciences, Southern Medical University +4

  18. Cortex: A Fixed-Point Theory of Governed Coding Agents - Technical Report

    Oct 16, 2026Marius-Constantin Dinu, Florian ZebaAI Coding AgentsAI Agent Governance

    Alpha Omega Labs

  19. Provable Authority: A Protocol for Verifiable Authority Resolution and Control Across Human, Organizational, and Agentic Transactions

    Oct 16, 2026Jeremy Blackburn, Tim Hines, Matthew Koepp +2AI Agent GovernanceRuntime Enforcement for AI Agents

  20. Who May Release an Agent's Promise? Standing over Commitments in Multi-Party Chat

    Oct 15, 2026Lan Wei, Bingyu Shen, Jiaqi Tang +6LLM AgentsAI Agent Governance

    Department of Computer Science and Technology, Kean University, Union, NJ, USA · Independent Researcher · School of Computer Science, McGill University, Montreal, QC, Canada

  21. Task-State Governance: A Virtual Machine for Verifiable and Recoverable GUI Agent Execution

    Oct 14, 2026Wenkui Yang, Yiming Hao, Kai Zhou +6GUI AgentsAI Agent Governance

    SAIS, University of Chinese Academy of Sciences, Beijing, China · Institute of Automation, Chinese Academy of Sciences, Beijing, China · Meituan, Beijing, China +2

  22. Holding Agents Accountable with Verifiable Agent Insurance

    Oct 13, 2026Cheng Hua, Taro Tsuchiya, Nicolas Christin +1AI AccountabilityAI Agent Governance

    Carnegie Mellon University

  23. Agentic4PDM: Host-Governed Evidence Admissibility for Industrial Fault Diagnosis

    Oct 13, 2026Nam V. Nguyen, Hoang Van Truong, Hieu D. D. +3Industrial Fault DiagnosisAgentic Reasoning

    FPT Corporation · Independent Researcher · Aalborg University

  24. Who is the 'I' in AI? Establishing Decentralized Identity and Accountability for Autonomous Agents

    Oct 12, 2026Ahammod Munim Ramil, Khalid Al Kafi, M. A. Abdullahis Sany +4AI AccountabilityAI Agent Governance

    Department of Computer Science and Engineering, BRAC University, Dhaka, Bangladesh · School of Computing, Mathematics and Engineering, Charles Sturt University, Bathurst, New South Wales, Australia

  25. RelLedger: Relational Information Governance for LLM Agent Organizations

    Oct 12, 2026Junxi Huang, Wenshuo Chen, Nuoxuan Li +7AI Agent AuditingAI Agent Governance

    Xidian University · The Hong Kong University of Science and Technology (Guangzhou)

  26. Pollard: Governed Semantic Execution Trees for Framework-Independent AI Agent Control and Replay

    Oct 12, 2026Muntaser Syed, Marius C. SilaghiRuntime Enforcement for AI AgentsAI Agent Governance

    Florida Institute of Technology, Melbourne, Florida, USA

  27. Computational Reflective Equilibrium for Agentic AI: A Rawlsian Alignment Scaffold for Governance

    Oct 12, 2026Quanyan ZhuAI Agent GovernanceAI Alignment

    Department of Electrical and Computer Engineering, Tandon School of Engineering, New York University, Brooklyn, NY 11201, USA

  28. ANASSA: From High-Level Framework to Low-Level Architecture for Spatial Agentic AI

    Oct 9, 2026Constantinos Papantoniou, Brian HiltonAgentic WorkflowsAI Agent Governance

    Anassa.ai USA · Research Scientist USA

  29. SwingGuard: Risk-Conditioned Multi-Agent Swing Trading with Dual-Timescale Governance

    Oct 9, 2026Junzhou Su, Yichen Luo, Yebo Feng +2Algorithmic TradingAI Agent Governance

    Xidian University · University College London · The University of Hong Kong +1

  30. A Society of Researchers: Designing Institutions for Populations of Autonomous Research Agents

    Oct 7, 2026Ali Asaria, Deep Gandhi, Tony SalomoneMulti-Agent Resource AllocationAutonomous Research Agents

    Transformer Lab Canada