Overview

AI agent auditing studies whether autonomous systems follow their instructions and policies as they use tools, exchange information, and change external state. Researchers combine trace analysis, runtime monitoring and authorization, static and dynamic security testing, adversarial benchmarks, and tamper-evident logs to detect violations and reconstruct how they occurred. A central lesson is that correct final answers or benchmark scores do not establish safe or faithful execution; audits increasingly examine intermediate decisions, permissions, evidence provenance, and effects on the environment. The field still faces challenges in obtaining complete, independent records and reliable evaluators, while balancing stronger oversight with task utility, cost, and agent autonomy.

Latest papers

CardsList

312 papers54 papers in the last four weeks, down 44% on the four weeks before. 0.4% of all new papers.

  1. Auditing Cascading Risks in Multi-Agent Systems via Semantic-Geometric Co-evolution

    Mar 4, 2026Zixun Luo, Yuhang Fan, Hengyu Lin +2Ollivier-Ricci CurvatureMulti-Agent LLM Systems

  2. DUCX: Decomposing Unfairness in Tool-Using Chest X-ray Agents

    Feb 28, 2026Zikang Xu, Ruinan Jin, Xiaoxiao LiAlgorithmic FairnessAlgorithmic Bias

  3. A Framework for Assessing AI Agent Decisions and Outcomes in AutoML Pipelines

    Feb 25, 2026Gaoyuan Du, Amit Ahlawat, Xiaoyang Liu +1AI Agent EvaluationAI Agent Auditing

  4. OpenPort Protocol: A Security Governance Specification for AI Agent Tool Access

    Feb 22, 2026Genliang Zhu, Chu Wang, Ziyuan Wang +2Tool Access Control for LLM AgentsAI Agent Governance

  5. The Convergence of Schema-Guided Dialogue Systems and the Model Context Protocol

    Feb 21, 2026Andreas SchlapbachLLM Tool UseModel Context Protocol

  6. The 2025 AI Agent Index: Documenting Technical and Safety Features of Deployed Agentic AI Systems

    Feb 19, 2026Leon Staufer, Kevin Feng, Kevin Wei +6AI Agent AuditingAI Agent Safety

  7. Colosseum: Auditing Collusion in Cooperative Multi-Agent Systems

    Feb 16, 2026Mason Nakamura, Abhinav Kumar, Saswat Das +5Multi-Agent LLM SystemsMulti-Agent Systems

  8. Towards Selection as Power: Bounding Decision Authority in Autonomous Agents

    Feb 16, 2026Jose Manuel de la Chica Rodriguez, Juan Manuel Vera DíazAI Agent GovernanceRuntime Enforcement for AI Agents

  9. PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support

    Jan 19, 2026Jiwon Kim, Violeta J. Rodriguez, Dong Whi Yoo +2Mental Health Conversational AgentsAI Agent Auditing