Overview

AI agent auditing studies whether autonomous systems follow their instructions and policies as they use tools, exchange information, and change external state. Researchers combine trace analysis, runtime monitoring and authorization, static and dynamic security testing, adversarial benchmarks, and tamper-evident logs to detect violations and reconstruct how they occurred. A central lesson is that correct final answers or benchmark scores do not establish safe or faithful execution; audits increasingly examine intermediate decisions, permissions, evidence provenance, and effects on the environment. The field still faces challenges in obtaining complete, independent records and reliable evaluators, while balancing stronger oversight with task utility, cost, and agent autonomy.

Latest papers

CardsList

312 papers54 papers in the last four weeks, down 44% on the four weeks before. 0.4% of all new papers.

  1. Choosing What to Observe: Budget-Paired Counterfactual Audits for Credible Evaluation of Visual Agents

    Nov 18, 2026Ruiqi Liu, Jinming Li, Mo Wang +2Process-Based Agent EvaluationAI Agent Auditing

  2. Auditable Clinical Support with Decision Agents

    Nov 18, 2026Tiancheng Bao, Riga Wu, Jan Wienhold +13Medical AI AgentsClinical Decision Support

  3. RagHarnessDebugger: Jev-Guided Agentic RAG in Contract Inference Repair Auditing

    Nov 17, 2026Moriya Dechtiar, Daniel Martin Katz, Michael J. Bommarito +2Agentic RAGAI Agent Auditing

  4. VITAL: A Framework for Validating Agentic AI in Pharmaceutical Drug Development and Clinical Trial Operations

    Nov 17, 2026Sandeep Burugupalli, Pedro Matos-Filipe, Andrea Hita Ardiaca +10AI Agent GovernanceAI Agent Auditing

  5. Agent Trajectories as Evidence for Software Quality Assurance

    Nov 17, 2026Jonathan Ullrich, Julien Siebert, Michael Kläs +2Software EngineeringAgent Trajectory Analysis

  6. Where Does Hindsight Enter Clinical Agent Benchmarks? An Audit of Simulators and Case Construction

    Nov 17, 2026Meilu Zhu, Xiaohan Li, Axiu MaoLLM Agent EvaluationBenchmark Validity

  7. DiscoveryAgent: A Framework for Scientist-centric Agentic AI

    Nov 16, 2026Owen Queen, Ioana Ciuca, Emma Dann +9AI-Assisted Scientific ResearchAutonomous Research Agents

  8. Auditors Struggle to Catch Sabotage In End-to-End Transcripts of AI Safety Research

    Nov 16, 2026Keshav Shenoy, Anthony Zang, Eric Gan +5AI Agent AuditingAI Safety Evaluation

  9. Corrupting Ties: Investigating Robustness to Bias Injection Across Multi-Agent Network Topologies

    Nov 16, 2026Cléa Chataigner, Mina Arzaghi, Florian Carichon +2Multi-Agent LLM SystemsMulti-Agent Systems

  10. Auditable Authorization for LLM Agents: Empirical Evidence Across Model, Harness, and Workflow Layers

    Nov 14, 2026Bangjie Deng, Xiaoxuan Lu, Wenjun Chen +8AI Agent AuditingHuman Oversight of AI

  11. Context Graph: Explainable Multi-Agent Decision Chains in AI-RAN

    Nov 12, 2026Xijun Wang, Zhaoyang Liu, Xiang Chen +2Explainable Artificial IntelligenceAI Agent Auditing

  12. MobileProbe: Adaptive Security Evaluation of Mobile Agents via Trajectory-Aware Injection

    Nov 12, 2026Yingbin Jin, Ji'an Wang, HaoYang Chai +7AI Agent AuditingMobile GUI Agents

  13. guardscope: Measuring Which Actions Runtime Controls Check in LLM Agent Systems

    Nov 11, 2026Kentaroh Toyoda, Alex Leung, Bhuvaneswari URuntime Enforcement for AI AgentsAI Agent Auditing

  14. Mitigating Agentic Deception via Evaluation-Side Partially Observable Games

    Nov 9, 2026Hanxiao Li, Shutong Liu, Yongjia Ma +11Deception in Language ModelsProcess-Based Agent Evaluation

  15. Trust, but verify, audit and attribute: a human-in-the-loop framework for checking AI-produced research results

    Nov 9, 2026György Eigner, Patrik P. Süli, Roland HollósHuman Oversight of AIAI Agent Auditing

  16. Publications as benchmarks: auditing AI agents on spatial transcriptomics alignment

    Nov 9, 2026Yiqun T. Chen, Jan Matthias, Jianing Yao +2Scientific Agent BenchmarksAI Agent Auditing

  17. ErosionBench: Probing Alignment Decay in Enterprise Multi-Agent Systems

    Nov 8, 2026Riya Bharathwaj, Akshara Prabhakar, Roshan Ram +4AI Agent Safety BenchmarksMulti-Agent LLM Systems

  18. Do Benign-Trained Hidden-State Probes Detect Tool Errors Under Adversarial Conditions?

    Nov 8, 2026Bibek Bhandari, Kshitij LingthepAI Agent MonitoringHidden-State Probing

  19. Knowing When to Intervene: Causal Evaluation of AI Agents

    Nov 6, 2026Ayush Sawarni, Wenqian Xing, Tijana Zrnic +2AI Agent EvaluationAI Agent Auditing

  20. Incentive Pathologies in a Live LLM Agent Arena: An Empirical Study of Concentration, Reward-Rule Implementation Discrepancy, and Network Dilution

    Nov 6, 2026Lei Zhenbing, Lei ChangAI Agent AuditingAI Agent Governance

  21. Auditable Human-Agent Teams for Autonomous X-ray Experimentation

    Nov 6, 2026Gunik Luthra, Ronald J. Pandolfi, Benjamin T. Diroll +6AI Agents for Scientific DiscoveryAutonomous Experimentation

  22. ChemE-as-Code: An Open-Source Platform for Agentic AI in Chemical Engineering

    Nov 5, 2026Artur M. SchweidtmannAgentic AIAI Agent Auditing