AI Agent Monitoring

Ask about this topic

Overview

AI agent monitoring studies how to observe and assess agents while they use tools, pursue long-running tasks, and interact with other agents, so problems can be detected before they cause harm or waste. Common approaches include trajectory classifiers and LLM judges, early-warning models over trace prefixes, formal runtime checks and action gates, and telemetry or provenance systems that record what happened and why. Some work also uses internal activations, human-facing dashboards, and recovery or intervention mechanisms to complement external observation. A central challenge is making monitors timely and reliable across long contexts and adaptive attacks without excessive false alarms, cost, or loss of useful autonomy.

Latest papers

CardsList

285 papers51 papers in the last four weeks, up 55% on the four weeks before. 0.3% of all new papers.

  1. Self-Attribution Bias: When AI Monitors Go Easy on Themselves

    Mar 4, 2026Dipika Khullar, Jack Hopkins, Rowan Wang +1AI Agent MonitoringLanguage Model Self-Assessment

    MATS · Anthropic

  2. Cross-Layer Semantic Flow Reconstruction for Attack Detection in Agentic Systems

    Mar 4, 2026Qizhi Cai, Yangyang Wei, Zhipeng Chen +2AI Agent SecurityLLM Agent Security

    Department of Software Technology, Zhejiang University, Ningbo, China · Department of Computer Science and Technology, Zhejiang University, Hangzhou, China

  3. The Controllability Trap: A Governance Framework for Military AI Agents

    Mar 3, 2026Subramanyam SahooAI Agent GovernanceAI Governance

    MARS (Mentorship for Alignment Researchers) 4.0 Fellow Cambridge AI Safety Hub (CAISH) University of Cambridge

  4. Beyond the 'Diff': Addressing Agentic Entropy in Agentic Software Development

    Mar 3, 2026Matteo Casserini, Alessandro Facchini, Andrea FerrarioAI Agent MonitoringSoftware Engineering Agents

    Dipartimento Tecnologie Innovative, SUPSI, Switzerland · Dalle Molle Institute for Artificial Intelligence (IDSIA), SUPSI, Switzerland · Management in Networked and Digital Societies (MINDS) Department, Kozminski University, Poland +2

  5. Constitutional Black-Box Monitoring for Scheming in LLM Agents

    Feb 28, 2026Simon Storf, Rich Barton-Cooper, James Peters-Gill +1AI Agent MonitoringLLM Agent Safety

    MATS Research · Independent · Apollo Research

  6. AI Runtime Infrastructure

    Feb 28, 2026Christopher CruzRuntime Enforcement for AI AgentsLLM Agent Workflow Optimization

  7. The Alignment Flywheel: A Governance-Centric Hybrid MAS for Architecture-Agnostic Safety

    Feb 28, 2026Elias Malomgré, Pieter SimoensAI Agent SafetyAI Agent Monitoring

    IDLab, Ghent University - imec, Belgium

  8. A Mathematical Theory of Agency and Intelligence

    Feb 26, 2026Wael Hafez, Chenan Wei, Rodrigo Pena +2AI Agent Monitoring

    Stiles-Nicholson Brain Institute, Jupiter, FL, USA

  9. Training Agents to Self-Report Misbehavior

    Feb 25, 2026Bruce W. Lee, Chen Yueh-Han, Tomek KorbakAI Agent SafetyLLM Agent Training

    UPenn · MATS · NYU +1

  10. When can we trust untrusted monitoring? A safety case sketch across collusion strategies

    Feb 24, 2026Nelson Gardner-Challis, Jonathan Bostock, Georgiy Kozhevnikov +4AI Agent MonitoringAI Safety

    LASR Labs · Imperial College London · University of Wyoming +2

  11. Wink: Recovering from Misbehaviors in Coding Agents

    Feb 19, 2026Rahul Nanda, Chandra Maddila, Smriti Jha +3LLM Agent ReliabilityAgent Reliability

    Meta Platforms, Inc. New York, NY, USA · Meta Platforms, Inc. Bellevue, WA, USA · Meta Platforms, Inc. Menlo Park, CA, USA

  12. StepShield: When, Not Whether to Intervene on Rogue Agents

    Jan 29, 2026Gloria Felicia, Zitha Sasindran, Jinfeng He +3LLM GuardrailsAI Agent Security

    University of Virginia · Indian Institute of Science Bangalore · Indian Institute of Science, Bangalore +5

  13. PAIR-SAFE: A Paired-Agent Approach for Runtime Auditing and Refining AI-Mediated Mental Health Support

    Jan 19, 2026Jiwon Kim, Violeta J. Rodriguez, Dong Whi Yoo +2Mental Health Conversational AgentsAI Agent Auditing

    University of Illinois Urbana-Champaign · Indiana University Indianapolis

  14. Measuring Harmfulness of Computer-Using Agents

    Jul 31, 2025Aaron Xuxiang Tian, Ruofan Zhang, Janet Tang +3LLM Agent SafetyComputer-Use Agent Benchmarks

    Independent Researcher · Arizona State University · Gradient +1

  15. Towards Mitigation of Hallucination for LLM-empowered Agents: Progressive Generalization Bound Exploration and Watchdog Monitor

    Jul 21, 2025Siyuan Liu, Wenjing Liu, Zhiwei Xu +3LLM Hallucination MitigationHallucination in Language Models

    College of Computer Science, Nankai University · College of intelligent Science and Technology, Inner Mongolia University of Technology · Institute of Computing Technology, Chinese Academy of Sciences +3