Overview

AI agent monitoring studies how to observe and assess agents while they use tools, pursue long-running tasks, and interact with other agents, so problems can be detected before they cause harm or waste. Common approaches include trajectory classifiers and LLM judges, early-warning models over trace prefixes, formal runtime checks and action gates, and telemetry or provenance systems that record what happened and why. Some work also uses internal activations, human-facing dashboards, and recovery or intervention mechanisms to complement external observation. A central challenge is making monitors timely and reliable across long contexts and adaptive attacks without excessive false alarms, cost, or loss of useful autonomy.

Latest papers

CardsList

300 papers26 papers in the last four weeks, down 51% on the four weeks before. 0.2% of all new papers.

  1. ConfGuard: a physics-grounded reference monitor for predictive-maintenance large-language-model agents

    Nov 17, 2026Arunkumar V, Gangadharan G. R., S. SenthilkumarAI Agent SecurityAI Agent Monitoring

  2. Controllable Chains of Thought Can Reveal Less, Even Without Evasion Training

    Nov 16, 2026Zheng-Xin Yong, Benjamin Arnav, Miles Wang +2AI Agent MonitoringCoT Monitoring

  3. Beyond Clumsy Agentic Tool Calling: How Cueing and Spotting Make the Difference

    Nov 14, 2026Xindi Yang, Yan Liu, Jiajun SunTool-Using AgentsLLM Agents

  4. Learn then Bet: Learning Interpretable Rules for Reliable Agent Intervention

    Nov 13, 2026You-Lin Chen, Xinyi Lisa Chen, Pedro Herrero-Vidal +3AI Agent MonitoringRuntime Enforcement for AI Agents

  5. Model-Free Runtime Measurement of Task-Relevant Information

    Nov 10, 2026Dimitris Panagopoulos, Adolfo Perrusquía, Yang Xing +1AI Agent MonitoringRobot Task Progress Estimation

  6. PegasusAI Studio: Legible Cyberinfrastructure and Accountable AI Agents for Scientific Workflows

    Nov 9, 2026Komal Thareja, Mats Rynge, Berent Aldikacti +12Scientific Workflow AutomationAI Coding Agents

  7. Do Benign-Trained Hidden-State Probes Detect Tool Errors Under Adversarial Conditions?

    Nov 8, 2026Bibek Bhandari, Kshitij LingthepAI Agent MonitoringHidden-State Probing

  8. What Do Collusion Probes Read? Three Pitfalls in Evaluating Multi-Agent Collusion Monitors

    Nov 7, 2026Mainul Hasan Mohsin, Mohammad Shahidur RahmanAI Agent MonitoringMulti-Agent System Security

  9. Signals: Continuous Diagnostics of AI Agents

    Nov 3, 2026Amey Rambatla, Vatsal Goel, Sagar Gaur +3AI Agent MonitoringAI Agent Evaluation

  10. From Watching to Steering: Enabling Human-Coding Agent Collaboration through Execution Traces

    Nov 3, 2026Xiaoke Yan, Jiaying Lei, Danqing Shi +2AI Coding AgentsLLM Agents

  11. What Standard Evaluations Hide About Detectors of Hijacked LLM Agents: Rare Attacks, Unseen Tools and Benchmark Transfer

    Oct 30, 2026Mahmoud Abbasi, Juan M. Núñez V., Amin ShahrakiLLM Agent SecurityAI Agent Monitoring

  12. Who Else Is In? Multi-Agent Collusion Initation Via Strategic Vagueness

    Oct 27, 2026Pramod Kaushik, Sarath Sivaprasad, Laura Ferrarotti +4Multi-Agent System SecurityMulti-Agent LLM Systems

  13. Babysitting AI Agents: A User-Centered Taxonomy and Study of Agentic Delegation Failures

    Oct 26, 2026Shravika Mittal, Sunnie S. Y. Kim, Scott Counts +3Agent Failure AnalysisAI Agent Reliability

  14. RIDAR: Safeguarding Research Integrity in Autonomous Research Agents via Automated Detection and Runtime Intervention

    Oct 22, 2026Jiening Siow, Amy Xin, Junjie Wang +7AI Agent MonitoringRuntime Enforcement for AI Agents

  15. Model Organisms of Collusion: Corrective Transfer in Untrusted Monitors

    Oct 22, 2026Juan-Pablo Rivera, Ari Spiesberger, Juan J Vazquez +6AI ControlLLM Safety Monitoring

  16. A Three-Pillar Governance Framework for Safe and Trustworthy AI Agents

    Oct 21, 2026Edward C. Cheng, Jeshua Cheng, Alice SiuAI Agent GovernanceAI Agent Safety

  17. COMET: A coordinated multi-layer runtime monitoring framework for human-supervised AI-enabled safety systems

    Oct 21, 2026Niclas Flehmig, Mary Ann Lundteigen, Shen YinAI SafetyAI Agent Monitoring

  18. RSI Control: Can AI Models Perform Covert Sabotage in the Self-Improvement Process?

    Oct 20, 2026Kaiwen Zhou, Udari Madhushani SehwagRecursive Self-ImprovementAI Control

  19. StopLoss: Teaching Agents to Predict Failure and Stop Early

    Oct 18, 2026Jiarong Liang, Xueguang Ma, Dongfu Jiang +3Early StoppingAI Agent Monitoring

  20. Mining the Self-Rewriting System: A Vision for Data Mining on AI-Native Infrastructure

    Oct 18, 2026Mayank Darbari, Chiman Salavati, Liang Wu +5Distribution ShiftAI Agent Monitoring