AI Agent Monitoring

Ask about this topic

Momentum

20 papers in the last four weeks, up 186% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 170

All topics
CardsList

  1. SwarmReconGuard: Black-Box Detection of Distributed Collective Reconnaissance by Individually Benign-Looking Agent Populations

    Oct 6, 2026Vahid Tavakkoli, Kabeh Mohsenzadegan, Kyandoghere KyamakyaAI Agent SecurityNetwork Intrusion Detection

    Institute for Smart System Technologies, University of Klagenfurt, Klagenfurt, Austria

  2. A Case Study in Assuring AI-Written Software

    Oct 6, 2026Lindsey Ferris, Sierra BonillaAI Agent ReliabilityAI Assurance

    Independent Researcher · University College London London, United Kingdom

  3. Before Agent Tells The Lie: Has Deception Already Been Represented?

    Oct 5, 2026Xinling Li, Dadi Guo, Qingyu Liu +5LLM InterpretabilityDeception in Language Models

    South China University of Technology · The Hong Kong University of Science and Technology · Shanghai Artificial Intelligence Laboratory +1

  4. AgentPrivArena: Evaluating and Auditing Real-world AI Agent Privacy

    Oct 5, 2026Shouju Wang, Haopeng ZhangAI Agent AuditingLLM Agent Evaluation

    University of North Carolina at Charlotte

  5. What Did the Agent Actually Do? Evidence-Grounded Oversight for Long-Horizon Agents

    Oct 5, 2026Zhongxiang Sun, Jiahao Yan, Hongkang Zhao +5Software Engineering AgentsHuman-in-the-Loop Evaluation

    Gaoling School of Artificial Intelligence, Renmin University of China · Kuaishou Technology

  6. Towards a Unified Misuse Monitoring Benchmark

    Oct 5, 2026Aniruddh Pramod, James Oldfield, Adel BibiAI Agent SecurityAI Agent Monitoring

    University of Oxford

  7. AgentSpy: Making AI Agent Behavior Observable

    Oct 5, 2026Christoph Bühler, Matteo Biagiola, Luca Di Grazia +1AI Agent ReliabilityAI Agent Auditing

    University of St. Gallen, St. Gallen, SG, Switzerland · University of St. Gallen and Università della Svizzera italiana (USI), St. Gallen and Lugano, SG and TI, Switzerland

  8. Representation Transitions Reveal Emerging Safety Risks in Multi-Turn LLM Agents

    Sep 30, 2026Haoyu Wang, Wei Zhao, Yedi Zhang +2AI Agent MonitoringLLM Agent Safety

    Singapore Management University · National University of Singapore

  9. Speculative Safety Honeypot: Toward Proactive Defense Against Multi-turn Agent Attacks

    Sep 30, 2026Zezhong Wang, Xueyang Tang, Rui Lian +2LLM Agent SecurityAI Agent Monitoring

    Huawei Technologies Co., Ltd, Hong Kong SAR.

  10. LLMs Learn to Evade Latent Monitors from Prior Feedback Alone

    Sep 29, 2026Hugo Lyons Keenan, Christopher Leckie, Sarah ErfaniLLM AuditingAdversarial Attacks on LLMs

    School of Computing and Information Systems The University of Melbourne, Victoria, Australia

  11. Improving scalable oversight with co-trained monitors

    Sep 28, 2026Joseph H. Rudoler, Kevin Tan, Benedict Tessler +2Scalable OversightAdversarial Robustness

    University of Pennsylvania

  12. ResonAct: Streaming Metrics for Runtime Diagnosis and Self-Healing in Multi-Agent Systems

    Sep 28, 2026Tarun Chintada, Neelamadhav Gantayat, Ishaan Romil +3Agent Failure AnalysisAI Agent Monitoring

    IBM, India · Indian Institute of Technology Patna, India · International Institute of Information Technology Hyderabad, India

  13. AgentWare: Automating the Lifecycle of Agentic Applications across the Edge-to-Cloud Continuum

    Sep 28, 2026Michalis Kasioulis, Moysis Symeonides, George Pallis +1LLM Agent OrchestrationLLM Agent Evaluation

    Department of Computer Science, University of Cyprus

  14. LLM Agents Can Easily Tamper With Their Own Traces

    Sep 24, 2026Jeremy Qin, David Schmotz, Derck Prinzhorn +3AI Agent AuditingAI Agent Security

    ELLIS Institute Tübingen · Max Planck Institute for Intelligent Systems · Tübingen AI Center +3

  15. On the Effectiveness of Kernel-Level Evidence for Agent Security

    Sep 24, 2026Spencer King, Zhilu Zhang, Mikhail Kuznetsov +3AI Agent SecurityAI Agent Security Benchmarks

    University of Georgia · Amazon Web Services

  16. Compliant with Local Controls, Collectively Discriminatory. A Governance Architecture for Multi-Agent AI in Regulated Finance

    Sep 23, 2026Jose Manuel de la Chica Rodriguez, Juan Manuel Vera Diaz, Pablo Delgado RomeroFinancial ServicesAlgorithmic Fairness

    Santander AI Lab, Grupo Santander, Madrid, Spain

  17. When Are Aggregate Agent Traces Diagnosable? Traffic-Governed Interpretation and Calibrated Abstention

    Sep 22, 2026Peiying Zhu, Sidi ChangAgent Failure AnalysisSelective Prediction

    Blossom AI San Francisco, CA, USA

  18. Monitorable Chart Reasoning Agents via Verifiable Process Rewards

    Sep 21, 2026Sanchit Sinha, Oana Frunza, Kashif Rasul +1AI Agent MonitoringReinforcement Learning with Verifiable Rewards

    University of Virginia, Charlottesville, VA, USA · Morgan Stanley, USA

  19. Red-Teaming Auto Mode: Improving Blocking Classifiers Against Malign Coding Agents

    Sep 17, 2026Alex Remedios, Simon Storf, Fabien Roger +1AI Agent SecurityAI Agent Monitoring

    Anthropic Fellows Program · Anthropic

  20. Compositional Policy Violations: When Step-Level Compliance Fails In Agentic AI Workflows

    Sep 16, 2026Ashwini Kurady, Sri Sai Charith Grandhi, Rajesh Gupta +1Agentic WorkflowsAI Agent Monitoring

    RunCtrl

  21. Reality Is the Final Verifier: On Two Key Gaps in Agentic Software Engineering

    Sep 14, 2026Alexander Krentsel, Shubham Agarwal, Mert Cemri +5AI Agent ReliabilitySoftware Engineering Agents

    UC Berkeley

  22. AI Safety: Not Optional, Not Later

    Sep 14, 2026Qinghua Lu, Yoshua BengioAI AssuranceAI Accountability

    CSIRO, Australia · LawZero, Canada · Université de Montréal, Canada +1

  23. DynSTEER: Dynamic Stage-wise Trajectory Evaluation and Execution-time Review for Agents

    Sep 13, 2026Zhichao Shi, Xuhui Jiang, Wenjie Zhang +5LLM Agent EvaluationAI Agent Evaluation

    School of Advanced Interdisciplinary Sciences, UCAS · State Key Lab of AI Safety, Institute of Computing Technology, CAS · DataArc Tech Ltd. +3

  24. BenchShield: Formal Model-Backed Instrumentation for Reward Integrity in LLM-Agent Evaluation Infrastructure

    Sep 12, 2026Shenghan Zheng, Zonglin Di, Yimin Liu +19Reward HackingLLM Agent Evaluation

    Dartmouth College · Independent · Ohio State University +10

  25. DriftNet: A Dual-Head Trajectory Transformer for Detecting and Localizing Prompt Injection in LLM Agents

    Sep 12, 2026Asif Pinjari, Mithun Paul Saint-GermainAI Agent Security BenchmarksAI Agent Monitoring

    School of Informatics, Computing, and Cyber Systems Northern Arizona University Flagstaff, AZ, USA

  26. Do Agents Know When They Succeed? Calibrating Agent Confidence from Internal Representations

    Sep 10, 2026Priyanka Mary Mammen, Emil Joswin, Srujananjali MedicherlaAI Agent MonitoringRepresentation Probing

    UMass Amherst · Independent Research

  27. SchemeArena: Factorized Stress Testing of Scheming in LLM Agents

    Sep 8, 2026Jie Ruan, Inderjeet Nair, Amy Liu +3LLM Agent EvaluationAI Agent Monitoring

    Computer Science and Engineering University of Michigan Ann Arbor, MI 48109, USA

  28. DNative-Twin: Decision Graphs and Digital Twins for Reconstructable Agentic Decisions

    Sep 3, 2026Junjie Pang, Zhenzhen Xie, Haoke Han +3Data ProvenanceAI Agent Auditing

    Qingdao University, Qingdao, China · Shandong University, Qingdao, China · Hangzhou Shujiao Technology Partnership (Limited Partnership), Hangzhou, China +1

  29. You Can't Escape Your Own Activations : Evaluation Awareness and Multi-Agent Monitoring

    Sep 2, 2026Aritra Das, Jaee Ponde, Mihir More +1AI Agent MonitoringMulti-Agent System Security

    Truth Audit Labs

  30. Monitoring Web Agents Without Internal Signals: Observable Trajectories and Key-Step Supervision

    Sep 2, 2026Sitong Pan, Yipeng Shen, Yilin Lu +3AI Agent MonitoringProcess Supervision

    University of Minnesota · 2Purdue University · 3The Pennsylvania State University

  31. Agent Flight Recorder: Tamper-Evident Audit Trails with On-Chain Anchoring for Long-Horizon Tool-Using Agents

    Sep 1, 2026Laurent Bindschaedler, Quentin Botha, Christoph SiebenbrunnerData ProvenanceAlgorithmic Auditing

    Max Planck Institute for Software Systems · Research Institute for Cryptoeconomics, Vienna University of Economics and Business

  32. Parsing the Stream: A Live Trace Model for Long-Horizon Agents and Their Observers

    Sep 1, 2026Egor Pakhomov, Erik NijkampLong-Horizon Agent EvaluationAI Agent Monitoring

    Salesforce AI Research

  33. CatchBench: When Can an Agent Failure Be Caught?

    Aug 24, 2026Yue Zhao, Mengyuan Li, Ruolin Li +5Agent Failure AnalysisBenchmark Auditing

    University of Southern California · Carnegie Mellon University · AWS Agentic AI +3

  34. Agent Safety Should Be a Runtime Contract

    Aug 11, 2026Albus W. Ng, Yi Han, Jusheng Zhang +1AI Agent SafetyAI Agent Monitoring

    1Vast Intelligence Lab · 2Southwest University · 3Sun Yat-sen University

  35. Evidence-Calibrated Runtime Reconstruction for Agent Skills Across Heterogeneous Coding Agents

    Aug 9, 2026Xueping GaoAI Coding AgentsAI Agent Monitoring

    Alibaba Cloud, Hangzhou, China

  36. TelemetrySuffBench: Is Agent Telemetry Sufficient for Failure-Origin Diagnosis?

    Aug 8, 2026Yuxuan Zhu, Peng PuSelective PredictionFault Detection

    School of Data Science and Engineering East China Normal University Shanghai, China

  37. Online Monitoring and Corrective Steering of Programming Agents

    Aug 7, 2026Shuyang Liu, Saman Dehghan, Ji Young Kim +3Software Engineering AgentsLLM Agent Workflow Optimization

    University of Illinois Urbana-Champaign, USA · IBM, USA

  38. TRACE: A Multi-Layer Benchmark for Human AI Controller Coordination Under Drift and Failure

    Aug 7, 2026Joshua Zuniga, Srinivasan Subramanian, Ramya Madhuri Narapureddy +1Agent Failure AnalysisAI Agent Benchmarks

    College of Computing and Software Engineering Kennesaw State University Marietta, GA, USA

  39. ChainClaw: A Layered Agent Framework for Reliable On-Chain Execution

    Aug 6, 2026Jiacheng Wei, Zhaoxin Fan, Xin Wen +5LLM Agent OrchestrationAI Agent Monitoring

    Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University, Beijing, China · School of Artificial Intelligence, Beihang University, Beijing, China · Zhongguancun Laboratory, Beihang University, Beijing, China +1

  40. Fail-Fast, Restart-Smart: Early Failure Prediction and Restart for SWE Agentic Tasks

    Aug 4, 2026Chenyu Wang, Yunbo Lyu, Junda He +4Software Engineering AgentsAI Agent Monitoring

    Singapore Management University · University of Alberta · Nanjing University of Science and Technology +1

  41. Magnet: Detecting Cross-Session AI Misuse Through Capability Accumulation

    Aug 3, 2026Natalie Isak, Matthew DressmanAI Agent SecurityAI Agent Monitoring

  42. Real-Time Detection and Repair of LLM Agent Failures

    Aug 3, 2026Sunny DubeyAI Agent ReliabilityAI Agent Monitoring

  43. Steganalysis of Adaptive Covert Collusion in Tool-Using Agent Populations: A Black-Box, Cross-Principal Approach

    Aug 3, 2026Mohamed Chahine GhanemAlgorithmic CollusionAI Agent Monitoring

    Keele University, Newcastle-Under-Lyme, U.K.

  44. Why Formal Monitors Fail: Attack Distribution Entropy as a Coverage Bound for LTL-Based LLM Agent Safety

    Aug 2, 2026Ruiyang ZhangFormal VerificationAI Agent Monitoring

    Ryonix Labs Inc. Flock.io

  45. Beyond Component Testing: Validating Agentic AI Systems

    Jul 31, 2026Fabio Orazio Mirto, Luca D'Agati, Giuseppe Tricomi +4AI Agent EvaluationAI Agent Safety

    Department of Biomedical, Dental, and Morphological and Functional Imaging Sciences, University of Messina, A.O.U. Policlinico “G.Martino” - Via Consolare Valeria, Messina, 98125, Italy. · Department of Engineering, University of Messina, Contrada di Dio, Sant’Agata, Messina, 98158, Italy. · Institute for High Performance Computing and Networking of National Research Council of Italy, ICAR-CNR, Via Pietro Castellino 111, Naples, 80131, Italy. +1

  46. SARC-DQ: Runtime Data-Quality Gating for Agentic AI: Silent Evidence Defects, the Incompetence Shield, and Downstream-Only Remediation

    Jul 28, 2026Gaston BesansonAI Agent ReliabilityData Provenance

    Universidad Torcuato Di Tella

  47. AgentGUI: An Interface for Observing and Steering Long-Running AI Agents

    Jul 28, 2026Xuan Zhao, Jiwoong Sohn, Qinyue Zheng +1GUI AgentsHuman-in-the-Loop AI

    ETH Zürich · ETH AI Center

  48. Toward Standardized Cross-Vendor Agent Tool Trust Management in Autonomous Networks

    Jul 28, 2026Ravi Kant Sharma, Ashutosh Uttam, Ajay KumarAI Agent SecurityAI Agent Monitoring

    Ericsson

  49. Early Detection of Distributed Backdoors in Multi-Agent LLM Systems: A Characterization Study

    Jul 27, 2026Diego Fernandez Arias, Dev Prashant Mistry, Ren Wang +1Multi-Agent LLM SystemsLLM Backdoor Attacks

    Illinois Institute of Technology Chicago, Illinois, USA

  50. Mission-Level Runtime Assurance for LLM-Assisted ISR Swarms over a Verification-Aware Fabric

    Jul 26, 2026Nikolaos Kekatos, Panagiotis Katsaros, Alexios Lekidis +2Swarm RoboticsAI Agent Monitoring

    Clone Systems, Larnaca, Cyprus · Aristotle University of Thessaloniki, Thessaloniki, Greece · University of Thessaly, Larissa, Greece

  51. Toward Continuous Assurance for the Democratization of AI Agent Creation in Industry

    Jul 23, 2026Natan Levy, Harel BergerAI Agent ReliabilityAI Agent Monitoring

    School of Computer Science and Engineering · The Department of Computer and Software Engineering

  52. Clinical Pathways as Safety Specifications for Physical AI in Hospital Wards

    Jul 22, 2026Gabriele Franchini, Giulio Mallardi, Michele De Carolis +1Cyber-Physical SystemsAI Agent Monitoring

    Computer Science Dept. University of Bari Bari, Italy

  53. ResearchArena: Evaluating Sabotage and Monitoring in Automated AI R&D

    Jul 21, 2026Lena Libon, Ben Rank, Jehyeok Yeon +5AI Agent MonitoringAI Control

    ELLIS Institute Tübingen, Max Planck Institute for Intelligent Systems, Tübingen AI Center · ETH Zurich · University of Amsterdam

  54. AgentDebugX: An Open-Source Toolkit for Failure Observability, Attribution, and Recovery in LLM Agents

    Jul 21, 2026Kunlun Zhu, Xuyan Ye, Zhiguang Han +9Agent Failure AnalysisAI Agent Reliability

    University of Illinois Urbana-Champaign · University of Toronto · Google +1

  55. ChainWatch: A Kill Chain-Aligned Sequential Detection Framework for Multi-Step Attacks in MCP-Based AI Agent Systems

    Jul 20, 2026Om Narayan, Rashmi Jyoti, Ramkinker SinghMCP SecurityAI Agent Security

    Computer Science New York University New York, USA · Cybersecurity University of Maryland, College Park MD, USA · Carnegie Mellon University Pittsburgh, USA

  56. Operational Hallucination and Safety Drift in AI Agents

    Jul 20, 2026Shasha Yu, Fiona Carroll, Barry L. BentleyLLM Agent EvaluationAI Agent Safety

    Cardiff School of Technologies, Cardiff Metropolitan University Cardiff, UK · Harvard Medical School, Harvard University Boston, USA

  57. Proof-or-Stop: Don't Trust the Agent, Trust the Evidence -- Loop Engineering for Verifiable Evidence-Gated Lifecycle Control

    Jul 16, 2026Jek Huang, Jeffery Hsia, Jiayi Sun +3Software Engineering AgentsAI Agent Monitoring

    Prodenovo

  58. Democratizing Agent Deployment Safety: A Structural Monitoring Approach

    Jul 16, 2026Preeti Ravindra, Rahul Tiwari, Vincent WolowskiSoftware Engineering AgentsAI Agent Security

    1Independent

  59. Towards an Intention Abstraction Layer for Autonomous Industrial Systems

    Jul 16, 2026Artan Markaj, Raphael Höfer, Felix GehlhoffAI Agent MonitoringMulti-Agent Systems

    Eurogate GmbH & Co. KGaA, KG Hamburg, Germany · Helmut Schmidt University Hamburg Hamburg, Germany

  60. Traccia: An OpenTelemetry-Based Governance Platform for AI Systems

    Jul 15, 2026Nutan Kumar Naik, Aditya Kumar Saroj, Vijay Prasad Poudel +2AI AccountabilityAI Agent Monitoring

    Department of Earth and Atmospheric Sciences National Institute of Technology Rourkela Odisha, India · Algen.AI2026 Bengaluru, Karnataka, India