AI Agent Monitoring

Follow this topic Ask about this topic

Momentum

20 papers in the last four weeks, up 186% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 170

All topics

Surviving the Unseen: Predictive Defense for Novel Multi-Turn Multimodal Attacks
May 18, 2026Doohee YouAdversarial Attacks on VLMs Multimodal Robustness
Trust and Safety, Google
SLEIGHT-Bench: A Benchmark of Evasion Attacks Against Agent Monitors
May 15, 2026Elle Najt, Colin Toft, Tyler Tracy +2Software Engineering Agents Adversarial Attacks
1Anthropic Fellows Program · University of Waterloo · 3Redwood Research +1
Formal Methods Meet LLMs: Auditing, Monitoring, and Intervention for Compliance of Advanced AI Systems
May 15, 2026Parand A. Alamdari, Toryn Q. Klassen, Sheila A. McIlraithLLM Auditing Formal Verification
University of Toronto, Vector Institute, Canada
Who Owns This Agent? Tracing AI Agents Back to Their Owners
May 15, 2026Ruben Chocron, Doron Jonathan Ben Chayim, Eyal Lenga +3AI Accountability LLM Agent Security
Ben-Gurion University of the Negev Beer-Sheva, Israel · Center for Cybersecurity Systems & Networks, Amrita Vishwa Vidyapeetham Amritapuri, India · Northeastern University Boston, Massachusetts, USA
Ensemble Monitoring for AI Control: Diverse Signals Outweigh More Compute
May 14, 2026Eugene Koran, Yejun Yun, Samantha Tetef +2AI Agent Monitoring AI Control
SPAR · Yale University
AI Knows When It's Being Watched: Functional Strategic Action and Contextual Register Modulation in Large Language Models
May 14, 2026Vinicius Covas, Jorge Alberto Hidalgo ToledoLLM Auditing AI Agent Monitoring
Center for Applied Communication Research (CICA)
Trustworthy Multi-Agent Systems: Mitigating Semantic Drift with the Argent Signaling Protocol
May 14, 2026Anantha SharmaAI Agent Reliability Multi-Agent LLM Systems
Synechron Inc · Charlotte, NC, USA
In-IDE Toolkit for Developers of AI-Based Features
May 14, 2026Yaroslav Sokolov, Yury Khudyakov, Lenar Sharipov +3AI Agent Monitoring Automated Evaluation
JetBrains Berlin, Germany · JetBrains Munich, Germany · JetBrains Amsterdam, Netherlands +1
How to Interpret Agent Behavior
May 13, 2026Jie Gao, Kaiser Sun, Jen-tse Huang +8Hierarchical Classification AI Agent Monitoring
1Johns Hopkins University · 2California Institute of Technology · 3Northeastern University +1
Runtime Monitoring of Perception-Based Autonomous Systems via Embedding Temporal Logic
May 12, 2026Parv Kapoor, Abigail Hammer, Ashish Kapoor +2Signal Temporal Logic AI Agent Monitoring
Software and Societal Systems Department Carnegie Mellon University · General Robotics · Aeronautics and Astronautics Department University of Washington
Classifier Context Rot: Monitor Performance Degrades with Context Length
May 12, 2026Sam Martin, Fabien RogerLanguage Model Safety Evaluation Long-Context Language Model Evaluation
Anthropic Fellows Program · Anthropic
Attacks and Mitigations for Distributed Governance of Agentic AI under Byzantine Adversaries
May 12, 2026Matthew D. Laws, Alina Oprea, Cristina Nita-RotaruAI Agent Security AI Agent Monitoring
Northeastern University
Property-Level Reconstructability of Agent Decisions: An Anchor-Level Pilot Across Vendor SDK Adapter Regimes
May 12, 2026Oleg SolozobovAI Agent Auditing Agent Evaluation
Independent Researcher (Global)
Can a Single Message Paralyze the AI Infrastructure? The Rise of AbO-DDoS Attacks through Targeted Mobius Injection
May 12, 2026Zi Liang, Ronghua Li, Yanyun Wang +2AI Agent Security LLM Agent Security
The Hong Kong Polytechnic University, Hong Kong SAR, China · HKUST (GZ), Guangzhou, China
Content-Aware Attack Detection in LLM Agent Tool-Call Traffic: An Empirical Study of Features, Architectures, and Evaluation Protocols
May 11, 2026Sultan ZavrakData Leakage Graph Neural Networks
Department of Computer Engineering, Duzce University, Duzce, Turkey
Machine Psychometrics: A Mathematical Psychology of Artificial Intelligence
May 10, 2026Alex Bogdan, Adrian de Valois-FranklinAI Agent Evaluation AI Agent Monitoring
Evolutionairy AI · Toronto, Canada
AgentShield: Deception-based Compromise Detection for Tool-using LLM Agents
May 10, 2026Yassin H. Rassul, Tarik A. RashidLLM Agent Security AI Agent Monitoring
Computer Science and Engineering Department, School of Science and Engineering, University of Kurdistan Hewlêr, Erbil, Iraq · Artificial Intelligence and Innovation Centre, University of Kurdistan Hewlêr, Erbil, Iraq
MonitoringBench: Semi-Automated Red-Teaming for Agent Monitoring
May 10, 2026Monika Jotautaitė, Maria Angelica Martinez, Ollie Matthews +1Software Engineering Agents AI Agent Security Benchmarks
Independent · Redwood Research
Skill Drift Is Contract Violation: Proactive Maintenance for LLM Agent Skill Libraries
May 9, 2026Linfeng Fan, Yuan Tian, Ziwei Li +1AI Agent Monitoring
Gaoling School of Artificial Intelligence, Renmin University of China, Beijing, China · King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
AgentForesight: Online Auditing for Early Failure Prediction in Multi-Agent Systems
May 9, 2026Boxuan Zhang, Jianing Zhu, Zeru Shi +2Multi-Agent LLM Systems AI Agent Monitoring
Rutgers University · The University of Texas at Austin · Purdue University
Beyond the Black Box: Interpretability of Agentic AI Tool Use
May 7, 2026Hariom Tatsat, Ariye ShaterAI Agent Reliability Mechanistic Interpretability
Quantitative Analytics, Barclays
PrefixGuard: Online Failure Warning and Trace-Grounded Diagnosis for LLM Agents
May 7, 2026Xinmiao Huang, Jinwei Hu, Qisong He +4Fault Detection AI Agent Monitoring
University of Liverpool · Université Grenoble Alpes
Monitoring autonomous persistent surveillance missions using invariance
May 7, 2026Vladislav Nenchev, Prodromos SotiriadisAI Agent Monitoring Runtime Verification
Department of Electrical and Computer Engineering, University of the Bundeswehr Munich, 85579 Neubiberg, Germany.
AgentTrust: Runtime Safety Evaluation and Interception for AI Agent Tool Use
May 6, 2026Chenglin YangAI Agent Security AI Agent Security Benchmarks
Independent Researcher
Hidden Coalitions in Multi-Agent AI: A Spectral Diagnostic from Internal Representations
May 4, 2026Cameron Berg, Susan L. Schneider, Mark M. BaileyAI Agent Monitoring Spectral Clustering
Reciprocal Research · New York, NY, USA · Center for the Future of AI, Mind, and Society +5
Evaluating Agentic AI in the Wild: Failure Modes, Drift Patterns, and a Production Evaluation Framework
May 2, 2026Mukund PandeyAI Agent Reliability AI Agent Evaluation
Independent Researcher
A Low-Latency Fraud Detection Layer for Detecting Adversarial Interaction Patterns in LLM-Powered Agents
May 1, 2026Sheldon Yu, Yingcheng Sun, Hanqing Guo +1AI Agent Security LLM Agent Security
University of California, San Diego · UNC at Greensboro · Indiana University Bloomington
Modeling Clinical Concern Trajectories in Language Model Agents
Apr 30, 2026Sukesh Subaharan, Venkatesan VS, Murugadasan P +3LLM Interpretability AI Agent Monitoring
Coimbatore Medical College · Coimbatore, TN · India
Trace-Level Analysis of Information Contamination in Multi-Agent Systems
Apr 30, 2026Anna Mazhar, Huzaifa Suri, Sainyam GalhotraAgentic Workflows AI Agent Monitoring
Cornell University Ithaca, NY, USA · University of Illinois Urbana-Champaign, IL, USA
End-to-End Evaluation and Governance of an EHR-Embedded AI Agent for Clinicians
Apr 30, 2026Aaryan Shah, Andrew Hines, Alexia Downs +6Healthcare AI Agent Evaluation
1Canvas Medical, San Francisco, CA, USA · Department of Biomedical Data Science, Stanford University, Stanford, CA, USA · 3XPC (X Primary Care) +2

May 18, 2026, cs.CRJ/K move · Enter open · S save

Surviving the Unseen: Predictive Defense for Novel Multi-Turn Multimodal Attacks

Doohee You

Trust and Safety, Google

Adversarial Attacks on VLMs Multimodal Robustness AI Agent Safety AI Agent Monitoring

Open paper AskPDF arXiv

The expansion of Multimodal Large Language Models (MLLMs) and their integration into autonomous agentic workflows has introduced a non-stationary attack surface. Empirical observations indicate that adversaries employ progressive, cross-modal perturbations that evade turn-specific guardrails by distributing malicious intent across longitudinal conversational trajectories. Static defense mechanisms, constrained by the Markov property, evaluate inputs in isolation and fail to detect cumulative structural poisoning. To handle this limitation, this paper formulates safety verification as a dynamic survival prediction and trajectory dynamics problem. The Triple-tier Anomaly Defense (TRIAD) framework is proposed as a predictive model that maps multimodal and multi-turn conversational flow as a continuous trajectory. The framework integrates structural anomaly detection to monitor covariance shifts, a Ledoit-Wolf regularized Mahalanobis distance to monitor covariance shifts in high-dimensional spaces, and topological trajectory acceleration to differentiate benign creative exploration from continuous malicious drift. These kinematic and geometric features are integrated into a time-varying Cox Proportional Hazards model via a Bayesian Hidden Markov Model (HMM) feedback loop. Theoretical analysis demonstrates that the TRIAD framework provides a mathematically bounded expected time-to-failure under adversarial perturbations, ensuring that malicious acceleration diverges positively. This framework provides a computationally efficient, interpretable, and predictive safeguard for real-time agentic AI systems, establishing a rigorous foundation for continuous safety alignment without relying on empirical retraining.

Momentum

Related topics

Latest papers 170