AI Agent Security

Follow this topic Ask about this topic

Momentum

43 papers in the last four weeks, up 258% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28

Latest papers 311

All topics

Know Your Agent: Reconnaissance-Driven Pentesting of AI Agents
Jul 22, 2026Or Zion Eliav, Eyal Lenga, Shir Bernstien +1AI Agent Security AI Agent Security Benchmarks
Faculty of Computer and Information Science Ben-Gurion University of the Negev Beer-Sheva, Israel
Twin Agent: Context Residual Compression for Privilege Separated Agents
Jul 21, 2026Zhanhao Hu, Dennis Jacob, Xiao Huang +3AI Agent Security LLM Agent Security
University of California, Berkeley · University of Chicago · University of Illinois, Urbana-Champaign
Data Leakage Prevention in Agentic Applications via Preemptive Hardening
Jul 21, 2026Akansha Shukla, Emily Bellov, Parth Atulbhai Gandhi +2AI Agent Security LLM Agent Security
Faculty of Computer and Information Science Ben-Gurion University of the Negev Beer-Sheva, Israel
Cross-Agent Campaign Attribution: Linking Asynchronous Attacks Across LLM Agents
Jul 21, 2026SangJin Park, Myungsub Choi, Jineok Kim +1LLM Agent Evaluation AI Agent Security
Tynapse, Seoul, Republic of Korea.
Building Trust in Autonomous Commerce: A Verifiable Global Event Timeline and AI-Ready Fraud Intelligence Layer
Jul 21, 2026Rajat SrivastavaData Provenance AI Agent Security
Independent Researcher, Gurugram, India
The Chronos Vulnerability: A Taxonomy of Temporal Persistence and Memory-Based Deception in Agentic AI
Jul 20, 2026Om Narayan, Ramkinker Singh, Praveen BaskarAdversarial Attacks AI Agent Security
Department of Computer Science New York University New York, NY, USA · Carnegie Mellon University Pittsburgh, PA, USA · Independent Researcher Chicago, IL, USA
ChainWatch: A Kill Chain-Aligned Sequential Detection Framework for Multi-Step Attacks in MCP-Based AI Agent Systems
Jul 20, 2026Om Narayan, Rashmi Jyoti, Ramkinker SinghMCP Security AI Agent Security
Computer Science New York University New York, USA · Cybersecurity University of Maryland, College Park MD, USA · Carnegie Mellon University Pittsburgh, USA
Self-State Attacks on Self-Hosted AI Agents: How Far Can OS Defenses Go?
Jul 20, 2026Yimeng Chen, Nathanaël Denis, Roberto Di Pietro +1AI Agent Security Agent Memory Poisoning
Center of Excellence for Generative AI, King Abdullah University of Science and Technology · The Swiss AI Lab, IDSIA-USI/SUPSI
ETAS: An Effect-Typed Language for Agent Systems
Jul 20, 2026Huiri Tan, Yikun Wang, Puyang Zhang +2AI Agent Security
The Hong Kong University of Science and Technology, Hong Kong
A Decision-Centered Reference Architecture for Trustworthy Agentic Commerce
Jul 20, 2026Dimitrios S. SfirisAI Agent Security Agentic Commerce
AspectSoft, Xanthi, Greece
Bad Memory: Evaluating Prompt Injection Risks from Memory in Agentic Systems
Jul 16, 2026Soham Gadgil, David Alexander, Sai Sunku +1AI Agent Security Agent Memory Poisoning
University of Washington Seattle, WA, USA
Democratizing Agent Deployment Safety: A Structural Monitoring Approach
Jul 16, 2026Preeti Ravindra, Rahul Tiwari, Vincent WolowskiSoftware Engineering Agents AI Agent Security
1Independent
Rethinking Penetration Testing for AI-Enabled Systems: From Resource Compromise to Behavioral Objective Violation
Jul 15, 2026Mohammad Allahbakhsh, Mohammad Hassan Bahari, Moslem Attar-RaoufAI Agent Security
Computer Engineering Department, Ferdowsi University of Mashhad, Mashhad, Iran. · Sensifai BV, Brussels, Belgium.
How Agents Ask for Permission: User Permissions for AI Agents, from Interfaces to Enforcement
Jul 15, 2026Alexandra E. Michael, Franziska RoesnerAI Agent Security Tool Access Control for LLM Agents
University of Washington
CAVA: Canonical Action Verification and Attestation for Runtime Governance of Agentic AI Systems
Jul 15, 2026Zexun WangAI Agent Security AI Agent Governance
Ond Holdings Inc.
Agentic Service-Oriented Computing: A Manifesto for the Next Frontier of Service-Oriented Computing
Jul 14, 2026Amin Beheshti, Rong N. Chang, Boualem Benatallah +7AI Accountability LLM Agent Orchestration
Macquarie University, Sydney, Australia · IBM Research, Yorktown Heights, USA · School of Computing, Dublin City University, Dublin, Ireland +5
SingGuard-NSFA: Extensible Guardrails for Agentic AI via Generative Reasoning and Real-Time Classification
Jul 13, 2026SingGuard TeamLLM Guardrails AI Agent Security
AI Security Lab, Ant Group
Neuro-Agentic Control: A Deep Learning-based LLM-Powered Agentic AI Framework for Controlling Security Controls
Jul 10, 2026Saroj Gopali, Bipin Chhetri, Deepika Giri +2Language Model-Based Control Safety-Critical Control
Department of Computer Science1, Texas Tech University1 · Cumberland University2 · Advanced Academic Programs Science3, Johns Hopkins University3
Formal Mechanisms for Market Stability in Self-Interested Agent Societies: A Marketplace Simulation Study
Jul 9, 2026Eugene Ng Yi Sheng, Bingquan ShenSocial Dilemmas Multi-Agent LLM Systems
DSO National Laboratories · National University of Singapore
Token-Flow Firewall: Semantic Runtime Auditing for Persistent AI Agents
Jul 9, 2026Puji Wang, Yingchen Zhang, Ruqing Zhang +2AI Agent Security AI Agent Monitoring
State Key Laboratory of AI Safety · Institute of Computing Technology, Chinese Academy of Sciences · University of Chinese Academy of Sciences, Beijing, China
Multi-Agent AI Control: Distributed Attacks Hamper Per-Instance Monitors
Jul 8, 2026Oliver Makins, Orazio Angelini, Zohreh Shams +1Multi-Agent Control AI Agent Security
UK AI Security Institute MATS Research · MATS Research
Security and Privacy in Agentic AI: Grand Challenges and Future Directions
Jul 7, 2026Adam Jenkins, Agnieszka Kitkowska, Caterina Maidhof +22AI Agent Security Agentic AI
Department of Informatics, Università della Svizzera italiana (USI), Lugano, Switzerland
The Balkanization of Execution-Security Research for AI Coding Agents: Isolation, Access Control, and Time-of-Check-to-Time-of-Use Vulnerabilities
Jul 7, 2026Mohammadreza RashidiAI Coding Agents Software Security
Department of Computer Science AI and Media Analysis Lab Berlin, Germany
When Agents Remember Too Much: Memory Poisoning Attacks on Large Language Model Agents
Jul 6, 2026George Torres, Sharad Shrestha, Satyajayant MisraAI Agent Security LLM Agent Security
‡∗§Department of Computer Science, §Klipsch School of Electrical and Computer Engineering New Mexico State University, Las Cruces, New Mexico, USA · §Klipsch School of Electrical and Computer Engineering New Mexico State University, Las Cruces, New Mexico, USA
aiAuthZ: Off-Host, Identity-Bound Authorization for AI Agents
Jul 6, 2026Sai Varun KodathalaAI Agent Security LLM Agent Security
Research & Development SportsVision AI Minnetonka, MN
PiSAs: Benchmarking Contextual Integrity in Multi-User Agentic Systems
Jul 6, 2026Shubham Gupta, Nazanin Mohammadi Sepahvand, Abhinav Kumar +6Multi-Agent LLM Systems Contextual Integrity
ServiceNow AI Research · Mila – Quebec AI Institute · Université Laval +2
Agent Data Injection Attacks are Realistic Threats to AI Agents
Jul 6, 2026Woohyuk Choi, Juhee Kim, Taehyun Kang +3AI Agent Security Indirect Prompt Injection
Seoul National University · Largosoft · University of Illinois Urbana-Champaign
FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents
Jul 6, 2026Yue Pan, Ziheng Zhang, Junxiang Lei +3Deep Research Agents RAG Poisoning Attacks
Fudan University · Huazhong University of Science and Technology · Explore Academy, JD
Governed Individuation: Cryptographically Decoupling an Agent's Learning from Its Authority
Jul 6, 2026Xue Qin, Simin Luan, Cong Yang +1AI Agent Security AI Agent Safety
School of Software, Harbin Institute of Technology, Harbin, China · School of Computer Science and Technology, Harbin Institute of Technology, Harbin, China · School of Future Science and Engineering, Soochow University, Suzhou, China
LLM-Centric Agentic AI for UAV Swarms: Architecture, Enabling Technologies, and Open Problems
Jul 5, 2026Yousef Emami, Rahim Taheri, Mohammadhossein Homaei +2Multi-Agent LLM Systems AI Agent Security
Senior Member, IEEE

Jul 22, 2026, cs.AIJ/K move · Enter open · S save

Know Your Agent: Reconnaissance-Driven Pentesting of AI Agents

Or Zion Eliav, Eyal Lenga, Shir Bernstien, Yisroel Mirsky

Faculty of Computer and Information Science Ben-Gurion University of the Negev Beer-Sheva, Israel

AI Agent Security AI Agent Security Benchmarks Indirect Prompt Injection Automated Penetration Testing Prompt Injection Attacks on LLMs Prompt Injection Attacks on AI Agents

Open paper AskPDF arXiv

Traditional pentesting uses reconnaissance at each step to uncover unseen weaknesses, build stronger attacks, and advance the objective; we argue that AI agents require the same treatment. We formalize agent reconnaissance by modeling the process and identifying the knowledge assets it seeks to extract: what they are, how they are used, and which agent weaknesses they exploit to give adversaries leverage in indirect prompt injection attacks. We instantiate these insights in Know Your Agent (KYA), a framework that automates black-box, reconnaissance-driven pentesting by probing agents, building target profiles, and using those profiles to craft stronger attacks. We evaluate KYA on agent-security benchmarks and a real-world coding agent, and release KYA, its benchmarks, and baseline implementations for reproducibility.

Momentum

Related topics

Latest papers 311