cs.LGMar 12, 2026

Security Considerations for Artificial Intelligence Agents

Authors: Ninghui Li, Kaiyuan Zhang, Kyle Polley, Jerry Ma

Organizations: Perplexity · Purdue University

Abstract

This article, a lightly adapted version of Perplexity's response to NIST/CAISI Request for Information 2025-0035, details our observations and recommendations concerning the security of frontier AI agents. These insights are informed by Perplexity's experience operating general-purpose agentic systems used by millions of users and thousands of enterprises in both controlled and open-world environments. Agent architectures change core assumptions around code-data separation, authority boundaries, and execution predictability, creating new confidentiality, integrity, and availability failure modes. We map principal attack surfaces across tools, connectors, hosting boundaries, and multi-agent coordination, with particular emphasis on indirect prompt injection, confused-deputy behavior, and cascading failures in long-running workflows. We then assess current defenses as a layered stack: input-level and model-level mitigations, sandboxed execution, and deterministic policy enforcement for high-consequence actions. Finally, we identify standards and research gaps, including adaptive security benchmarks, policy models for delegation and privilege control, and guidance for secure multi-agent system design aligned with NIST risk management principles.

Explore similar work

CardsList
  1. The Attack and Defense Landscape of Agentic AI: A Comprehensive Survey

    Mar 11, 2026Juhee Kim, Xiaoyuan Liu, Zhun Wang +4AI Agent SecurityLLM Agent Security

  2. Architecting Secure AI Agents: Perspectives on System-Level Defenses Against Indirect Prompt Injection Attacks

    Mar 31, 2026Chong Xiang, Drew Zagieboylo, Shaona Ghosh +5AI Agent SecurityPrompt Injection Defense

  3. Lessons from Penetration Tests on Large-Scale Agent Systems

    May 26, 2026Kevin Eykholt, Dhilung Kirat, Xiaokui Shu +3Software SecurityAI Agent Security