LLM Agent Security

LLM: Large Language Model

Overview

The field examines how agents can be manipulated through indirect prompt injection, malicious tools or skills, poisoned memory, excessive permissions, and multi-agent interactions, sometimes leading to data leaks or harmful actions. Researchers evaluate these risks with red-team attacks and benchmarks that track agent trajectories, tool calls, and real effects—not just final answers. Defenses include runtime authorization and least privilege, sandboxing, provenance and information-flow controls, monitoring, and security-focused training. A central challenge is protecting agents over long, changing workflows without blocking legitimate tasks, while making evaluations realistic enough to capture adaptive attacks and deployment risks.

Latest papers

CardsList

332 papers44 papers in the last four weeks, up 33% on the four weeks before. 0.3% of all new papers.

  1. Meta-SecAlign: Training LLMs against Prompt Injection for Robust Agents

    Jul 3, 2025Sizhe Chen, Arman Zharmagambetov, David Wagner +1LLM Agent SecurityAI Agent Security Benchmarks

  2. Seven Security Challenges in Cross-domain Multi-agent LLM Systems

    May 28, 2025Ronny Ko, Jiseong Jeong, Shuyuan Zheng +4Multi-Agent LLM SystemsLLM Agent Security