Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation
Organizations: Wuhan University
Abstract
Foundation models are increasingly used for perception, reasoning, planning, and action generation in embodied agents, creating security risks that can propagate from digital inputs to physical behavior. Existing surveys often organize threats by mechanisms such as jailbreaks, prompt injection, backdoors, poisoning, or adversarial examples, but these categories do not consistently identify where an adversary first enters the embodied control loop. We present a trust-boundary-centric survey of foundation-model-powered embodied-agent security. Using a first-compromised-trust-boundary principle, we separate attack surface from attack mechanism and organize the system into five layers and twelve attack surfaces spanning the model supply chain, user instructions, context and memory, physical semantic environments, multimodal perception, world state, internal reasoning, task planning, action interfaces, middleware, multi-agent communication, and execution control. Based on 58 attack records and 61 defense records collected through August 15, 2026, we analyze representative attacks, cross-layer propagation, defense placement, and evaluation practices. Our quantitative analysis shows that attack research is concentrated on multimodal perception and action interfaces, while defenses are especially concentrated on action-level and runtime protection. Context and long-term memory, middleware and networking, world-state integrity, and multi-agent trust remain comparatively underexplored. We conclude with open challenges in state provenance, compositional defenses, long-horizon attack propagation, physical realizability, Byzantine multi-robot behavior, and unified closed-loop evaluation.
Figures & tables
| Code | Attack surface | Core definition | Representative carriers/objects |
| AS01 | Model, data, and supply chain | The attack first occurs before deployment in a learning asset or model/component boundary. Malicious influence is encoded through training, fine-tuning, adapters, checkpoints, or third-party components and is later activated during deployment. | Training data, fine-tuning examples, LoRA/Adapter, checkpoints, third-party FM components |
| AS02 | User instruction and natural-language control | Malicious input enters through the channel explicitly treated as the current user’s task or control intent. The first corrupted representation is task intent rather than environmental observation. | Text tasks, speech commands, adversarial suffixes, direct prompts |
| AS03 | Context, memory, and ICL/RAG | The attack targets runtime language context other than the current user instruction, including demonstrations, history, persistent memory, retrieved documents, tool returns, or cached plans. | ICL examples, memory, RAG, history, tool results |
| AS04 | Physical semantic environment | The adversary changes real semantic content that is correctly perceived by the robot, such as signs, displays, labels, QR codes, or instruction-like objects. The sensor may function correctly; the failure is semantic authority. | Printed text, signs, screens, labels, QR codes, scene text |
| AS05 | Multimodal perception and sensors | The first corruption occurs in raw observations or sensor signals, including pixels, physical/digital patches, 3D textures, optical signals, audio, or LiDAR. | Pixels, patches, 3D textures, cameras, audio, LiDAR |
| AS06 | World state, localization, and proprioception | The attack targets structured state consumed by planning or policy modules. Raw sensing can be intact while object relations, occupancy, localization, joint state, affordances, feedback, or summaries are forged. | Object relations, occupancy, pose, joint state, affordance, feedback |
| Attack mechanism | Common primary surfaces | Decision rule |
| Jailbreak / Direct Prompt Injection | AS02; sometimes AS08/AS09 | If malicious content comes directly from the currently authorized user-task channel, AS02 is the primary entry; plan/action changes are normally downstream targets. |
| Indirect / Physical Prompt Injection | AS03 / AS04 / AS05 | Depends on whether untrusted language comes from auxiliary context, real environmental semantics, or a corrupted raw sensor. |
| Backdoor / Poisoning | AS01 | Malicious capability is implanted during training, fine-tuning, or model distribution; runtime triggers are recorded separately. |
| Adversarial Patch / Sensor Spoofing | AS05 | The first distorted quantity is a raw image, audio, LiDAR, optical, or related sensor signal. |
| State Manipulation | AS06 | The adversary directly changes object relations, occupancy, pose, joint state, affordances, feedback, or other structured state. |
| Reasoning / Attention Hijacking | AS07 | The adversary directly targets CoT, attention, hidden representations, or cross-modal alignment. |
| Category | 2022 | 2023 | 2024 | 2025 | 2026 (through Aug. 15) |
| Attacks | 1 | 1 | 5 | 21 | 30 |
| Defenses | 0 | 3 | 8 | 27 | 23 |
| Code | Attack surface | Attack count | Attack coverage | Defense count | Defense coverage | D/A ratio |
| AS01 | Model, data, and supply chain | 16 | 27.6% | 12 | 19.7% | 0.75 |
| AS02 | User instruction and language control | 15 | 25.9% | 8 | 13.1% | 0.53 |
| AS03 | Context, memory, and ICL/RAG | 2 | 3.4% | 2 | 3.3% | 1.00 |
| AS04 | Physical semantic environment | 10 | 17.2% | 5 | 8.2% | 0.50 |
| AS05 | Multimodal perception and sensors | 29 | 50.0% | 20 | 32.8% | 0.69 |
| AS06 | World state, localization, proprioception | 4 | 6.9% | 8 | 13.1% | 2.00 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| No. | Paper / Method | Year | Attack mechanism | Attack surfaces | Model | Validation environment |
|---|---|---|---|---|---|---|
| 1 | On the Vulnerability of LLM/VLM-Controlled Robotics | 2024 | Adversarial input / robustness attack | AS02;AS05;AS08 | LLM/VLM | Simulation / partial real-world tests |
| 2 | Exploring the Robustness of Decision-Level Through Adversarial Attacks on LLM-Based Embodied Models (EIRAD) | 2024 | Adversarial prompt / targeted and untargeted attacks | AS02;AS08 | LLM/VLM | Simulation |
| 3 | Can We Trust Embodied Agents? Exploring Backdoor Attacks against Embodied LLM-based Decision-Making Systems (BALD) | 2025 | Backdoor: word/scenario/knowledge injection | AS01;AS02;AS06 | LLM | Simulation |
| 4 | BadRobot: Jailbreaking Embodied LLMs in the Physical World | 2024 | Jailbreak / language–action misalignment | AS02;AS07;AS08;AS09 | LLM | Simulation + real robot |
| 5 | A Study on Prompt Injection Attack Against LLM-Integrated Mobile Robotic Systems | 2024 | Prompt Injection | AS02;AS08 | LLM | Simulation / mobile robot |
| 6 | Compromising LLM Driven Embodied Agents with Contextual Backdoor Attacks | 2025 | ICL/Contextual Backdoor | AS03;AS01 | LLM/VLM | Simulation / partial real-world tests |
| No. | Paper / Method | Year | Defense mechanism | Covered surfaces | Model | Validation environment |
|---|---|---|---|---|---|---|
| 1 | Plug in the Safety Chip: Enforcing Constraints for LLM-driven Robot Agents | 2024 | Formal constraints / LTL safety chip | AS02;AS08;AS09 | LLM | Simulation + real robot |
| 2 | Ensuring Safety in LLM-Driven Robotics: A Cross-Layer Sequence Supervision Mechanism | 2024 | Cross-layer sequence supervision | AS02;AS08;AS09 | LLM | Simulation / robot |
| 3 | SafeEmbodAI: Securing LLM-Controlled Mobile Robots against Prompt Injection | 2024 | Secure Prompting + State Management + Safety Validation | AS02;AS03;AS08 | LLM | Simulation / mobile robot |
| 4 | SELP: Generating Safe and Efficient Task Plans for Robot Agents with Large Language Models | 2024 | Safety-aware decoding / unsafe-action pruning | AS08;AS09 | LLM | Simulation |
| 5 | Safe LLM-Controlled Robots with Formal Guarantees via Reachability Analysis | 2025 | Reachability / Formal Guarantee | AS08;AS09;AS12 | LLM | Simulation |
| 6 | SafePlan: Leveraging Formal Logic and Chain-of-Thought Reasoning for Enhanced Safety in LLM-based Robotic Task Planning | 2025 | Prompt Sanity + Invariant + Preconditions/Postconditions | AS02;AS08;AS09 | LLM | Simulation |
AI Agent Security
Artificial intelligence agent security studies attacks and safeguards for tool-using, persistent, and collaborative systems across digital and physical settings.
See all 491 papers