Silent Sabotage: Internal State Triggered Backdoor Attacks on LLM-Powered Robotic Systems
Organizations: Electrical and Computer Engineering Department, Michigan Technological University, Houghton, MI 49931, USA
Abstract
The integration of Large Language Models (LLMs) into robotic control systems is enabling a new generation of autonomous agents capable of complex reasoning and planning. While this paradigm shift accelerates progress, it also introduces novel security risks that remain largely unexplored. Current research into LLM backdoors has focused on attacks triggered by external stimuli, such as specific words, visual objects, or environmental states. These attacks, while potent, overlook a more insidious class of vulnerability where the trigger is internal to the agent's own operational logic. This paper presents the first comprehensive study of history-based backdoor attacks on LLM-powered robotic systems. We demonstrate that an attacker can embed a stealthy backdoor into an LLM-based robot controller by manipulating its instructions. This backdoor is triggered not by an external cue, but by a specific, rare sequence of the robot's own past actions. It remains dormant during normal operation, preserving the robot's utility, but can be activated to induce a malicious behavior, such as a complete stop or a collision. Our experiments, conducted in a simulated environment with a variety of robots and LLMs, show that this history-based attack is highly effective, achieving a near-perfect attack success rate while remaining exceptionally difficult to detect. These findings reveal a critical and previously unaddressed vulnerability in autonomous systems and underscore the urgent need for security measures that account for an agent's internal state.
Figures & tables
| Method | Trigger Type |
|---|---|
| Jiao et al. [ 8 ] | External : Textual or Environmental/Visual (e.g., the phrase “in arcane parlance” or a “gray trash bin” on the road) |
| Wang et al. [ 20 ] | External : Visual / Physical Object (e.g., a “yellow CD” or a “blue block” placed in the robot’s view) |
| Al Nahian et al. [ 1 ] | External : Textual (e.g., rare words like “herical” or “Imposedolis” added to the user’s command) |
| Liu et al. [ 12 ] | External : Textual + Visual / Dual-Modality (e.g., the word “slowly” in a prompt combined with a “helmet dog” visual trigger) |
| Zhang et al. [ 25 ] | External : Textual + Visual (e.g., a malicious prompt like “turn aside…” that is conditional on a visual event, such as identifying the target on camera) |
| Ours | Internal : Action History (e.g., a specific sequence of the robot’s own past movements like [‘‘Turn Clockwise’’, ‘‘Strafe Right’’, ‘‘Strafe Left’’] ) |
| Map | Robot | Metric | Gemma-3-27B | Llama-3.3-70B | Qwen2-72B |
|---|---|---|---|---|---|
| 1 Door | Go1 | ASR | 10/10 | 10/10 | 9/10 |
| TCR | 10/10 | 9/10 | 8/10 | ||
| Go2 | ASR | 10/10 | 10/10 | 10/10 | |
| TCR | 9/10 | 9/10 | 8/10 | ||
| A1 | ASR | 10/10 | 10/10 | 10/10 | |
| TCR | 10/10 | 9/10 | 9/10 |
Backdoor Attacks
Backdoor attacks implant hidden, trigger-dependent behaviors in models while aiming to preserve normal performance.
See all 135 papers