Organizations: Department of Computer Science, University of Wisconsin Milwaukee, Milwaukee, WI, USA · IBM Research, Yorktown Heights, NY, USA · MIT Lincoln Laboratory, Lexington, MA, USA
Learning-based models (e.g., visuomotor and Vision-Language-Action (VLA)) are increasingly explored for industrial robotic manipulation, where model predictions are directly translated into physical actions. This tight coupling between model behavior and physical execution makes hidden security vulnerabilities particularly consequential. While backdoor attacks have been widely studied in conventional AI models, their effects on deployed learning-based robotic arm manipulation systems remain less understood: a backdoored robot can behave normally during benign operation while inducing attacker-specified behaviors only when specific triggers are present, posing potentially serious risks in physical environments. In this work, we present a preliminary empirical security study of backdoor attacks and defenses in learning-based robotic manipulation on two real commercial industrial robotic arms (FANUC and xArm). We investigate whether a backdoor can reliably induce semantically incorrect manipulation behaviors while remaining stealthy under nominal task execution. We then develop an online defense pipeline that detects and neutralizes triggers at runtime, and compare its effectiveness against an offline fine-tuning defense. Beyond defense effectiveness, we further evaluate the computational latency and execution overhead introduced by the defense pipeline to assess its suitability for high-throughput industrial operation.
Figures & tables
Metric
Formula
Model Setting
Clean Performance
Ncp=#successful rollouts w/o trigger
Backdoor Model
Attack Performance
Nap=#successful attacked rollouts w/ trigger
Backdoor Model
Defense Performance
Ndp=#successful rollouts w/ trigger
Backdoor Model + Defense
TABLE I: Definitions of success count metrics.
FANUC LR Mate 200iD
xArm 6
Task
Ncp
Nap
Ncp
Nap
Color Sorting
8/10
9/10
10/10
10/10
Machinery Boxing
10/10
9/10
9/10
8/10
TABLE II: Attack Efficacy and Nominal Stealthiness Evaluation across Robotic Platforms (Success Count out of 10 Rollouts).
Fig. 1: Machinery boxing task. The robot collects all items from the table and places them on the tray according to their colors. The adversarial attack induces the robot to drop the blue solder wire during the lifting motion.
Fig. 2: Color sorting task. The robot puts the gray screw in the left container and puts the black screw in the right container. The adversarial attack induces the robot to drop the black screw during the lifting motion.
Defense Method
Trigger Activation
Operational Cost
Nap↓
Ndp↑
Retraining
Downtime
Fine-tuning (2%)
4/5
0/5
Yes
High
Fine-tuning (4%)
4/5
0/5
Yes
High
Fine-tuning (8%)
3/5
0/5
Yes
High
Online Sanitization
1/5
5/5
No
Zero
TABLE III: Defense Performance Comparison under Physical Trigger Activation (Color Sorting Task, out of 5 Rollouts).
Hardware Platform
Unshielded (Cycles)
Shielded (Cycles)
NVIDIA RTX 4090
31
32
NVIDIA Jetson AGX Orin
32
29
TABLE IV: Industrial Throughput Evaluation: Completed Task Cycles during a 10-Minute Continuous Execution Window.
The integration of large language models (LLMs) into robotic control pipelines enables natural language interfaces that translate user prompts into executable commands. However, this digital-to-physical interface introduces a critical and underexplored vulnerability: structured backdoor attacks embedded during fine-tuning. In this work, we experimentally investigate LoRA-based supply-chain backdoors in LLM-mediated ROS2 robotic control systems and evaluate their impact on physical robot execution. We construct two poisoned fine-tuning strategies targeting different stages of the command generation pipeline and reveal a key systems-level insight: back-doors embedded at the natural-language reasoning stage do not reliably propagate to executable control outputs, whereas backdoors aligned directly with structured JSON command formats successfully survive translation and trigger physical actions. In both simulation and real-world experiments, backdoored models achieve an average Attack Success Rate of 83% while maintaining over 93% Clean Performance Accuracy (CPA) and sub-second latency, demonstrating both reliability and stealth. We further implement an agentic verification defense using a secondary LLM for semantic consistency checking. Although this reduces the Attack Success Rate (ASR) to 20%, it increases end-to-end latency to 8-9 seconds, exposing a significant security-responsiveness trade-off in real-time robotic systems. These results highlight structural vulnerabilities in LLM-mediated robotic control architectures and underscore the need for robotics-aware defenses for embodied AI systems.
Mingyang Xie, Jin Wei-Kocsis
School of Applied and Creative Computing, Purdue University, West Lafayette, IN, USA
Vision-Language-Action (VLA) models map multimodal perception and language instructions to executable robot actions, making them particularly vulnerable to behavioral backdoor manipulation: a hidden trigger introduced during training can induce unintended physical actions while nominal task performance remains intact. Prior work on VLA backdoors primarily studies untargeted attacks or task-level hijacking, leaving fine-grained control over individual actions largely unexplored. In this work, we present DropVLA, an action-level backdoor attack that forces a reusable action primitive (e.g., open_gripper) to execute at attacker-chosen decision points under a realistic pipeline-black-box setting with limited data-poisoning access, using a window-consistent relabeling scheme for chunked fine-tuning. On OpenVLA-7B evaluated with LIBERO, vision-only poisoning achieves 98.67%-99.83% attack success rate (ASR) with only 0.31% poisoned episodes while preserving 98.50%-99.17% clean-task retention, and successfully triggers the targeted action within 25 control steps at 500 Hz (0.05 s). Text-only triggers are unstable at low poisoning budgets, and combining text with vision provides no consistent ASR improvement over vision-only attacks. The backdoor remains robust to moderate trigger variations and transfers across evaluation suites (96.27%, 99.09%), whereas text-only largely fails (0.72%). We further validate physical-world feasibility on a 7-DoF Franka arm with pi0-fast, demonstrating non-trivial attack efficacy under camera-relative motion that induces image-plane trigger drift. These results reveal that VLA models can be covertly steered at the granularity of safety-critical actions with minimal poisoning and without observable degradation of nominal performance.
Zonghuan Xu, Jiayu Li, Yunhan Zhao +3
Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China. · Shanghai Key Laboratory of Multimodal Embodied AI, Shanghai, China. · City University of Hong Kong, Hong Kong SAR, China.
Large language models and vision-language models are increasingly used as high-level planners in robotic systems, using task goals and sensor summaries to select navigation or manipulation actions. This creates a new backdoor surface: a compromised planner can behave normally in most runs, yet change its target selection when a hidden trigger is present. Prior attacks on LLM-powered or embodied agents mainly rely on triggers that appear in language, camera-visible objects, scene semantics, or specific sequences of past actions. This paper presents StepTrigger, a contact-state-triggered backdoor attack for VLM-powered legged robots. The trigger is not a prompt token or a visible marker. It is produced by pressure and foot-ground contact patterns that arise when a Unitree Go1 quadruped walks across a dense terrain patch. Unlike conventional visual or textual triggers, contact signals are inherently noisy and may also arise during benign locomotion. To avoid treating every pressure anomaly as a trigger, StepTrigger learns a selective backdoor policy from multimodal robot state, using incidental pressure events as benign examples and dense-patch contacts as poisoned examples. In a stratified offline evaluation, the trained planner achieved 98.75% clean behavior preservation, 92.50% false-trigger rejection, 76.25% true-trigger activation, and 89.17% overall parsed behavior accuracy. These results reveal a backdoor surface in proprioceptive and contact channels that is not captured by defenses focused only on language, vision, or action history.
Jiageng Zhang, Doniyorkhon Obidov, Kaichen Yang
Michigan Technological University, Houghton, MI, USA