Organizations: Department of Computer Science, University of Wisconsin Milwaukee, Milwaukee, WI, USA · IBM Research, Yorktown Heights, NY, USA · MIT Lincoln Laboratory, Lexington, MA, USA
Learning-based models (e.g., visuomotor and Vision-Language-Action (VLA)) are increasingly explored for industrial robotic manipulation, where model predictions are directly translated into physical actions. This tight coupling between model behavior and physical execution makes hidden security vulnerabilities particularly consequential. While backdoor attacks have been widely studied in conventional AI models, their effects on deployed learning-based robotic arm manipulation systems remain less understood: a backdoored robot can behave normally during benign operation while inducing attacker-specified behaviors only when specific triggers are present, posing potentially serious risks in physical environments. In this work, we present a preliminary empirical security study of backdoor attacks and defenses in learning-based robotic manipulation on two real commercial industrial robotic arms (FANUC and xArm). We investigate whether a backdoor can reliably induce semantically incorrect manipulation behaviors while remaining stealthy under nominal task execution. We then develop an online defense pipeline that detects and neutralizes triggers at runtime, and compare its effectiveness against an offline fine-tuning defense. Beyond defense effectiveness, we further evaluate the computational latency and execution overhead introduced by the defense pipeline to assess its suitability for high-throughput industrial operation.
Figures & tables
Metric
Formula
Model Setting
Clean Performance
Ncp=#successful rollouts w/o trigger
Backdoor Model
Attack Performance
Nap=#successful attacked rollouts w/ trigger
Backdoor Model
Defense Performance
Ndp=#successful rollouts w/ trigger
Backdoor Model + Defense
TABLE I: Definitions of success count metrics.
FANUC LR Mate 200iD
xArm 6
Task
Ncp
Nap
Ncp
Nap
Color Sorting
8/10
9/10
10/10
10/10
Machinery Boxing
10/10
9/10
9/10
8/10
TABLE II: Attack Efficacy and Nominal Stealthiness Evaluation across Robotic Platforms (Success Count out of 10 Rollouts).
Fig. 1: Machinery boxing task. The robot collects all items from the table and places them on the tray according to their colors. The adversarial attack induces the robot to drop the blue solder wire during the lifting motion.
Fig. 2: Color sorting task. The robot puts the gray screw in the left container and puts the black screw in the right container. The adversarial attack induces the robot to drop the black screw during the lifting motion.
Defense Method
Trigger Activation
Operational Cost
Nap↓
Ndp↑
Retraining
Downtime
Fine-tuning (2%)
4/5
0/5
Yes
High
Fine-tuning (4%)
4/5
0/5
Yes
High
Fine-tuning (8%)
3/5
0/5
Yes
High
Online Sanitization
1/5
5/5
No
Zero
TABLE III: Defense Performance Comparison under Physical Trigger Activation (Color Sorting Task, out of 5 Rollouts).
Hardware Platform
Unshielded (Cycles)
Shielded (Cycles)
NVIDIA RTX 4090
31
32
NVIDIA Jetson AGX Orin
32
29
TABLE IV: Industrial Throughput Evaluation: Completed Task Cycles during a 10-Minute Continuous Execution Window.
Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China. · Shanghai Key Laboratory of Multimodal Embodied AI, Shanghai, China. · City University of Hong Kong, Hong Kong SAR, China.