AffectiveVLA: Safe and Intent-Aware VLA Control for Human-Humanoid Social Interaction
Organizations: Skolkovo Institute of Science and Technology, Moscow, Russia
Abstract
Social touch interactions, such as handshakes, fist bumps, and hugs, require humanoid robots to infer human intent, generate contact-rich motions, and maintain safe physical contact. We present AffectiveVLA, an intent-gated Vision-Language-Action (VLA) pipeline deployed on a Unitree G1 humanoid with dexterous hands. A lightweight RGB-based model recognizes interaction intent from two onboard cameras and converts it into a language prompt for the VLA policy. Low-confidence predictions suppress motion execution, reducing unintended activations. During physical contact, interaction-specific compliance profiles adjust arm impedance, while an independent voice-triggered mechanism initiates a latched safe-stop procedure. Using VR teleoperation, we collected approximately 1,300 multimodal interaction episodes and fine-tuned four VLA models: GR00T, RLDX-1, Being-H0.5, and UnifoLM-VLA-0. On-robot evaluation identifies GR00T as the best-performing standalone model. Integrating intent recognition increases its macro-F1 score from 0.75 to 0.90, while the intent model achieves a p95 inference latency of 6.27 ms. These results demonstrate that explicit intent gating improves the reliability of VLA-based social interaction without compromising real-time operation.
Figures & tables
| Profile | Shoulder | Elbow | Wrist |
|---|---|---|---|
| Handshake | |||
| Hug | |||
| FistBump | |||
| Soft |
| Action part | Chunk step | ||||
|---|---|---|---|---|---|
| Model | Overall | Body | Hand | First | Last |
| Being-H0.5 | 0.135 | 0.100 | 0.353 | 0.093 | 0.161 |
| GR00T | 0.135 | 0.103 | 0.341 | 0.085 | 0.156 |
| RLDX-1 | 0.133 | 0.100 | 0.341 | 0.096 | 0.158 |
| UnifoLM-VLA-0 | 0.148 | 0.114 | 0.373 | 0.110 | 0.177 |
| Interaction | ||||
|---|---|---|---|---|
| Model | Handshake | Fist bump | Hug | Mean |
| Being-H0.5 | 0.09 | 0.00 | 0.26 | 0.12 |
| UnifoLM-VLA-0 | 0.57 | 0.38 | 0.94 | 0.63 |
| RLDX-1 | 0.68 | 0.38 | 0.54 | 0.53 |
| GR00T | 0.86 | 0.50 | 0.89 | 0.75 |
| GR00T + intent (ours) | 0.92 | 0.78 | 1.00 | 0.90 |
Human-Robot Interaction
Human-robot interaction studies how people and robots communicate, coordinate, and safely work or live together.
See all 475 papers