HACo: Learning Haptic Active Compliance for Force-Aware Dexterous Manipulation
Organizations: The University of Hong Kong, Hong Kong SAR, China · Beijing Academy of Artificial Intelligence (BAAI), Beijing, China · Johns Hopkins University, Baltimore, MD, USA
Abstract
Contact-rich dexterous manipulation requires policies that translate physical feedback into motion commands while regulating interaction loads across evolving multi-contact interactions. This requires haptic observations of contact state and action supervision showing how commands should adapt. Existing policies often overlook complementary fingertip tactile and joint-torque feedback, while common action targets either encode excessive loading or omit motion constrained by the object. We introduce HACo, a Haptic Active Compliance policy that learns force-regulating actions directly from haptic feedback. Compliance-regulated teleoperation converts operator inputs into controller-executable compliant actions that preserve motion intent while regulating loads. HACo learns these actions directly, using command-state discrepancy as auxiliary compliant-intent supervision. It combines local fingertip tactile responses with joint-torque feedback capturing load transmission through the articulated hand, including contacts beyond tactile coverage. A Compliance Grounding Module uses gated haptic cross-attention to ground action generation in the evolving haptic state, enabling closed-loop force regulation without explicit online contact modeling. We evaluate HACo on a real-world benchmark covering multi-contact friction, tangential interaction, fragile curved-surface contact, rotational torque, and deformable-object manipulation. Across 20 trials per task, HACo achieves an 83% mean success rate, compared with 35% for the strongest evaluated baseline. These results demonstrate active compliance across diverse force-sensitive dexterous manipulation tasks.
Figures & tables
| Method | Insert poker cards | Open book | Draw on balloon | Unscrew cap | Squeeze toothpaste | Mean |
|---|---|---|---|---|---|---|
| GR00T [ 38 ] | 3/20 | 0/20 | 1/20 | 7/20 | 4/20 | 15% |
| GR00T + Tactile | 5/20 | 2/20 | 1/20 | 9/20 | 5/20 | 22% |
| ViTacFormer [ 1 ] | 0/20 | 1/20 | 0/20 | 2/20 | 1/20 | 4% |
| T-Rex [ 8 ] | 4/20 | 6/20 | 2/20 | 12/20 | 11/20 | 35% |
| HACo | 18/20 | 17/20 | 14/20 | 19/20 | 15/20 | 83% |
| Configuration | Insert poker cards | Open book | Draw on balloon | Unscrew cap | Squeeze toothpaste | Mean |
|---|---|---|---|---|---|---|
| HACo | 18/20 | 17/20 | 14/20 | 19/20 | 15/20 | 83% |
| Haptic perception | ||||||
| w/o Haptic Feedback | 7/20 | 2/20 | 3/20 | 8/20 | 7/20 | 27% (-56%) |
| w/o Tactile Feedback | 8/20 | 5/20 | 7/20 | 13/20 | 12/20 | 45% (-38%) |
| w/o Torque Feedback | 15/20 | 16/20 | 11/20 | 14/20 | 12/20 | 68% (-15%) |
| w/o Coupled Encoding | 17/20 | 14/20 | 12/20 | 13/20 | 14/20 | 70% (-13%) |