cs.ROOct 29, 2026

Kinematic-Tactile Aligned Dexterous Retargeting with Contact Wrench Space Alignment

Authors: Xinyuan He, Ziheng Xu, Yueyuan Chen, Yufan Ye, Yuanshuo Tan, Huiming Pan, Jianjun Meng, Shuo Jiang, 

Organizations: State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · College of Electronics and Information Engineering, Tongji University, Shanghai 201804, China · International Collaboration for Creative Research Teams, Shanghai Jiao Tong University, Shanghai 200240, China · School of Artificial Intelligence, The Chinese University of Hong Kong, Shenzhen, Shenzhen 518172, China

Abstract

Human demonstrations provide a natural and scalable source of data for learning dexterous manipulation policies. However, existing retargeting methods primarily transfer human kinematics, while the tactile information underlying physical interaction is rarely preserved across embodiments. To address this limitation, we present a hierarchical three-stage framework for kinematic-tactile aligned dexterous retargeting. We use object-centric contact wrench space as a physical representation for tactile alignment between human and robot hands. The framework first aligns hand kinematics and contact geometry, and then constructs a human wrench support profile from tactile forces and contact geometry. Robot fingertip force targets are subsequently optimized to cover the human wrench support and converted into joint position corrections, yielding directly replayable robot hand trajectories. We evaluate the framework in simulation and real robot experiments across three pouring conditions. In the real robot experiments, our method achieves a 96.7% replay success rate and higher wrench transfer fidelity than representative retargeting baselines. The framework enables physically grounded transfer of kinematic and tactile information from human demonstrations to robot hands, providing a path toward scalable learning of contact-rich dexterous manipulation.

Figures & tables

Explore similar work

CardsList
  1. DexOAK: Object-Aware Kinematic Retargeting

    Oct 19, 2026Federica Spinola, Robert Katzschmann, Cordelia SchmidMotion RetargetingHuman-to-Robot Motion Imitation

  2. Dexterous Robot Manipulation from Human Demonstrations via Contact-Anchored Retargeting and Residual Policy Learning

    Sep 21, 2026Zihao Yang, Chengyuan Liu, Yu Zhou +6Dexterous ManipulationBimanual Robotic Manipulation