cs.ROJul 9, 2026

AnyDexRT: Calibration-Free Dexterous Hand Retargeting with Few-Shot Human Guidance

Authors: Chenxi WangYing FengHongjie FangShangning XiaLixin YangChuan WenCewu Lu

Organizations: 1Noematrix · 2Shanghai Jiao Tong University · 3Shanghai Innovation Institute

Abstract

Teleoperation is a key interface for controlling dexterous robotic hands and collecting demonstrations for imitation learning. Its effectiveness largely depends on kinematic retargeting, which maps operator hand motions to feasible and intuitive robot hand motions. Existing methods often require hand-crafted objectives, precise calibration, or global shape matching between human and robot hand spaces, making them sensitive to hand-specific tuning and less reliable across different dexterous hands. We propose AnyDexRT, a calibration-free retargeting method for intuitive dexterous teleoperation across human-like dexterous hands. AnyDexRT combines self-supervised fingertip correspondence learning with few-shot human guidance to anchor the mapping in task-relevant regions, and further refines pinch-related poses using a contact classifier. Experiments on diverse dexterous hands and real-world teleoperation tasks show that AnyDexRT improves retargeting quality, reduces manual tuning, and provides more intuitive and efficient control than prior retargeting methods. Project website: https://chenxi-wang.github.io/projects/anydexrt

Explore similar work

CardsList
  1. Towards Human-level Dexterous Teleoperation

    Jul 13, 2026Puhao Li, Zeyuan Chen, Yingying Wu +9TeleoperationImitation Learning