cs.RONov 15, 2026

DAPPT: Domain-Aware Policies from Procedural Trajectories for Sim-to-Real Dexterous Tool Use

Authors: Beining Han, Jia Deng

Organizations: Princeton Unversity

Abstract

Sim-to-real RL has achieved impressive results in dexterous manipulation but remains limited to tasks with accurate rigid-body simulation. However, these methods cannot be applied to skills that involve deformable and particles, with which the simulation speed will become too slow for large-scale RL learning. We present DAPPT, a sim-to-real framework for end-to-end dexterous tool-use manipulation skills, e.g., sand scooping, play-dough rod-rolling, without simulating non-rigid materials. Our method learns a domain-aware RL policy by tracking procedural trajectories parameterized by domain parameters, and distills it into an end-to-end domain-aware sensorimotor policy. Furthermore, explicit domain represen-tation enables fast selection of domain parameters that can maximize downstream task performance. We evaluate DAPPT end-to-end on six dexterous manipulation tasks, including sand scooping, play-dough rod-rolling, sand scraping, mouse-wheel scrolling, dispenser pressing, and spray triggering. Our method achieves 1.5-3.8x in task metrics through the best domain parameter and transfers zero-shot to the real world.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. DexSim2Real: Foundation Model-Guided Sim-to-Real Transfer for Generalizable Dexterous Manipulation

    May 3, 2026Zijian Zeng, Fei Ding, Huiming Yang +2Domain RandomizationDexterous Manipulation

  2. SimToolReal: An Object-Centric Policy for Zero-Shot Dexterous Tool Manipulation

    Feb 18, 2026Kushal Kedia, Tyler Ga Wei Lum, Jeannette Bohg +1Zero-Shot Robotic ManipulationRobot Skill Learning

  3. Dex4D: Task-Agnostic Point Track Policy for Zero-Shot Dexterous Manipulation

    Feb 17, 2026Yuxuan Kuang, Sungjae Park, Katerina Fragkiadaki +1Robotic ManipulationRobot Skill Learning