Hand Object Manipulation
Hand object manipulation research aims to understand and replicate the complex interplay between human hands and objects, focusing on accurate modeling of interactions for applications like robotics and virtual reality. Current efforts concentrate on developing robust datasets capturing diverse manipulation scenarios, employing deep learning architectures like diffusion models and transformers to generate and reconstruct realistic hand-object interactions, and leveraging reinforcement learning to improve control and physical plausibility. These advancements are crucial for creating more intuitive and adaptable robotic systems capable of performing complex tasks in unstructured environments, as well as enhancing human-computer interaction in virtual and augmented reality.
Papers
ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild
Arya Farkhondeh, Samy Tafasca, Jean-Marc Odobez
ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
Jiajun Zhang, Yuxiang Zhang, Liang An, Mengcheng Li, Hongwen Zhang, Zonghai Hu, Yebin Liu