Hand Object Interaction
Hand-object interaction research focuses on accurately modeling and reconstructing how humans manipulate objects, aiming to improve computer vision, robotics, and virtual/augmented reality applications. Current research heavily utilizes graph neural networks, diffusion models, and variational autoencoders to address challenges like occlusion, contact modeling, and physical plausibility in 3D hand and object pose estimation and interaction synthesis. This field is significant due to its potential to enable more realistic human-computer interaction, improve robotic manipulation capabilities, and advance our understanding of human motor control and perception. The development of large, diverse datasets capturing hand-object interactions in various contexts is also a key area of ongoing effort.
Papers
ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild
Arya Farkhondeh, Samy Tafasca, Jean-Marc Odobez
ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
Jiajun Zhang, Yuxiang Zhang, Liang An, Mengcheng Li, Hongwen Zhang, Zonghai Hu, Yebin Liu