Hand Object Interaction
Hand-object interaction research focuses on accurately modeling and reconstructing how humans manipulate objects, aiming to improve computer vision, robotics, and virtual/augmented reality applications. Current research heavily utilizes graph neural networks, diffusion models, and variational autoencoders to address challenges like occlusion, contact modeling, and physical plausibility in 3D hand and object pose estimation and interaction synthesis. This field is significant due to its potential to enable more realistic human-computer interaction, improve robotic manipulation capabilities, and advance our understanding of human motor control and perception. The development of large, diverse datasets capturing hand-object interactions in various contexts is also a key area of ongoing effort.
Papers
Detecting Activities of Daily Living in Egocentric Video to Contextualize Hand Use at Home in Outpatient Neurorehabilitation Settings
Adesh Kadambi, José Zariffa
Grasp What You Want: Embodied Dexterous Grasping System Driven by Your Voice
Junliang Li, Kai Ye, Haolan Kang, Mingxuan Liang, Yuhang Wu, Zhenhua Liu, Huiping Zhuang, Rui Huang, Yongquan Chen
ChildPlay-Hand: A Dataset of Hand Manipulations in the Wild
Arya Farkhondeh, Samy Tafasca, Jean-Marc Odobez
ManiDext: Hand-Object Manipulation Synthesis via Continuous Correspondence Embeddings and Residual-Guided Diffusion
Jiajun Zhang, Yuxiang Zhang, Liang An, Mengcheng Li, Hongwen Zhang, Zonghai Hu, Yebin Liu