3D Hand Pose Estimation

Ask about this topic

Overview

The field estimates a hand’s 3D articulation, shape, and sometimes motion in camera or world coordinates, supporting applications such as interaction analysis, sign-language capture, and robot teleoperation. Common approaches combine image or depth features with parametric hand models, transformers, geometric and kinematic constraints, and temporal or generative motion priors; some also fuse multiple views, inertial sensors, or electromyography. Evaluation spans benchmarks such as FreiHAND, InterHand2.6M, DexYCB, HO3D, HOT3D, and ARCTIC, covering single-image pose, egocentric video, and hand-object interaction. Persistent challenges include occlusion and hands leaving the view, reliable metric scale and camera-motion recovery, and generalization from limited annotations to varied real-world settings.

Latest papers

CardsList

69 papers16 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

  1. Enhancing Hands in 3D Whole-Body Pose Estimation with Conditional Hands Modulator

    Mar 16, 2026Gyeongsik Moon3D Human Pose Estimation3D Hand Pose Estimation

    Korea University

  2. DexEMG: Towards Dexterous Teleoperation System via EMG2Pose Generalization

    Mar 6, 2026Qianyou Zhao, Wenqiao Li, Chiyu Wang +1Robot TeleoperationRobotic Manipulation

    Sharpa · Shanghai Jiao Tong University

  3. WHOLE: World-Grounded Hand-Object Lifted from Egocentric Videos

    Feb 25, 2026Yufei Ye, Jiaman Li, Ryan Rong +1Hand-Object Interaction ReconstructionHand-Object Interaction

    Stanford University · Amazon FAR (Frontier AI & Robotics)

  4. UniHand: A Unified Model for Diverse Controlled 4D Hand Motion Modeling

    Feb 25, 2026Zhihao Sun, Tong Wu, Ruirui Tu +2Human Motion Generation3D Hand Pose Estimation

    Institute of Trustworthy Embodied AI (TEAI), Fudan University · Stanford University

  5. TrackStudio: An Integrated Toolkit for Markerless Tracking

    Nov 10, 2025Hristo Dimitrov, Viktorija Pavalkyte, Giulia Dominijanni +1Markerless Motion Capture3D Hand Pose Estimation

    1MRC Cognition and Brain Sciences Unit, University of Cambridge · Center for Neuroprosthetics and School of Engineering, ´Ecole Polytechnique F´ed´erale de Lausanne

  6. Affordance-Guided Diffusion Prior for 3D Hand Reconstruction

    Oct 1, 2025Naru Suzuki, Takehiko Ohkawa, Tatsuro Banno +33D Hand Pose EstimationHand-Object Interaction

    The University of Tokyo · KAIST

  7. Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors

    Aug 13, 2025Giorgos Karvounas, Nikolaos Kyriazis, Iason Oikonomidis +23D Hand Pose Estimation3D Reconstruction

    1ICS-FORTH · University of Crete · University of Texas at Austin

  8. Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders

    Jun 12, 2025Hui Yang, Wei Sun, Jian Liu +3Masked Autoencoders3D Hand Pose Estimation

    National Engineering Research Center for Robot Visual Perception and Control Technology, School of Artificial Intelligence and Robotics, Hunan University, Changsha, 410082, China · School of Architecture and Art, Central South University, Changsha, 410082, China · Department of Computer Science and Software Engineering, The University of Western Australia, WA 6009, Australia

  9. Multi-view Hand Reconstruction with a Point-Embedded Transformer

    Aug 20, 2024Lixin Yang, Licheng Zhong, Pengxiang Zhu +43D ViTsMarkerless Motion Capture

    School of Artificial Intelligence (SAI), Shanghai Jiao Tong University, Shanghai 200230, China · School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China +1