3D Hand Pose Estimation

Ask about this topic

Overview

The field estimates a hand’s 3D articulation, shape, and sometimes motion in camera or world coordinates, supporting applications such as interaction analysis, sign-language capture, and robot teleoperation. Common approaches combine image or depth features with parametric hand models, transformers, geometric and kinematic constraints, and temporal or generative motion priors; some also fuse multiple views, inertial sensors, or electromyography. Evaluation spans benchmarks such as FreiHAND, InterHand2.6M, DexYCB, HO3D, HOT3D, and ARCTIC, covering single-image pose, egocentric video, and hand-object interaction. Persistent challenges include occlusion and hands leaving the view, reliable metric scale and camera-motion recovery, and generalization from limited annotations to varied real-world settings.

Latest papers

CardsList

69 papers16 papers in the last four weeks, up 167% on the four weeks before. 0.1% of all new papers.

  1. EgoHand: Monocular 3D Hand Reconstruction from Egocentric Video

    Oct 21, 2026Chao-Yeh Chen, Tiffany Chen, Lin Duan +123D Hand Reconstruction3D Hand Pose Estimation

    NVIDIA

  2. V-JEPA Hand: Simple, Accurate and Fast 3D Hand and Camera Trajectory Recovery from Egocentric Videos

    Oct 19, 2026Ruicheng Li, Qixiu Li, Yu Deng +33D Hand Pose EstimationEgocentric Video Understanding

    1Tsinghua University · 2Microsoft Research

  3. Perceive, Predict, and Plan: a Unified World Action Model for Egocentric Dexterous Manipulation

    Oct 15, 2026Zirui Wu, Chen Guo, Tianjian Jiang +11World Action ModelsAction-Conditioned Video Generation

    HKUST (GZ) · Primatix · ETH Zurich +3

  4. DreamHMR: From Video Generation to Human Motion Modeling via Structural Focusing

    Oct 14, 2026Zhengjie Xu, Ruihao Gong, Xianglong LiuHuman Mesh Recovery3D Human Reconstruction

    Beihang University

  5. EgoWholeView: Camera-Only Head-Mounted Capture of Body and Bimanual Hand Motion for Embodied Demonstrations

    Oct 12, 2026Yaoqing Hu, Xuguo He, Daohan Cui +2Markerless Motion Capture3D Human Pose Estimation

    Zhongguancun Academy · DeepCybo · Beijing University of Chemical Technology +1

  6. YOCO: You Only Calibrate Once! Fast Mocap Calibration for Dexterous Teleoperation

    Oct 8, 2026Yu Zhang, Yunqi Li, Yushi Du +2Post-Hoc Calibration3D Hand Pose Estimation

    The University of Hong Kong · Shenzhen Loop Area Institute · TranscEngram

  7. Video-Conditioned Generative Joint 2D-3D Hand Motion Recovery

    Oct 7, 2026Chen Xu, Yunqi Li, Binbin Huang +33D Hand Reconstruction3D Hand Pose Estimation

    The University of Hong Kong · UC Berkeley

  8. RLHND: Video Foundation Models as Physically Grounded Hand Trackers for Robot Learning

    Oct 7, 2026Seungjun Moon, Subin Jeon, Sangwoo Kim +23D Hand Pose EstimationTactile Sensing for Robotic Manipulation

    RLWRLD · KAIST · Seoul National University

  9. StableGrasp: Reconstructing Physically Stable Human Hand Grasps from Single Images

    Oct 6, 2026Han Jiang, Etienne Vouga, Qixing Huang +13D Hand Pose Estimation

    Department of Computer Science The University of Texas at Austin Austin, TX 78712, USA

  10. VICON: Visual-Inertial-Contact based Hand-Object Tracking for Manipulation Datasets

    Oct 4, 2026Youbeen Jeon, Uiseong Shin, Hwanchul La +3Robot Manipulation Datasets3D Hand Pose Estimation

    DGIST, Daegu 42988, Republic of Korea · Seoul National University, Republic of Korea

  11. EVFormer: An Egocentric Vision-EMG Bidirectional Attention Model for Bimanual Hand Pose Estimation

    Oct 3, 2026JiaCheng Ge, SiYu Zhang, ShengJie Li +13D Hand Pose EstimationMultimodal Sensor Fusion

  12. EgoFound3R: End-to-End Egocentric Hand Reconstruction in World Space with Point-Wise Interaction Attributes

    Oct 1, 2026Hongming Fu, Jingcheng Shi, Wenjia Wang +23D Hand Pose Estimation3D Reconstruction

    School of AI, Shanghai Jiao Tong University · Rutgers University · The University of Hong Kong +1

  13. EFormer: Temporally Aligned Local Correction for Continuous sEMG-Based Hand Pose Tracking

    Sep 30, 2026JiaCheng Ge, SiYu Zhang3D Hand Pose EstimationSurface Electromyography

  14. InfiniHand: Streaming World-Space Hand Motion Estimation from Egocentric Video

    Sep 28, 2026Kerui Ren, Kaiwen Song, Weiguang Zhao +83D Hand Pose EstimationCamera Pose Estimation

    Shanghai Artificial Intelligence Laboratory · Shanghai Jiao Tong University · University of Science and Technology of China +4

  15. ESTHER: Egocentric Stereo Hand Estimation and Reconstruction in the Wild

    Sep 28, 2026Hongyu Ma, Hairong Qu, Shiqi Zhao +2Articulated Object Reconstruction3D Hand Pose Estimation

    City University of Hong Kong

  16. Functional Hand Type Prior for 3D Hand Pose Estimation and Action Recognition from Egocentric View Monocular Videos

    Sep 28, 2026Wonseok Roh, Seung Hyun Lee, Won Jeong Ryoo +53D Hand Pose EstimationHand-Object Interaction Detection

    Department of Artificial Intelligence, Korea University, Seoul, Republic of Korea · Electrical and Computer Engineering, Purdue University, West Lafayette, Indiana, USA

  17. Estimating Accurate Hand Pose in Camera Space with Vision Transformer

    Sep 21, 2026Kaiwen Ren, Yiran Jiang, Yongjing Ye +13D Hand Pose Estimation

    Institute of Computing Technology, Chinese Academy of Sciences University of Chinese Academy of Sciences Beijing, China

  18. EventEgoHands++: Event-based Egocentric 3D Hand Mesh Reconstruction with Real Dataset

    Sep 15, 2026Ryosei Hara, Wataru Ikeda, Masashi Hatano +1Event-Based Vision3D Hand Pose Estimation

    Graduate School of Science and Technology, Keio University, Yokohama, Kanagawa 223-8522, Japan · JST Presto

  19. MEgoVista: Multi-view Ego-aware Motion Estimation for Metric 4D Hands and Head in the Wild

    Sep 15, 2026Jiangong Xiao, Chao Ma, Zhihao Zhang +19Markerless Motion Capture3D Hand Pose Estimation

    Northwestern Polytechnical University · Maniformer · Xi’an Jiaotong University

  20. Beyond Gestures: Estimating Full Hand Pose and Contact Forces from Wrist-Worn Pressure Sensor Array

    Sep 15, 2026Svetoslav Kolev, Lingni Ma, Michael Goesele +3Tactile Sensing3D Hand Pose Estimation

    Meta Reality Labs Research

  21. KAD-Net: Kinematics-Aware Decoupled Learning for Robust 3D Hand Pose Estimation from a Single Depth Image

    Sep 11, 2026Jun Lu, Zhenming Chen, Lin Chen +33D Hand Pose EstimationMulti-Task Learning

    College of Intelligence and Computing, Tianjin University, Tianjin, China. · National Center for Applied Mathematics in Chongqing, Chongqing Normal University, Chongqing, China. · State Key Laboratory of Intelligent Vehicle Safety Technology, Chongqing Chang’an Automobile Co., Ltd., Chongqing, China.

  22. MINT: A Unified Model for World-Space Camera and Hand Motion Estimation from Scalable Egocentric Pipeline Supervision

    Sep 4, 2026Zijie Zhu, Weiren Cai, Yizhou Wang +43D Hand Pose EstimationCamera Pose Estimation

    1ShanghaiTech University · 3Wuji Technology · 4The University of Hong Kong +2

  23. GraspHOI: Full-Body 3D Human-Object Reconstruction with Finger-Level Grasps from a Single In-the-Wild Image

    Aug 28, 2026Semin Kim, Haechan Shin, Jongyoo Kim3D Hand Pose Estimation3D Reconstruction

    Yonsei University

  24. Fiber Optic Sensing Glove for High Performance Dexterous Manipulation Capture

    Aug 25, 2026J. D. Peiffer, Taylor Niehues, Li Guan +23D Hand Pose EstimationWearable Sensing

    Meta, Redmond, Washington, 98052, USA · Department of Biomedical Engineering, Northwestern University, Evanston, Illinois, 60208, USA · Work done at Meta

  25. TransHands: Repurposing Human Pose Encoders as Hand Pose Encoders

    Aug 23, 2026Milo Piccioli, Gianluca Amprimo, Claudia Ferraris +13D Hand Pose EstimationTransfer Learning

    Politecnico di Torino, Torino, Italy · Consiglio Nazionale delle Ricerche, Torino, Italy

  26. ACE-Ego-Hand: Repurposing Video Diffusion Models for Occlusion-Robust Egocentric 3D Hand Motion Recovery

    Aug 20, 2026Yufei Liu, Xixi Wang, Hao Li +8Video Diffusion Models3D Hand Pose Estimation

    1Shanghai Jiao Tong University · 2Nanyang Technological University · 3The Chinese University of Hong Kong +1

  27. HandMvNet: Real-Time 3D Hand Pose Estimation Using Multi-View Cross-Attention Fusion

    Aug 20, 2026Muhammad Asad Ali, Nadia Robertini, Didier StrickerCross-View Attention3D Hand Pose Estimation

    Augmented Vision Group, German Research Center for Artificial Intelligence (DFKI), Kaiserslautern, Germany · Department of Computer Science, University of Kaiserslautern-Landau (RPTU), Kaiserslautern, Germany

  28. HandSplatter: Automated Digital Goniometry from Neural Rendering

    Aug 10, 2026Emmett Chen, Neal Chen, Xiang Li +23D Hand Pose Estimation

    CAMCA Massachusetts General Hospital Boston, USA · Department of Orthopedic Surgery Massachusetts General Hospital Boston, USA

  29. Exo2EgoPose: Leveraging Exocentric Demonstrations for Vision-Language guided Egocentric 3D Hand Pose Forecasting

    Jul 17, 2026Zhaofeng Shi, Heqian Qiu, Lanxiao Wang +23D Hand Pose EstimationCross-Embodiment Robot Learning

    University of Electronic Science and Technology of China Chengdu, Sichuan, China

  30. HandFlow: Fully Generative 4D Hand Recovery with Flow Matching

    Jul 13, 2026Mingxi Xu, Bowen Duan, Yi Gu +3Articulated Object Reconstruction4D Reconstruction

    The Hong Kong University of Science and Technology (Guangzhou), China · Google, USA