3D Hand Pose Estimation

Follow this topic Ask about this topic

Momentum

11 papers in the last four weeks, up 175% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28

Latest papers 49

All topics

Open-CHOIR: Open-World Contact-Aware 4D Hand-Object Interaction Reconstruction
May 20, 2026Hao Xu, Yilin Liu, Yinqiao Wang +23D Hand Pose Estimation 3D Reconstruction
The Chinese University of Hong Kong, China · University College London, United Kingdom · Adobe Research, United Kingdom
StableHand: Quality-Aware Flow Matching for World-Space Dual-Hand Motion Estimation from Egocentric Video
May 18, 2026Huajian Zeng, Chaohua Yao, Yuantai Zhang +3Flow Matching 3D Hand Pose Estimation
Mohamed bin Zayed University of Artificial Intelligence · University of Illinois at Urbana-Champaign · Imperial College London
DanceHMR: Hand-Aware Whole-Body Human Mesh Recovery from Monocular Videos
May 18, 2026Wenhao Shen, Ming Zhou, Hengyuan Zhang +33D Hand Pose Estimation Human Mesh Recovery
ByteDance Intelligent Creation
UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation
May 18, 2026Tianhao Han, Haoyang Zhang, Liang Xie +5Uncertainty Quantification Self-Supervised Learning
School of Computer Science, Shanghai Jiao Tong University · Defense Innovation Institute, Academy of Military Sciences · Tianjin Artificial Intelligence Innovation Center +3
GeoHand: Unlocking Prior Geometry Knowledge for Monocular 3D Hand Reconstruction
May 17, 2026Weiquan Lin, Yaoqing Hu, Liangchen Dai +23D Hand Pose Estimation Monocular 3D Reconstruction
School of Artificial Intelligence, Xidian University · Zhongguancun Academy · School of Automation, Beijing Institute of Technology
Rethinking Graph Convolution for 2D-to-3D Hand Pose Lifting
May 13, 2026Chanyoung Kim, Donghyun Kim, Dong-Hyun Sim +2Graph Attention Networks Graph Representation Learning
Emory University · Yonsei University · WHATs Lab
EgoForce: Forearm-Guided Camera-Space 3D Hand Pose from a Monocular Egocentric Camera
May 12, 2026Christen Millerdurai, Shaoxiang Wang, Yaxu Xie +33D Hand Pose Estimation Monocular 3D Reconstruction
Deutsches Forschungszentrum für Künstliche Intelligenz (DFKI), Kaiserslautern, Germany · Max Planck Institute for Informatics (MPII), Saarbrücken, Germany
EgoEV-HandPose: Egocentric 3D Hand Pose Estimation and Gesture Recognition with Stereo Event Cameras
May 12, 2026Luming Wang, Hao Shi, Jiajun Zhai +2Event-Based Vision 3D Hand Pose Estimation
National Research Center for Optical Instrumentation, Zhejiang University, Hangzhou 310027, China · Ant Group Company Ltd., Hangzhou 310013, China · School of Artificial Intelligence and Robotics and the National Engineering Research Center of Robot Visual Perception and Control Technology, Hunan University, Changsha 410082, China +1
Monocular Biomechanical Tracking of Fingers with Inverse Kinematics to Foundation Models
May 10, 2026R. James Cotton, Pouyan Firouzabadi, Wendy MurrayMarkerless Motion Capture 3D Hand Pose Estimation
1Shirley Ryan AbilityLab · Department of Physical Medicine and Rehabilitation, Northwestern University · Department of Biomedical Engineering, Northwestern University
EggHand: A Multimodal Foundation Model for Egocentric Hand Pose Forecasting
May 8, 2026Jaeyoung Choi, Hyeondong Kim, Yujin Kim +13D Hand Pose Estimation Egocentric Video Understanding
DGIST, Republic of Korea
EgoEMG: A Multimodal Egocentric Dataset with Bilateral EMG and Vision for Hand Pose Estimation
May 7, 2026Ziheng Xi, Jiayi Yu, Yitao Wang +3EMG-Based Gesture Recognition 3D Hand Pose Estimation
Department of Automation, Tsinghua University
Tamaththul3D: High-Fidelity 3D Saudi Sign Language Avatars from Monocular Video
May 6, 2026Eyad Alghamdi, Sattam Altuuaim, Obay Ghulam +23D Hand Pose Estimation 3D Reconstruction
University of Jeddah, Jeddah, Saudi Arabia · King Abdullah University of Science and Technology, Thuwal, Saudi Arabia
Decoding High-Dimensional Finger Motion from EMG Using Riemannian Features and RNNs
Apr 24, 2026Martin Colot, Cédric Simar, Guy Cheron +23D Hand Pose Estimation Neural Decoding
Machine Learning Group, ULB, Bruxelles, Belgium · § These authors contributed equally to this work and share ﬁrst authorship. · Neuromove, ULB Neuroscience Institute, ULB, Brussels, Belgium +1
GenHOI: Generalized Hand-Object Pose Estimation with Occlusion Awareness
Mar 19, 2026Hui Yang, Wei Sun, Jian Liu +63D Hand Pose Estimation OOD Generalization
NERC-RVC, Hunan University · National University of Singapore · Lancaster University +2
TrackStudio: An Integrated Toolkit for Markerless Tracking
Nov 10, 2025Hristo Dimitrov, Viktorija Pavalkyte, Giulia Dominijanni +1Markerless Motion Capture 3D Hand Pose Estimation
1MRC Cognition and Brain Sciences Unit, University of Cambridge · Center for Neuroprosthetics and School of Engineering, ´Ecole Polytechnique F´ed´erale de Lausanne
Affordance-Guided Diffusion Prior for 3D Hand Reconstruction
Oct 1, 2025Naru Suzuki, Takehiko Ohkawa, Tatsuro Banno +33D Hand Pose Estimation Diffusion Models
The University of Tokyo · KAIST
Enhancing Monocular 3D Hand Reconstruction with Learned Texture Priors
Aug 13, 2025Giorgos Karvounas, Nikolaos Kyriazis, Iason Oikonomidis +23D Hand Pose Estimation 3D Reconstruction
1ICS-FORTH · University of Crete · University of Texas at Austin
Occlusion-Aware 3D Hand-Object Pose Estimation with Masked AutoEncoders
Jun 12, 2025Hui Yang, Wei Sun, Jian Liu +3Masked Autoencoders 3D Hand Pose Estimation
National Engineering Research Center for Robot Visual Perception and Control Technology, School of Artificial Intelligence and Robotics, Hunan University, Changsha, 410082, China · School of Architecture and Art, Central South University, Changsha, 410082, China · Department of Computer Science and Software Engineering, The University of Western Australia, WA 6009, Australia
Multi-view Hand Reconstruction with a Point-Embedded Transformer
Aug 20, 2024Lixin Yang, Licheng Zhong, Pengxiang Zhu +43D ViTs Markerless Motion Capture
School of Artificial Intelligence (SAI), Shanghai Jiao Tong University, Shanghai 200230, China · School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China · School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China +1

May 20, 2026, cs.CVJ/K move · Enter open · S save

Open-CHOIR: Open-World Contact-Aware 4D Hand-Object Interaction Reconstruction

Hao Xu, Yilin Liu, Yinqiao Wang, Chi-Wing Fu+1

The Chinese University of Hong Kong, China · University College London, United Kingdom · Adobe Research, United Kingdom

3D Hand Pose Estimation 3D Reconstruction Monocular 3D Reconstruction Object Pose Estimation Human-Object Interaction

Open paper AskPDF arXiv

We ask whether everyday open-world monocular videos can be turned into reusable 4D interaction primitives: articulated hand motion, object shape with 6D pose over time, and the when/where of contact. Such a capability would enable scalable mining of real interactions and, beyond reconstruction, support scene-aware synthesis and planning. However, reconstructing hand-object interaction (HOI) from challenging monocular videos remains difficult: methods often assume known objects or curated scenes, and separately estimated hands and objects easily become misaligned under clutter, occlusion, and unseen object geometries. Targeting this setting, we present Open-CHOIR, an Open-world Contact-aware HOI Reconstruction framework for a monocular camera, using contact as an explicit coupling signal between hands and objects. Open-CHOIR first initializes a coarse, contact-agnostic 4D HOI sequence from open-world visual priors. It then introduces a generative HOI spatial rectification module to predict ray-depth corrections and rectify hand-object relative placement, then derive initial per-frame contact correspondences on the rectified geometry. Last, a contact-aware joint optimization with dynamically updated contact constraints enforces geometric, temporal, and contact consistency. Experiments on controlled and challenging videos show that Open-CHOIR improves object reconstruction, physical plausibility, and temporal consistency over state-of-the-art methods. Code, data, and pretrained weights are available at https://github.com/hxwork/CHOIR.

Momentum

Related topics

Latest papers 49