cs.CVNov 13, 2026

VACO: Vertex-Aligned Decoding for Dense Hand Contact Estimation from a Single Image

Authors: Binhong Ye, Jin-Chuan Shi, Tao Liu, Xin Wang, Hao Chen, Chunhua Shen

Organizations: State Key Lab of CAD & CG, Zhejiang University, China · Zhejiang University of Technology, China

Abstract

Dense hand contact estimation from a single RGB image is a foundational primitive for dexterous manipulation and 3D interaction analysis. Direct predictors typically decode the entire per-vertex contact map from one shared query, leaving individual vertices ungrounded in the image and smearing contact across adjacent, non-touching surfaces. We present VACO, a vertex-aligned decoder in which each MANO vertex samples local image features at its projected location. A hand-reconstruction backbone, jointly trained for reconstruction and contact, predicts these locations at inference without an auxiliary reconstructor. Training uses noise-perturbed ground-truth projections and end-to-end feature adaptation to improve robustness and contact-sensitive features. A single VACO checkpoint sets a new state of the art on five benchmarks spanning hand-object, hand-human, hand-scene, and bimanual interactions. It improves F1 by +20.7 pp over the strongest prior direct predictor on Hi4D and generalizes to the held-out HOT3D and HOCap, with gains of +5.5 and +2.7 pp. The resulting contact predictions also improve downstream HOI reconstruction.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Training-Free Dense Hand Contact Estimation with Multi-Modal Large Language Models

    May 7, 2026Daniel Sungho Jung, Kyoung Mu LeeHand-Object Contact Estimation

  2. TactoHand: Learning Geometry-Based Dense Hand-Surface Interaction Fields from Video

    Oct 29, 2026Ziheng Xi, Weibo Li, Jiayi Yu +6Visual-to-Tactile PredictionHand-Object Interaction Detection