cs.CVNov 16, 2026

GRAZE: Text-Free Grasp Synthesis for Unseen Objects from Human Gaze

Authors: Jeongho Lee, Boeun Kim, Hyung Jin Chang, Jungchan Cho, Sang-Il Choi

Organizations: Dankook University · University of Birmingham · Gachon University

Abstract

Text-conditioned hand-object interaction (HOI) generation provides intuitive semantic control, but language is an indirect way to specify where an interaction should occur on an object. Naming the part to grasp requires object-specific words, and naming the approach side requires a reference frame that a prompt lacks. We propose GRAZE (GRAsp from gaZE), which generates hand-object grasp motion from recorded gaze instead of object and part names. Its Geometry-Aware Gaze Encoding (GeoGaze) maps gaze rays to cues on object geometry, and cross-attention conditions a diffusion Transformer on these cues. We also introduce HOT3D-Grasp, a grasp-centered benchmark with object-disjoint folds built on HOT3D recordings. On unseen objects, GRAZE grasps the target part more often than the strongest text-conditioned baseline (49.3% vs. 43.6%), achieves the highest grasp success (66.3% vs. 46.6%), and transfers without fine-tuning to GazeHOI (45.3% vs. 33.8%). Gaze conveys the approach side: when gaze is rotated around the object, the approach turns with it in 59.1% of cases, against 20.5% for a text model retrained with clock words. On the same backbone, a text prompt names parts better, but gaze adds the approach side. Given both, GRAZE keeps the prompt's part accuracy and follows gaze.

Figures & tables

Explore similar work

CardsList
  1. FunHOI: Annotation-Free 3D Hand-Object Interaction Generation via Functional Text Guidance

    Feb 28, 2025Yongqi Tian, Xueyu Sun, Haoyuan He +2HOI GenerationRobotic Grasping

  2. AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis

    Mar 9, 2026Xiaofei Wu, Yi Zhang, Yumeng Liu +3HOI GenerationRobotic Grasping

  3. Gaze2HOI: Gaze-Aware Intention Disambiguation for Egocentric Hand-Object Interaction Forecasting

    Oct 20, 2026Chuanyang Ma, Chenye Wang, Yixuan Wang +6Hand-Object InteractionHuman Motion Prediction