cs.CVNov 18, 2026

CoRelate: Coordinated Human-Object Motion Synthesis through Interaction Relations

Authors: Zhiwen Qiu, Daisy Lin, Diyu Zhou, Jialin Wu, Rosita Ji, Saleh Kalantari

Organizations: Cornell University

Abstract

Human-object motion synthesis requires coordinated human participation as objects move toward specified goals. However, reaching object targets does not ensure that contact is established and maintained, while adjustments that improve contact may interfere with task completion. We introduce CoRelate, a diffusion framework that coordinates full-body human-object motion through explicit interaction relations and task feedback for rigid and articulated objects. We represent intended participation through hand-part relations that specify the participating hand, its part-relative reference position, and participation interval. These relations serve both as generation conditions and as references for measuring interaction realization. At each denoising step, a temporal refiner trained jointly with the generator combines relation deviations, task residuals, and motion features from the current prediction to jointly update human and object motion across the sequence. After generation, temporal motion correction addresses remaining contact failures by optimizing local motion segments while preserving object trajectories and protected human motion. Experiments demonstrate improved object-goal satisfaction, contact F1, and complete interaction success over the evaluated baselines. Ablation studies support the benefits of relation conditioning and the complementary roles of task and relation feedback.

Figures & tables

Explore similar work

CardsList
  1. PAMI: Part Anchored Motion for Text to Human-Object Interaction Generation

    Sep 29, 2026Chuqiao Li, Xianghui Xie, Yong Cao +2HOI GenerationText-to-Motion Generation

  2. GIRAF: Towards Generalizable Human Interactions with Articulated Objects

    Jul 8, 2026Xiaohan Zhang, Sebastian Starke, Alexander Winkler +3HOI GenerationText-to-Motion Generation