cs.CVOct 7, 2026

From Digital Human Interactions to Physics-Based Humanoid Skills: Physics-Grounded Post-Training of Interaction Generators

Authors: Kerui Chen, Jianrong Zhang, Kai Lv, Hehe Fan

Organizations: College of Artificial Intelligence, Zhejiang University. · School of Computer Science and Technology, Beijing Jiaotong University.

Abstract

Recent methods have made promising progress in generating interactions between two humanoids, largely relying on physics-based tracking policies to convert digital reference motions into executable trajectories. However, limited tracking capabilities restrict the range of reference motions that can be successfully executed, reducing data utilization. Moreover, even successful tracking does not guarantee physically plausible responses or faithful realization of the intended interactions. In this paper, we introduce DIGHT, a co-adaptive framework that couples a Digital human Interaction Generator with a Humanoid Tracking policy. Our DIGHT first executes multiple text-conditioned interaction candidates in simulation using a fixed tracker. It then constructs physics-grounded preferences from the resulting rollouts, covering both general executability and interaction fidelity. Rather than collapsing these signals into a single scalar reward for candidate ranking, we align the pretrained generator using physics-decoupled diffusion direct preference optimization (DPO), preserving criterion-specific supervision without differentiating through the simulator. To improve executability, preference pairs are derived from tracking error, friction, and floating. Additionally, to improve interaction fidelity, we propose to incorporate force feedback from simulator as a measure of contact fidelity and construct preferences over contact occurrence, location, duration, and force magnitude. The aligned generator then supplies reference motions for fine-tuning the tracker, improving compatibility between generation and physical execution. Extensive experiments demonstrate that our approach not only improves the physical plausibility of generated motions but also enables more reliable and faithful humanoid interactions in simulation.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PhyGenHOI: Physically-Aware 4D Generation of Dynamic Human-Object Interactions

    May 28, 2026Omer Benishu, Gal Fiebelman, Sagie BenaimArticulated ObjectsHuman Motion Generation

  2. PhysiGen: Integrating Collision-Aware Physical Constraints for High-Fidelity Human-Human Interaction Generation

    May 1, 2026Nan Lei, Yuan-Ming Li, Ling-An Zeng +5Human Motion GenerationHuman Mesh Recovery

  3. InterPhys: Physics-aware Human Motion Synthesis in a Dynamic Scene

    May 1, 2026Chaoyue Xing, Wei Mao, Miaomiao LiuHuman MotionHuman Motion Generation