cs.CVNov 19, 2026

MorphTwin: Enriching Deformable Material Responses from Videos for Morphable and Interactive Physical Twins

Authors: Haoqin Hong, Ding Fan, Fubin Dou, Tianyu Huang, Yuzhuo Chen, Zhemeng Zhang, Hanxiao Jiang, Congcong Zhu, 

Organizations: University of Science and Technology of China · City University of Hong Kong · Multimedia Laboratory, The University of Hong Kong · Columbia University

Abstract

Reconstructing interactive physical twins from video requires accurately capturing how objects deform while maintaining efficient simulation. We observe that reproducing motion in a video does not guarantee correct responses to new forces when the physical representation restricts how an object can deform. In spring-based twins, coupling between volume and shape responses creates such a limitation. We present MorphTwin, which enriches local deformation modes to capture and independently control these responses while retaining standard spring forces and explicit simulation. To support interpretable material editing and transfer, we use offline calibration to map shared relative response changes to stiffness updates on each reconstructed graph. Under identical inverse settings on synthetic scenes, MorphTwin reduces the mean absolute error of Poisson's ratio by 75.8% and the mean relative error of Young's modulus by 22.1% compared to PhysTwin. We introduce an egocentric stereo and RGB-D benchmark covering interactions with objects of varying stiffness. Real-world experiments demonstrate improved reconstruction accuracy and up to 14.4% lower future tracking error than PhysTwin at interactive speeds.

Figures & tables

Explore similar work

CardsList
  1. BendTwin: Robust Dense-to-Sparse Physical Reconstruction with Bending-Aware Differentiable Spring-Mass Models

    Aug 6, 2026Yixiong Jing, Qi Wang, Lin Chen +6Structural MechanicsSparse-View 3D Reconstruction

  2. MatPhys: Learning Material-Aware Physics Parameters for Deformable Object Simulation from Videos

    May 19, 2026Yang Yang, Yiyan Wang, Zheming Liu +1Dynamic Scene ReconstructionMaterials Property Prediction