cs.ROJan 14, 2026

SyncTwin: Fast Digital Twin Construction and Synchronization for Safe Robotic Manipulation

Authors: Ruopeng Huang, Boyu Yang, Wenlong Gui, Jeremy Morgan, Erdem Biyik, Jiachen Li

Organizations: University of California, Riverside · University of Southern California

Abstract

Accurate and safe robotic manipulation under dynamic and visually occluded conditions remains a core challenge in real-world deployment. We introduce SyncTwin, a novel digital twin framework that unifies fast 3D scene reconstruction and real-to-sim synchronization for robust and safety-aware robotic manipulation in such environments. In the offline stage, we employ VGGT to rapidly reconstruct object-level 3D assets from RGB images, forming a reusable geometry library. During execution, SyncTwin continuously synchronizes the digital twin by tracking real-world object states and uses stored assets to complete partially observed geometry. The synchronized twin enables motion planners to compute collision-aware robot trajectories in simulation, with execution on the real robot closing the real-to-sim-to-real loop. Experiments in dynamic and occluded scenes show that SyncTwin improves manipulation performance and motion safety, demonstrating the effectiveness of digital twin synchronization for real-world robotic execution.

Figures & tables

Explore similar work

CardsList
  1. ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos

    Jun 23, 2026Pranjal Mishra, René Zurbrügg, Max Wilder-Smith +4Articulated Object Reconstruction3D Gaussian Splatting

  2. GaussTwin: Unified Simulation and Correction with Gaussian Splatting for Robotic Digital Twins

    Mar 5, 2026Yichen Cai, Paul Jansonnie, Cristiana de Farias +2Digital TwinsRobotics Simulation

  3. VPTwin: Real-Sim-Real Video Prediction for Robotic Manipulation Planning

    Sep 27, 2026Zhenghao Xiao, Minting Pan, Nantian He +2Action-Conditioned Video GenerationRobotic Manipulation