cs.ROAug 12, 2026

Operational digital twin clinics enable task-based evaluation of embodied AI

Authors: Xinyuan Wu, Jingrao Zhang, Mengdi Xu, Henry K. Chu, Mingguang He, Danli Shi

Organizations: School of Optometry, The Hong Kong Polytechnic University, Hong Kong SAR, China. · Faculty of Science and Technology, University of Macau, Macau, China. · Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing, China. · Department of Mechanical Engineering, The Hong Kong Polytechnic University, Hong Kong SAR, China. · 

Abstract

Embodied artificial intelligence (AI) must be tested in the clinical environments where it will operate, but building realistic, robot-testable settings is costly and difficult to scale. Here we show that routine clinic images can be transformed into operational digital twins for task-based evaluation of embodied AI. Using 39 ophthalmic clinic scenes, we converted single photographs into editable, simulator-ready environments and assessed reconstruction quality, room-scale geometry, mesh grounding, multi-robot feasibility, perturbation sensitivity and closed-loop policy performance. The reconstructed scenes preserved workspace structure, while local editing enabled controlled device reconfiguration. Device meshes, collision proxies and semantic anchors converted visual reconstructions into contact-aware simulation scenes. Across three robot embodiments, shared task targets showed different patterns of reachability and contact feasibility. Small device translations and rotations produced task-specific changes in contact margins that were not captured by visual similarity alone. Digital-twin trajectories also supported local policy learning and closed-loop evaluation. These findings establish operational validity as a key principle for clinical digital twins and provide an intermediate layer between offline development and physical deployment of embodied AI in healthcare.

Explore similar work

CardsList
  1. EAST: Embodied AI Safety Testing via Systematic Fault Injection in Digital Twins

    Oct 25, 2026Yuhao Tian, Tao Li, Ling Zhou +5AI Safety EvaluationRobot Safety

  2. ArtiTwinSplat: Interactable Digital Twin Reconstruction via Gaussian Splatting from RGB-D videos

    Jun 23, 2026Pranjal Mishra, René Zurbrügg, Max Wilder-Smith +4Articulated Object Reconstruction3D Gaussian Splatting

  3. SimFoundry: Modular and Automated Scene Generation for Policy Learning and Evaluation

    Jun 26, 2026Nadun Ranawaka, Josiah Wong, Wei-Lin Pai +15Robotics SimulationSim-to-Real Transfer