cs.CVNov 13, 2026

TelePhysica: Agentic Reconstruction of Physically Interactive Scenes

Authors: Ruiqi Shu, Xufeng Zhan, Yuanzhi Liang, Haibin Huang, Chi Zhang, Xuelong Li

Organizations: Institute of Artificial Intelligence, China Telecom (TeleAI)

Abstract

Direct image-to-video diffusion models entangle pixel synthesis with implicit latent motion, precluding persistent 3D mechanical equilibrium, mid-rollout intervention, and counterfactual force control. Conversely, single-pass programmatic 3D reconstruction from an uncalibrated photograph leaves monocular depth and support clearance underconstrained, causing reconstructed scenes to interpenetrate or collapse under gravity. We present TelePhysica, a closed-loop framework that reconstructs an executable, multi-regime physical world from a single photograph to drive stateful 3D interaction and trajectory-grounded video synthesis. A vision-language coding agent synthesizes separable visual meshes and declarative physical models within a two-stage verification loop that pairs pixel-aligned silhouette critique with a zero-force gravitational equilibrium preflight. The verified world compiles into a unified solver coupling rigid bodies, articulated chains, co-dimensional cloth shells, and 3D tetrahedral elastodynamics, whose simulated rollouts condition pretrained video diffusion models through pixel-aligned structural streams. On a 100-scene single-image benchmark, closed-loop execution raises equilibrium-verified world recovery from 0%0\% in single-pass synthesis to 81%81\%. Controlled constitutive ablations show over an order-of-magnitude larger localized corner displacement and out-of-plane pleating in finite-element cloth than in matched rigid-plate proxies. Conditioning video diffusion on simulated trajectories increases dynamic motion-mask overlap by 2×–5×2{\times}\text{--}5{\times} and preserves motion direction under counterfactual force reversals where direct image-to-video models fail.

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PhysOmni: Physics-Grounded Multi-Object Scene Generation from a Single Image with Real-Time Interaction

    May 19, 2026Xin Zhang, Yabo Chen, Yijie Fang +5Physical Consistency in Video GenerationReal-Time Interactive Video Generation

  2. φφ-Scene: Physically Grounded Image-to-3D Scene Reconstruction

    Jun 19, 2026Haodong Li, Lulu Shao, Haolin Lu +43D ReconstructionSingle-View 3D Reconstruction

  3. Fysiverse-3D-SimReady Technical Report: Agentic Physical Simulation for Pragmatic 3D World Reconstruction

    Sep 21, 2026Lintao Wang, Mingyang Sun, Yang Liu +23D Reconstruction3D Scene Generation