cs.CVSep 17, 2026

SnapPhysics: A Physics-Aware Scene Graph from a Single View for Interactive Mixed Reality Scenes

Authors: Suji KangSeok-Young KimYoung Bin KimTaewook HaDieter SchmalstiegShohei MoriWoontack Woo

Organizations: KAIST UVR Lab · VISUS, University of Stuttgart · KAIST UVR Lab KAIST KI-ITC ARRC

Abstract

We propose SnapPhysics, a training-free framework that reconstructs 3D objects and estimates their physical properties such as mass, friction, and center of gravity from a single image. For physically coherent interactions in mixed reality (MR), such properties are as important as geometry. Prior approaches infer them by analyzing object dynamics in video, which is computationally costly, or by querying vision-language models (VLMs) on single images, which lacks geometric grounding and inter-object relationships. We address these limitations by combining instance-level 3D reconstruction and spatial alignment with a physics-aware scene graph that encodes these relationships and per-object metric geometry as structured context for VLM-based property reasoning. Experiments on 3D-FRONT show that SnapPhysics improves scene-level F-Score by 18.6% over the best learning-based method, and on real captured scenes with ground-truth mass, it reduces the mean absolute log difference error (mALDE) by up to 20.5% and improves log-scale correlation (rls2r^2_{\mathrm{ls}}) by up to 19.6% over VLM-only estimation. SnapPhysics enables physically interactive MR experiences without manual parameter tuning. Project page: https://snapphysics-ismar2026.github.io/.

Explore similar work

CardsList
  1. SiPhy: Single-Image Physical Property Reasoning

    Jul 24, 2026Hoang Le, Joonwoo Kwon, Elkhan Ismayilzada +2Single Images