cs.CVNov 6, 2026

RigidGS: Geometry-Aware Object Decoupling for Rigid-Body Interaction in 3D Gaussian Splatting

Authors: Paul Sansah Gyreyiri, Diksha Shukla

Organizations: University of Wyoming, Laramie, WY, USA

Abstract

Interactive VR/MR applications demand photorealistic 3D representations that support real-time rendering and object-level manipulation. While 3D Gaussian Splatting (3DGS) achieves high rendering quality, it represents scenes as unstructured, monolithic primitives. Existing object-aware 3DGS methods jointly optimize geometry and semantic states but suffer from two key failure modes: noisy foundation-model masks on complex geometry, and label-geometry coupling, in which co-optimized identity gradients mislabel boundary Gaussians. We introduce RigidGS, an end-to-end pipeline that decouples geometric learning from object identity. We propose a depth- and temporally-aware mask refinement module that addresses two complementary SAM2 failures: over-inclusion on thin structures and under-inclusion on multimodal-depth objects. We then determine object identities entirely upstream via COLMAP projection voting and freeze them during training, directing mask supervision solely toward geometric optimization. Refined masks alone substantially improve competing methods, yet a residual gap in label-geometry coupling persists that our fixed-identity design eliminates. RigidGS outperforms prior object-aware 3DGS methods on LLFF/NVOS, Mip-NeRF360, and iNeRF360, improving segmentation and boundary IoU by 7.7 and 14.5 points on LLFF/NVOS. Finally, RigidGS enables real-time rigid-body manipulation on Meta Quest2 without mesh extraction. Our code and project page are available at https://gyreyirisansah.github.io/rigidgs.

Figures & tables

Explore similar work

CardsList
  1. OP2GS: Object-Aware 3D Gaussian Splatting with Dual-Opacity Primitives

    May 19, 2026Guiyu Liu, Niklas Vaara, Janne Mustaniemi +23D Gaussian SplattingOpen-Vocabulary 3D Segmentation

  2. Geometry Gaussians: Decoupling Appearance and Geometry in Gaussian Splatting

    Jun 3, 2026Hongyu Zhou, Zorah Lähner3D Gaussian Splatting3D Reconstruction

  3. PointGauss: Point Cloud-Guided Multi-Object Segmentation for Gaussian Splatting

    Aug 1, 2025Wentao Sun, Yiping Chen, John S. Zelek +13D Gaussian Splatting3DGS Segmentation