cs.ROSep 1, 2026

DSG: Dynamic 3D Scene Graph Construction for Embodied Agents in Changing Indoor Environments

Authors: Ming LiaoChao YeJianing FeiWeiyang Lin

Abstract

In indoor environments, object positions frequently change due to human activities or embodied-agent interactions, causing previously constructed scene graphs to become inconsistent with the current scene. To address this issue, we propose DSG, a dynamic 3D scene graph construction framework that detects object changes and performs spatial relationship reasoning. First, we construct a semantic-aware 3D Gaussian scene representation and develop a dual-view rendering-based object change detection method to enable reliable scene graph node updates. Second, we propose a spatial relationship reasoning method that incorporates multi-granularity visual context, enabling a large language model to identify a richer set of interobject spatial relationships. Furthermore, we introduce DynTHOR, a dynamic indoor scene graph benchmark built on the AI2-THOR simulation platform for evaluating scene graph construction in dynamic environments. Extensive experiments on Dyn-THOR, 3RScan, and real-world scenes demonstrate that DSG consistently outperforms existing methods in both object node construction and spatial relationship reasoning, significantly improving the accuracy of dynamic scene graph construction.

Explore similar work

CardsList
  1. 3D Scene Graphs: Open Challenges and Future Directions

    Jun 15, 2026Dennis Rotondi, Francesco Argenziano, Sebastian Koch +103D Scene GraphsAffordances