cs.CVOct 13, 2026

SWORD: Scene-Grounded Wasserstein Object-Relation Distance for 3D Scene Graph Prediction

Authors: U-Chae Jun, Jaeeun Ko, Yoonhyuk Choi, Jiwoo Kang

Organizations: Sookmyung Women’s University, Seoul, South Korea

Abstract

3D scene graph prediction is commonly optimized with object-node and relation-edge classification losses. These objectives encourage exact object and relation label recovery, but they do not directly optimize semantic proximity to the ground-truth scene graph: two wrong graphs can receive comparable penalties even when one is much closer in object roles and relation contexts. A direct graph-distance loss is difficult in general, since graph matching and graph edit distance require correspondence search and edit-cost design. Our key observation is that prior supervised 3D scene graph prediction protocols are conducted on fixed object-node indices and supervised edge slots. This can turn a scene graph comparison into a well-defined aligned graph-distance problem. To this end, we propose SWORD, a Scene-Grounded Wasserstein Object-Relation Distance that builds block-normalized object and relation ground distance metrics from training scene graph annotations through a deterministic base-to-context order, without external semantic priors. SWORD lifts these metrics to Wasserstein distances over aligned node and null-augmented edge marginals, providing semantic graph-distance supervision beyond exact-label penalties while preserving the ground-truth graph as the unique zero-distance solution in aligned marginal probability space. We prove that SWORD is a strict metric on aligned marginal probabilistic scene graphs, preserves scene-graph-grounded substitution ordering, controls additive graph-grounded semantic observables, and yields a surrogate upper-bounding decoded semantic error.

Explore similar work

CardsList
  1. A Differentiable 3D Scene Graph Metric via Contextual Hellinger Triplet Geometry

    Oct 13, 2026U-Chae Jun, Yoonhyuk Choi, Jiwoo Kang3D SGGMetric Learning

  2. GraphWrit3R: End-to-End 3D Scene Graph Writing

    Sep 25, 2026Luka Milivojevic, Nikola Popovic, Sayan Deb Sarkar +43D SGG3D Scene Understanding

  3. GHOST: Geometry-Constrained Hybrid Diffusion for Open-Vocabulary 3D Scene Graph Generation

    Oct 12, 2026Changqun Feng, Wangxiandi Yin, Xin Hu +43D SGG3D Scene Understanding