cs.CVNov 14, 2026

Prepare Lighter and Faster for Open-Vocabulary Queries: A Query-Wise 3D Segmenter for Gaussian Splatting

Authors: Nhat-Quynh Le-Pham, Khoi Nguyen, Binh-Son Hua

Organizations: Qualcomm AI Research†

Abstract

Open-vocabulary 3D understanding aims to localize and segment arbitrary objects beyond predefined categories. However, existing approaches based on Gaussian Splatting often rely on expensive preprocessing and lengthy training, limiting their applicability when fast and lightweight solutions are desired. We propose a lightweight, training-free framework for query-driven 3D instance segmentation on Gaussian Splatting. Instead of conventional mask-wise CLIP embeddings, we use dense pixel-level CLIP features to preserve fine-grained semantic information and enable flexible text-driven localization without relying on predefined instance proposals. Given a text query, we identify a high-quality target region in a carefully selected pivot view and propagate it across views using a video segmentor, providing consistent and comprehensive coverage of the target instance. We then lift the resulting 2D tracklets to 3D Gaussians through a novel visibility voting strategy, yielding accurate 3D segmentation masks with clean object boundaries. Extensive experiments demonstrate state-of-the-art performance on LERF-OVS, ScanNet, and ScanNet++, competitive results on 3D-OVS, and significant speedups over existing open-vocabulary 3D segmentation methods. These results highlight the effectiveness of our framework for efficient open-vocabulary 3D understanding without per-scene training.

Figures & tables

Explore similar work

CardsList
  1. Ilov3Splat: Instance-Level Open-Vocabulary 3D Scene Understanding in Gaussian Splatting

    May 6, 2026Binh Long Nguyen, Kien Nguyen, Sridha Sridharan +23D Gaussian SplattingLanguage-Embedded 3DGS

  2. Relation-Centric Open-Vocabulary 3D Gaussian Segmentation

    Jul 1, 2026Eunsung Cha, Hyunjoon Lee, Jaesik Park3D Gaussian SplattingOpen-Vocabulary 3D Segmentation