cs.CVNov 4, 2026

Feature Puzzles: Single-Image Supervision for Multi-View 3D-Aware Segmentation

Authors: Jiahao Ma, Qiang Zhang, Miaomiao Liu, David Ahmedt-Aristizabal, Chuong Nguyen

Organizations: Australian National University · CSIRO, Australia · University of Science and Technology of China

Abstract

Humans can easily recognize the same objects across different viewpoints of a 3D scene, whereas teaching models such multi-view-consistent perception typically requires videos or calibrated multi-view captures, which are considerably more expensive and less diverse than large-scale monocular data.~In this paper, we introduce Feature Puzzles, a novel framework for learning multi-view-consistent segmentation using only single-image semantic segmentation supervision. Specifically, we propose a simple yet effective pipeline that constructs multi-view-consistent segmentation pseudo-labels through image cropping and geometric transformations. We further introduce a lightweight, plug-and-play network that leverages the multi-view-consistent image features learned by existing pretrained 3D foundation models and the generated pseudo-labels to perform multi-view-consistent segmentation. Importantly, our flexible framework supports various types of prompts provided from one or multiple views and can be readily extended to open-vocabulary 3D segmentation. Under this single-image supervision, our feed-forward model achieves the best mIoU on NVOS, remains competitive on SPIn-NeRF and ScanNet++ against baselines using per-scene optimization or in-domain multi-view training, and demonstrates zero-shot transfer to open-vocabulary 3D segmentation. Visual comparisons are available on our project page: https://featurepuzzles.github.io/

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Multi-View Foundation Models

    Dec 17, 2025Leo Segre, Or Hirschorn, Shai AvidanMulti-View ConsistencyVision Foundation Model Adaptation

  2. EPS3D: End-to-End Feed-Forward 3D Panoptic Segmentation

    Jun 8, 2026Runsong Zhu, Jiaxin Guo, Xiaoyang Guo +9Panoptic SegmentationOpen-Vocabulary 3D Segmentation

  3. 3D Segmentation Using Viewpoint-Dependent Spatial Relationships

    May 15, 2026Ayaka Nanri, Klara Reichard, Mert Kiray +33D Spatial Reasoning3D Referring Segmentation