cs.CVOct 19, 2026

Where Do the Gaussians Go? Foreground Attraction for Camera-Based Weakly Supervised 3D Occupancy

Authors: Jeagon Song, Jhonghyun An

Organizations: School of Computing, Gachon University, Seongnam 13120, Republic of Korea.

Abstract

Camera-based 3D semantic occupancy models can be trained without 3D labels by rendering their predictions into the images and supervising them with 2D pseudo labels. In sparse Gaussian representations trained this way, Gaussian positions are learned only through pixel-wise rendering losses, which we hypothesize give small foreground objects little weight. In trained GaussianFlowOcc models, the Gaussian density on foreground voxels is on average only 1.62 times that on background voxels. We propose a training-only foreground attraction loss that back-projects foreground pseudo-label pixels with pseudo depth and pulls nearby Gaussians toward these 3D points, favoring Gaussians that already predict the target class; the inference network is unchanged. On Occ3D-nuScenes, the loss raises this concentration to 2.40 over three seeds. Over three seeds, the mean foreground IoU increases from 6.29 to 6.96 and is higher for each seed, whereas the change in mean mIoU (13.53 to 13.82) is within the seed-to-seed variation of the baseline. Single-run ablations further indicate that pseudo-label targets outperform targets placed at ground-truth voxels and that acting on the Gaussian positions alone is not sufficient, and a single-seed test shows that the model degrades less when fewer Gaussians are kept at inference.

Figures & tables

Explore similar work

CardsList
  1. LetOccVote: Learning Weakly Supervised 3D Occupancy through Consensus

    Sep 4, 2026Chi Zhang, Qi Song, Feifei Li +23D Occupancy PredictionPseudo-Labeling

  2. Learning Adaptive Semantic Gaussian Allocation for 3D Occupancy

    Jul 24, 2026Kanglin Ning, Yiran Zhao, Wenrui Li +43D Gaussian SplattingSemantic Occupancy Mapping

  3. VGOcc: Learning Visual-Geometric Gaussians for Vision-Centric 3D Driving Occupancy Prediction

    Jul 20, 2026Junhong Lin, Xianda Guo, Kangli Wang +4Autonomous Driving3D Occupancy Prediction