cs.CVNov 11, 2026

CGOcc: Learning Cross-Gaussian Dependencies for 3D Semantic Occupancy Prediction

Authors: Zirui Huang, Jiongle He, Yunfan Zeng, Yuanzhi Lu, Guangye Li, Boyan Tang, Weite SU, Pedro V. Sander, 

Organizations: Hong Kong University of Science and Technology · Nanyang Technological University · The Hong Kong University of Science and Technology (Guangzhou) · The University of Hong Kong · 

Abstract

In Gaussian-based semantic occupancy prediction, overlapping primitives can provide ambiguous class predictions, making their joint interpretation important for voxel classification. However, current methods using spatially weighted mixtures neglect explicit modeling of cross-primitive dependencies, limiting the readout's ability to utilize category-specific relational evidence. Hence, we introduce CGOcc, a supervised multi-camera framework that explicitly models Cross-Gaussian dependencies for 3D semantic Occupancy prediction. CGOcc integrates appearance and geometric observations to refine Gaussian states and encodes cross-Gaussian dependencies in a diagonal-plus-low-rank representation. To incorporate these dependencies into voxel classification, CGOcc uses a class-conditional projection to extract diagonal and signed cross-Gaussian statistics without constructing a dense dependency matrix. The readout then refines occupied-class probabilities using these statistics while preserving a learned reference's occupied mass and free probability. Extensive experiments on nuScenes demonstrate CGOcc achieves state-of-the-art performance, with larger gains at high Gaussian overlap and improved predictions near boundaries. Ablation studies validate the effectiveness of covariance-aware prediction and support its synergy with geometric interaction.

Figures & tables

Appendix figures & tables5 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RayOcc: Occlusion-Aware Ray Occupancy Estimation via Gaussian Mixture Intensity

    Jul 20, 2026Junho Kim, Seongwon LeeSemantic Occupancy Mapping3D Occupancy Prediction

  2. VGOcc: Learning Visual-Geometric Gaussians for Vision-Centric 3D Driving Occupancy Prediction

    Jul 20, 2026Junhong Lin, Xianda Guo, Kangli Wang +4Autonomous Driving3D Occupancy Prediction