cs.CVNov 10, 2026

UGG: Unified Generative Geometry Model

Authors: Amani Kiruga, Zhiyi Li, Ruojin Cai, Hansen Lillemark, Xiaoshan Wu, Ayush Tewari, Yilun Du

Organizations: Harvard University · MIT · UC San Diego · University of Cambridge

Abstract

Understanding 4D scenes is a core challenge in visual intelligence, requiring models to jointly capture scene geometry, appearance, and dynamics from partial observations. However, existing approaches are subdivided into feedforward models for direct geometric prediction, and generative models for visual synthesis. We introduce UGG, a unified framework for 4D scene understanding that jointly models RGB video and geometric representations such as depth and camera pose. By assigning different noise levels across modalities and time, UGG formulates visual generation and geometric prediction as conditional completion within a single generative model. This flexible formulation enables the model to learn from diverse, heterogeneous datasets with different subsets of geometric and visual annotations. Furthermore, our generative formulation enables inference-time search over multiple plausible scene hypotheses, using geometric evidence extracted from observed RGB frames to improve geometric prediction without ground truth geometry. We demonstrate UGG's effectiveness over non-unified baselines across camera-controlled video generation, depth estimation, and camera pose prediction, including in challenging sparse observation settings. Code and visualizations are available at https://ugg-model.github.io/

Figures & tables

Appendix figures & tables2 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Gen4P: Video Generators are 4D Perceivers

    Oct 15, 2026Yitong Xia, Zeren Jiang, Chuanxia ZhengVideo Depth Estimation4D Scene Understanding

  2. Geometry-Aware Single-Image 4D Synthesis via Dense Trajectory Generation

    Dec 4, 2025Yanran Zhang, Ziyi Wang, Wenzhao Zheng +3Video Diffusion Models3D Scene Generation

  3. Geometric 4D Stitching for Grounded 4D Generation

    May 11, 2026Sunwoo Park, Taesung Kwon, Jong Chul Ye3D Scene Generation3D Shape Generation