cs.CVMay 29, 2026

VolFill: Single-View Amodal 3D Scene Reconstruction with Volumetric Flow Matching

Authors: Tuan Duc NgoChuang GanEvangelos Kalogerakis

Organizations: UMass Amherst · 2TU Crete

Abstract

Reconstructing the complete geometry of a scene from a single RGB image remains challenging - especially when inferring hidden structures where visual evidence is incomplete. We introduce VolFill, a generative framework that predicts the 3D structure of the complete scene rather than relying on traditional pixel-aligned regression. Our method utilizes a hybrid 3D VAE to compress sparse truncated unsigned distance function grids into a compact latent space, paired with a latent Diffusion Transformer that denoises this representation to recover the complete scene. We condition the generation on geometry foundation models, leveraging rich spatial priors for robust reasoning. Unlike existing methods limited by per-ray constraints or unstructured point-cloud queries, VolFill provides a structured representation that supports direct surface extraction and occupancy queries at scale. Extensive experiments on the SCRREAM and NRGB-D datasets demonstrate that our approach significantly outperforms current baselines, providing a robust foundation for holistic spatial understanding.

Explore similar work

CardsList
  1. Sparse auto-regressive modeling for scene generation from multi-view images

    Sep 3, 2026Thomas Lucas, Maxime Pietrantoni, Philippe Weinzaepfel +43D Generative ModelsMulti-View