cs.CVSep 19, 2026

D3GS: Depth, DINO, and RGB Diffusion Co-Guided 3D Gaussian Splatting for Sparse-View Reconstruction

Authors: Yunqi Gao, Zhanfeng Liao, Hanzhang Tu, Zhaoqi Su, Guoqing Zheng, Songtao Wang, Hongwen Zhang, Zhou Xue, +2 more

Organizations: Central China Normal University · Tsinghua University · Fuzhou University · University of the Chinese Academy of Sciences · Space Engineering University · Beijing Normal University · ByteDance Inc.

Abstract

Novel view synthesis from sparse inputs remains challenging for 3D Gaussian Splatting (3DGS) due to ambiguous geometry, cross-view inconsistency, and missing details in under-constrained regions, resulting in degraded reconstruction and unstable rendering. To tackle these issues, we propose D3^{3}GS, a Depth-DINO-Diffusion guided sparse-view Gaussian reconstruction framework that jointly enhances geometry and appearance. D3^{3}GS first recovers a high-resolution, metric depth map via diffusion-based completion and DPT (Dense Prediction Transformer) refinement, providing robust Gaussian initialization and geometric constraints. Then, a DINO-guided view-consistent learning is introduced to augment Gaussian attributes with structural features, improving multi-view consistency. Finally, a diffusion-based Gaussian refinement module injects generative priors into an iterative optimization strategy, enhancing high-frequency geometric and appearance details within the Gaussian representation. Experiments on DTU, LLFF, and Mip-NeRF 360 show that D3^{3}GS achieves consistent and substantial improvements over strong baselines, with ablation studies validating the effectiveness and complementary roles of each component.

Explore similar work

CardsList
  1. GeoQuery: Geometry-Query Diffusion for Sparse-View Reconstruction

    May 12, 2026Xiao Cao, Yuze Li, Youmin Zhang +43D Gaussian SplattingDiffusion Models for Image Restoration

  2. DualDiff3D: Dual Structure-Appearance Diffusion Priors for Reliability-Enhanced 3D Gaussian Splatting

    Sep 1, 2026Qian Wang, Yu Wang, Weiqi Li +43D Gaussian SplattingNovel View Synthesis

  3. SparseGS: Sparse View Synthesis using 3D Gaussian Splatting

    Nov 30, 2023Haolin Xiong, Sairisheek Muttukuru, Hanyuan Xiao +43D Gaussian SplattingNovel View Synthesis