SurfelSplat: Learning Efficient and Generalizable Gaussian Surfel Representations for Sparse-View Surface Reconstruction
Organizations: Tsinghua University
Abstract
3D Gaussian Splatting (3DGS) has demonstrated impressive performance in 3D scene reconstruction. Beyond novel view synthesis, it shows great potential for multi-view surface reconstruction. Existing methods employ optimization-based reconstruction pipelines that achieve precise and complete surface extractions. However, these approaches typically require dense input views and high time consumption for per-scene optimization. To address these limitations, we propose SurfelSplat, a feed-forward framework that generates efficient and generalizable pixel-aligned Gaussian surfel representations from sparse-view images. We observe that conventional feed-forward structures struggle to recover accurate geometric attributes of Gaussian surfels because the spatial frequency of pixel-aligned primitives exceeds Nyquist sampling rates. Therefore, we propose a cross-view feature aggregation module based on the Nyquist sampling theorem. Specifically, we first adapt the geometric forms of Gaussian surfels with spatial sampling rate-guided low-pass filters. We then project the filtered surfels across all input views to obtain cross-view feature correlations. By processing these correlations through a specially designed feature fusion network, we can finally regress Gaussian surfels with precise geometry. Extensive experiments on DTU reconstruction benchmarks demonstrate that our model achieves comparable results with state-of-the-art methods, and predict Gaussian surfels within 1 second, offering a 100x speedup without costly per-scene training.
Figures & tables
| ID | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | Mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| NeuS [ 3 ] | 4.69 | 4.72 | 4.03 | 4.58 | 4.71 | 2.01 | 4.83 | 3.94 | 4.31 | 2.61 | 1.63 | 6.48 | 1.44 | 5.69 | 6.34 | 4.13 |
| NeuSurf [ 6 ] | 1.96 | 3.73 | 2.35 | 0.82 | 1.07 | 2.51 | 0.87 | 1.21 | 1.15 | 1.13 | 1.06 | 1.23 | 0.41 | 0.92 | 1.13 | 1.44 |
| VolRecon [ 51 ] | 1.41 | 3.24 | 1.76 | 1.43 | 1.66 | 2.25 | 1.42 | 1.81 | 1.54 | 1.26 | 1.52 | 1.53 | 0.99 | 1.54 | 1.75 | 1.67 |
| UFORecon [ 8 ] | 1.15 | 2.42 | 1.67 | 2.55 | 1.90 | 2.73 | 1.55 | 1.49 | 2.16 | 0.95 | 2.22 | 1.98 | 1.40 | 2.11 | 2.32 | 1.91 |
| 2DGS [ 18 ] | 2.29 | 2.63 | 2.33 | 1.23 | 3.69 | 4.71 | 2.64 | 3.94 | 3.55 | 3.92 | 3.95 | 2.68 | 2.37 | 3.15 | 2.21 | 3.02 |
| GausSurf [ 19 ] | 4.22 | 5.69 | 4.32 | 3.98 | 4.93 | 2.81 | 4.67 | 5.52 | 4.98 | 3.61 | 4.11 | 5.43 | 2.98 | 3.66 | 4.55 | 4.36 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.