Point-Based 3D Reconstruction from Sparse Views under Known Illumination
Organizations: Visual Analysis & Perception Lab, Aalborg University · Centre for Software Technology, University of Southern Denmark · Pioneer Centre for Artificial Intelligence · Department of Applied Mathematics and Computer Science, Technical University of Denmark ·
Abstract
Sparse view 3D reconstruction is commonly addressed with neural implicit surfaces or dense point-based representations such as Gaussian splatting. Surface-aware splatting methods improve extracted geometry through oriented primitives and regularization, while RadiosityGS incorporates differentiable light transport through a radiosity inspired finite-element surfel formulation. We propose a differentiable point rendering method based on opacity-bearing beta surfels. An opacity explicit adjoint light transport formulation provides gradients for surfel geometry and appearance parameters, allowing physically based light transport to constrain reconstruction. Across five synthetic objects reconstructed from ten posed views, our method achieves the lowest mean symmetric Chamfer distance among the evaluated baselines and reduces mean Chamfer distance by 28.5% relative to the strongest point-based baseline while using only 267 surfels on average, approximately ~161 fewer primitives. Directional Chamfer results further show improved accuracy and competitive completion relative to related point-based methods. These results show that, in the controlled direct illumination setting, compact beta surfels combined with transport-based optimization can recover surfaces without relying on the tens to hundreds of thousands of primitives used by the evaluated baselines.
Figures & tables
| Method | Teapot | LEGO | Horse | Dragon | Plant | Mean | Avg pts |
|---|---|---|---|---|---|---|---|
| NeuS2 [ 22 ] | 95.850 | 112.344 | 90.242 | 101.955 | 93.212 | 98.721 | – |
| NeuS [ 21 ] | 1.396 | 1.424 | 2.022 | 1.397 | 2.180 | 1.684 | – |
| GeoSVR [ 10 ] | 3.667 | 1.446 | 2.054 | 3.255 | 10.296 | 4.144 | – |
| 2DGS 7K [ 5 ] | 2.471 | 1.429 | 1.702 | 2.251 | 2.891 | 2.149 | 43.0k |
| 2DGS 30K [ 5 ] | 53.570 | 30.563 | 39.075 | 53.149 | 15.917 | 38.455 | 51.0k |
| SuGaR [ 4 ] | 5.837 | 1.406 | 1.993 | 2.613 | 3.468 | 3.064 | 421.4k |
| Method | Accuracy | Completion |
|---|---|---|
| 2DGS 7K [ 5 ] | 0.020 | 0.023 |
| 2DGS 30K [ 5 ] | 0.743 | 0.026 |
| SuGaR [ 4 ] | 0.037 | 0.024 |
| GOF [ 24 ] | 0.295 | 0.014 |
| RadiosityGS [ 6 ] | 0.512 | 0.026 |
| Ours | 0.017 | 0.014 |
| Setting | Learn | CD | Acc. | Comp. | |||
|---|---|---|---|---|---|---|---|
| Full | ✓ | ✓ | ✓ | ✓ | 0.0132 | 0.0138 | 0.0125 |
| w/o | ✓ | ✓ | ✓ | 0.0162 | 0.0171 | 0.0152 | |
| w/o | ✓ | ✓ | ✓ | 0.0185 | 0.0193 | 0.0178 | |
| w/o | ✓ | ✓ | ✓ | 0.0241 | 0.0187 | 0.0295 | |
| Fixed | ✓ | ✓ | ✓ | 0.0278 | 0.0245 | 0.0312 |
Sparse-View 3D Reconstruction
Sparse-view 3D reconstruction recovers scene geometry and appearance from a small number of images for novel-view rendering and 3D use.
See all 188 papers