Lumos3D: A Single-Forward Framework for Low-Light 3D Scene Restoration
Organizations: Texas A&M University, College Station, TX 77801 USA
Abstract
Restoring 3D scenes with low-light conditions is challenging, and most existing methods depend on precomputed camera poses and scene-specific optimization, which greatly restricts their application to real-world scenarios. To overcome these limitations, we propose Lumos3D, a pose-free single-forward framework for 3D low-light scene restoration. First, we develop a cross-illumination distillation scheme, where a frozen teacher network takes normal-light ground truth images as input to distill accurate geometric information to the student model. Second, we define a Lumos loss to improve the restoration quality of the reconstructed 3D Gaussian space. Trained on a single dataset, Lumos3D performs inference in a purely feed-forward manner, directly restoring illumination and structure from unposed, low-light multi-view images without any per-scene training or optimization. Experiments on real-world datasets demonstrate that Lumos3D achieves competitive restoration results compared to scene-specific methods. Our codes are available at https://github.com/HanzhouLiu/Lumos3D.
Figures & tables
| Distillation | Lumos losses | Metrics (Average) | |||||
| Low 1 | GT 2 | Content | Image | Voxel | PSNR | SSIM | LPIPS |
| ✓ | 17.93 | 0.758 | 0.405 | ||||
| ✓ | 17.47 | 0.758 | 0.402 | ||||
| ✓ | 17.47 | 0.758 | 0.402 | ||||
| ✓ | ✓ | 17.59 | 0.765 | 0.403 | |||
| ✓ | ✓ | ✓ | 19.41 | 0.782 | 0.402 | ||
| Models | Bike | Buu | Chair | Sofa | ||||||||
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
| Low-light | ||||||||||||
| Aleth_NeRF [ 4 ] | 16.50 | 0.661 | 0.481 | 16.52 | 0.707 | 0.418 | 16.54 | 0.768 | 0.536 | 16.53 | 0.805 | 0.408 |
| Luminance-GS [ 5 ] | 16.39 | 0.627 | 0.520 | 15.40 | 0.725 | 0.436 | 18.58 | 0.690 | 0.634 | 18.98 | 0.756 | 0.472 |
| Lumos3D (Ours) | 14.07 | 0.605 | 0.432 | 19.16 | 0.755 | 0.420 | 17.82 | 0.781 | 0.565 | 22.21 | 0.848 | 0.346 |
| Over-exposure | ||||||||||||
Feed-Forward 3D Reconstruction
Feed-forward 3D reconstruction predicts geometry, cameras, and renderable scene representations directly from images without per-scene optimization.
See all 338 papers