RetinexGS: Retinex-Inspired Gaussian Splatting for Low-Light RAW Reconstruction
Organizations: University of Waterloo Waterloo, Ontario, Canada
Abstract
Standard 3D Gaussian Splatting (3DGS) pipelines struggle with severely underexposed images, producing unstable colors, floating artifacts, and incomplete reconstructions in dark regions. To better account for noise in these low-light observations, RAW images offer a natural basis for noise-aware reconstruction by preserving linear sensor measurements and providing access to noise metadata. We present RetinexGS, a RAW-domain 3DGS framework that combines Retinex-inspired appearance modeling with sensor-informed optimization for low-light novel-view synthesis. We factorize each Gaussian's color into a view-independent base color and a shared, position- and view-dependent modulation field, regularizing the two components separately to constrain appearance learning from noisy observations. We use DNG noise metadata to weight the reconstruction loss for signal-dependent noise, while distortion-aware rendering avoids spatially resampling RAW targets. To address sparse geometry in dark regions, we introduce depth-guided initialization. We evaluate RetinexGS on three public RawNeRF scenes and two custom-captured low-light RAW scenes. With all methods trained on the same RAW inputs for each scene, RetinexGS outperforms LE3D and RawNeRF in mean sRGB PSNR by 2.18 dB and 2.71 dB respectively, across the five scenes, while supporting real-time novel-view rendering.
Figures & tables
| Method | Iterations | PSNR | SSIM | LPIPS |
|---|---|---|---|---|
| LDR-NeRF [ 42 ] | – | 20.04 | 0.5541 | 0.5669 |
| LDR-3DGS [ 1 ] | 30k | 20.29 | 0.5477 | 0.5344 |
| HDR-3DGS [ 5 ] | 30k | 20.33 | 0.5286 | 0.6563 |
| RawNeRF [ 4 ] | – | 24.08 | 0.6100 | 0.4952 |
| RawGS [ 5 ] | 30k | 23.35 | 0.5843 | 0.5472 |
| LE3D [ 5 ] | 30k | 24.70 | 0.6076 | 0.5071 |
| Scene | Method | Iterations | PSNR | SSIM | LPIPS |
|---|---|---|---|---|---|
| miningtunnel | LDR-3DGS [ 1 ] | 30k | 17.29 | 0.3878 | 0.6209 |
| Raw3DGS (our impl.) | 30k | 11.85 | 0.3415 | 0.7327 | |
| LE3D [ 5 ] | 30k | 21.27 | 0.4250 | 0.6017 | |
| HDRSplat+PMRID [ 16 ] | 30k | 15.78 | 0.3340 | 0.7330 | |
| RetinexGS | 15k | 23.47 | 0.4897 | 0.5053 | |
| housecorner | LDR-3DGS [ 1 ] | 30k | 18.95 | 0.6051 | 0.6264 |
| Method | sRGB | Linear RAW | |||
|---|---|---|---|---|---|
| PSNR | SSIM | LPIPS | PSNR | SSIM | |
| RawNeRF [ 4 ] | 22.31 | 0.484 | 0.550 | 60.92 | 0.9977 |
| LE3D [ 5 ] | 22.83 | 0.550 | 0.553 | 61.14 | 0.9977 |
| RetinexGS | 25.01 | 0.600 | 0.471 | 63.39 | 0.9987 |
| Variant | pianotest | miningtunnel | ||||
|---|---|---|---|---|---|---|
| PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | |
| SH appearance | 19.20 | 0.4651 | 0.5829 | 19.53 | 0.4019 | 0.6322 |
| RawNeRF weighting [ 4 ] | 25.59 | 0.6238 | 0.4800 | 23.47 | 0.4878 | 0.5117 |
| Log-L1 only | 25.42 | 0.6168 | 0.4801 | 22.19 | 0.4566 | 0.5485 |
| w/o factor reg. | 25.77 | 0.6213 | 0.4630 | 23.27 | 0.4894 | 0.5107 |
| w/o depth init. | 25.80 | 0.6209 | 0.4725 | 22.81 | 0.4477 | 0.5837 |
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
| Quantity | Input / storage | Output transform |
|---|---|---|
| learnable per Gaussian | ||
| encoded and ; shared MLP | ||
| and |
| Loss term | Weight | Active from |
|---|---|---|
| 0.001 | iter 1000 | |
| (modulation magnitude) | 0.02 | iter 2000 (3k warm-up) |
| (base anchor) | 0.005 | iter 4000 |
| 0.005 | iter 4000 | |
| (iter 2000) | 0.4 | iter 0 |
| (iter 2000) | 0.8 | iter 2000 |
| Scene | HDRSplat Gaussians | RetinexGS Gaussians | Reduction |
|---|---|---|---|
| pianotest | 505k | 340k | 33% |
| officetest | 579k | 273k | 53% |
| yuccatest | 199k | 133k | 33% |
| miningtunnel | 302k | 225k | 25% |
| housecorner | 460k | 138k | 70% |
| Mean | 409k | 222k | 46% |
| Scene | HDRSplat+PMRID | RetinexGS | Difference |
|---|---|---|---|
| pianotest | 22.84 / 0.565 / 0.490 | 25.84 / 0.623 / 0.461 | / / |
| officetest | 23.97 / 0.587 / 0.475 | 25.58 / 0.635 / 0.440 | / / |
| yuccatest | 19.73 / 0.396 / 0.638 | 23.91 / 0.560 / 0.509 | / / |
| miningtunnel | 15.78 / 0.334 / 0.733 | 23.47 / 0.490 / 0.505 | / / |
| housecorner | 16.57 / 0.517 / 0.755 | 26.27 / 0.692 / 0.440 | / / |
| Scene | Iter. | PSNR | SSIM | LPIPS |
|---|---|---|---|---|
| pianotest | 30k | 19.23 | 0.5675 | 0.6252 |
| officetest | 30k | 21.85 | 0.5932 | 0.5506 |
| yuccatest | 30k | 18.53 | 0.4973 | 0.6467 |
| miningtunnel | 30k | 11.85 | 0.3415 | 0.7327 |
| housecorner | 30k | 24.61 | 0.6255 | 0.5222 |
| Mean | 30k | 19.21 | 0.5250 | 0.6155 |
| Scene | Method | sRGB PSNR | sRGB SSIM | sRGB LPIPS | RAW PSNR | RAW SSIM |
|---|---|---|---|---|---|---|
| pianotest | RetinexGS | 25.84 | 0.623 | 0.461 | 62.74 | 0.9987 |
| LE3D (half-packed) | 24.67 | 0.593 | 0.501 | 60.05 | 0.9979 | |
| RawNeRF (half-packed) | 22.84 | 0.476 | 0.562 | 59.69 | 0.9978 | |
| HDRSplat (native) | 22.84 | 0.565 | 0.490 | 59.19 | 0.9970 | |
| officetest | RetinexGS | 25.58 | 0.635 | 0.440 | 61.30 | 0.9981 |
| LE3D (half-packed) | 24.44 | 0.607 | 0.496 | 59.78 | 0.9973 |
| Method | RAW PSNR | RAW SSIM |
|---|---|---|
| HDR-3DGS | 56.50 | 0.9926 |
| RawNeRF | 58.69 | 0.9969 |
| RawGS | 59.28 | 0.9971 |
| LE3D | 61.08 | 0.9983 |
| RetinexGS | 61.72 | 0.9984 |
| Scene | Composition | sRGB PSNR | SSIM | LPIPS | RAW PSNR | RAW SSIM |
|---|---|---|---|---|---|---|
| pianotest | Primitive-level | 25.84 | 0.6230 | 0.4610 | 62.74 | 0.9987 |
| Image-space | 25.72 | 0.6215 | 0.4635 | 62.59 | 0.9986 | |
| officetest | Primitive-level | 25.58 | 0.6350 | 0.4400 | 61.30 | 0.9981 |
| Image-space | 25.48 | 0.6345 | 0.4437 | 61.02 | 0.9980 | |
| yuccatest | Primitive-level | 23.91 | 0.5600 | 0.5090 | 61.12 | 0.9983 |
| Image-space | 23.77 | 0.5596 | 0.5149 | 60.94 | 0.9983 |
| Scene | # Gaussians | RetinexGS | Matched SH control | ||
|---|---|---|---|---|---|
| FPS | Memory (MB) | FPS | Memory (MB) | ||
| pianotest | 340k | 91 | 602 | 148 | 614–661 |
| housecorner | 138k | 145 | 471 | 176–187 | 475–494 |
| miningtunnel | 225k | 138 | 427 | 207–215 | 434–464 |
3D Gaussian Splatting
3D Gaussian Splatting represents scenes as optimizable 3D Gaussian primitives for fast, photorealistic rendering from new viewpoints.
See all 1,071 papers