FastWild-GS: Minutes-Scale In-the-Wild Gaussian Splatting via Compact Per-Image Appearance Adaptation
Organizations: Chung-Ang University
Abstract
Internet photos of a scene differ in exposure, illumination and transient objects such as passers-by, so one set of Gaussian colours cannot explain all photos (the in-the-wild setting). Recent in-the-wild Gaussian Splatting methods mostly report hours of per-scene optimization. We present FastWild-GS, which describes each photo by a 128-dimensional Photo Appearance Token and a per-channel transform, a scale and an offset applied to the rendered image (six parameters); a small MLP predicts the colour of each Gaussian from this token and a per-Gaussian feature, replacing the spherical-harmonics colour. The same transform is applied to the renders that score Gaussians for densification and pruning, so appearance differences between photos are not counted as reconstruction error. On PhotoTourism, FastWild-GS trains in 8.8 minutes per scene with the lowest LPIPS among the compared methods, 23x faster than AsymGS, the next best in LPIPS. On NeRF-OSR, it has the best average PSNR, SSIM and LPIPS among the compared methods in 9.7 minutes per scene.
Figures & tables
| Brandenburg Gate | Sacré-Cœur | Trevi Fountain | Mean | |||||||||||
| Method | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | Train | GPU |
| K-Planes [ 9 ] | 23.65 | 0.859 | 0.253 | 19.96 | 0.762 | 0.299 | 19.70 | 0.662 | 0.388 | 21.10 | 0.761 | 0.313 | 15.9 min | RTX 5090 |
| GS-W [ 49 ] | 24.35 | 0.903 | 0.155 | 19.73 | 0.824 | 0.210 | 20.06 | 0.724 | 0.272 | 21.38 | 0.817 | 0.213 | 43.0 min | RTX 5090 |
| gsplat [ 47 ] | 26.36 | 0.931 | 0.118 | 22.05 | 0.876 | 0.154 | 22.56 | 0.765 | 0.213 | 23.66 | 0.857 | 0.162 | 1.06 h | RTX 5090 |
| WildGaussians [ 17 ] | 27.77 | 0.927 | 0.133 | 22.56 | 0.859 | 0.177 | 23.63 | 0.766 | 0.228 | 24.65 | 0.851 | 0.179 | 5.65 h | RTX 5090 |
| NexusSplats [ 39 ] | 27.76 | 0.922 | 0.141 | 23.13 | 0.859 | 0.174 | 23.97 | 0.766 | 0.237 | 24.95 | 0.849 | 0.184 | 3.39 h | RTX 5090 |
| Method | PSNR | SSIM | LPIPS | Train |
| NeRF-MS [ 22 ] | 21.61 | 0.716 | 0.317 | 2.11 h |
| SWAG [ 5 ] | 23.00 | 0.801 | 0.270 | 49.8 min ∗ |
| GS-W [ 49 ] | 23.79 | 0.792 | 0.217 | 1.77 h |
| WE-GS [ 42 ] | 23.91 | 0.818 | 0.224 | 3.38 h |
| WilLaGS [ 1 ] | 25.79 | 0.855 | 0.207 | 27.6 min |
| FastWild-GS | 26.00 | 0.856 | 0.152 | 9.7 min |
| Setting | PSNR | SSIM | LPIPS | Train |
|---|---|---|---|---|
| FastWild-GS | 25.52 | 0.874 | 0.1461 | 8.8 min |
| w/o colour-matched scoring | 24.80 | 0.873 | 0.1491 | 8.9 min |
| w/o channel transform | 24.94 | 0.874 | 0.1491 | 8.8 min |
| w/o | 24.86 | 0.873 | 0.1498 | 7.0 min |
| w/o PAT | 21.22 | 0.834 | 0.1882 | 7.6 min |
| w/o Splat Descriptor | 23.53 | 0.861 | 0.1660 | 11.4 min |
| Test-time fitting | #param. | PSNR | SSIM | LPIPS |
|---|---|---|---|---|
| FastWild-GS: PAT, , ; 512 steps | 137 | 25.52 | 0.874 | 0.1461 |
| without radial gain | 134 | 25.20 | 0.874 | 0.1467 |
| without channel transform | 131 | 24.81 | 0.872 | 0.1504 |
| 128 steps | 137 | 25.13 | 0.874 | 0.1474 |
| 256 steps | 137 | 25.45 | 0.874 | 0.1464 |
| 1024 steps | 137 | 25.51 | 0.875 | 0.1461 |
| Own colours | With our appearance module | |||||
|---|---|---|---|---|---|---|
| Backbone | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| 2DGS [ 13 ] | 17.65 | 0.784 | 0.2618 | 24.68 | 0.866 | 0.1604 |
| Mip-Splatting [ 48 ] | 16.94 | 0.748 | 0.3258 | 24.62 | 0.867 | 0.1540 |
| 3DGS-MCMC [ 16 ] | 18.40 | 0.810 | 0.2168 | 24.76 | 0.869 | 0.1591 |
| Taming-3DGS [ 29 ] | 18.33 | 0.801 | 0.2235 | 24.72 | 0.868 | 0.1539 |
| StopThePop [ 34 ] | 18.42 | 0.794 | 0.2382 | 24.91 | 0.868 | 0.1529 |
| Scene | Training time (min) |
|---|---|
| Brandenburg Gate | 6.1 |
| Sacré-Cœur | 8.5 |
| Trevi Fountain | 11.8 |
| Mean | 8.8 |
| Item | Value |
|---|---|
| Densification | iterations 600 to 14,900, every 100 |
| Densification thresholds | FastGS defaults ( , , ), multiplied by before 12k iterations and by from 12k |
| Additional pruning | at 5.9k, 8.9k, 11.9k and 14.9k iterations |
| Weight of | until 500; linear to at 2k; until 15k; linear to at 30k |
| Learning rates, Gaussians | position (times the scene extent), opacity , scaling , rotation , |
| Learning rates, appearance | PAT , PAT Decoder (Adam, constant) |
| Setting | PAT | Fitted | PSNR | SSIM | LPIPS | Train | |
|---|---|---|---|---|---|---|---|
| FastWild-GS | 128 | 32 | 137 | 8.8 min | |||
| PAT size 64 | 64 | 32 | 73 | 0.26 | 0.0014 | +0.0022 | 8.5 min |
| PAT size 256 | 256 | 32 | 265 | 0.30 | +0.0001 | +0.0007 | 9.7 min |
| feature size 16 | 128 | 16 | 137 | 0.06 | 0.0002 | +0.0007 | 8.4 min |
| feature size 64 | 128 | 64 | 137 | 0.29 | 0.0004 | +0.0015 | 9.5 min |
| Brandenburg Gate | Sacré-Cœur | Trevi Fountain | ||||||||
| Setting | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | Train |
| FastWild-GS | 28.87 | 0.940 | 0.1086 | 23.72 | 0.893 | 0.1357 | 23.96 | 0.790 | 0.1941 | 8.8 min |
| w/o colour-matched scoring | 27.57 | 0.940 | 0.1116 | 23.01 | 0.890 | 0.1393 | 23.84 | 0.790 | 0.1963 | 8.9 min |
| w/o channel transform | 27.87 | 0.940 | 0.1116 | 22.93 | 0.890 | 0.1410 | 24.02 | 0.791 | 0.1945 | 8.8 min |
| w/o | 28.12 | 0.939 | 0.1108 | 22.60 | 0.890 | 0.1421 | 23.86 | 0.790 | 0.1964 | 7.0 min |
| w/o PAT | 25.02 | 0.918 | 0.1341 | 18.36 | 0.846 | 0.1815 | 20.29 | 0.738 | 0.2491 | 7.6 min |
| europa | lwp | st | stjohann | Mean | |||||||||||
| Method | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| NeRF-MS [ 22 ] | 21.03 | 0.721 | 0.294 | 21.90 | 0.719 | 0.336 | 20.68 | 0.630 | 0.402 | 22.84 | 0.793 | 0.235 | 21.61 | 0.716 | 0.317 |
| SWAG [ 5 ] | 23.74 | 0.845 | 0.242 | 22.07 | 0.783 | 0.303 | 22.29 | 0.713 | 0.364 | 23.91 | 0.864 | 0.172 | 23.00 | 0.801 | 0.270 |
| GS-W [ 49 ] | 22.04 | 0.758 | 0.231 | 24.44 | 0.827 | 0.208 | 22.45 | 0.690 | 0.315 | 26.23 | 0.893 | 0.113 | 23.79 | 0.792 | 0.217 |
| WE-GS [ 42 ] | 24.73 | 0.873 | 0.157 | 24.33 | 0.821 | 0.197 | 22.45 | 0.720 | 0.341 | 24.12 | 0.858 | 0.202 | 23.91 | 0.818 | 0.224 |
| WilLaGS [ 1 ] | 25.50 | 0.830 | 0.230 | 27.07 | 0.879 | 0.200 | 24.45 | 0.788 | 0.255 | 26.13 | 0.925 | 0.144 | 25.79 | 0.855 | 0.207 |
| Setting | PSNR | SSIM | LPIPS |
|---|---|---|---|
| Ablations ( Tab. 3 ) | |||
| FastWild-GS | 0.15 | 0.0003 | 0.0017 |
| w/o colour-matched scoring | 0.12 | 0.0005 | 0.0012 |
| w/o channel transform | 0.07 | 0.0004 | 0.0005 |
| w/o | 0.00 | 0.0006 | 0.0010 |
| w/o PAT | 0.02 | 0.0000 | 0.0010 |
| Own colours | With our module | |||||
|---|---|---|---|---|---|---|
| Backbone | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| 2DGS | 0.09 | 0.0086 | 0.0150 | 0.02 | 0.0009 | 0.0016 |
| Mip-Splatting | 0.16 | 0.0091 | 0.0134 | 0.01 | 0.0021 | 0.0014 |
| 3DGS-MCMC | 0.09 | 0.0015 | 0.0013 | 0.06 | 0.0006 | 0.0015 |
| Taming-3DGS | 0.03 | 0.0009 | 0.0035 | 0.06 | 0.0010 | 0.0012 |
| StopThePop | 0.20 | 0.0043 | 0.0080 | 0.04 | 0.0003 | 0.0008 |
| Brandenburg Gate | Sacré-Cœur | Trevi Fountain | |||||||
|---|---|---|---|---|---|---|---|---|---|
| Setting | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| FastWild-GS | 0.39 | 0.0001 | 0.0029 | 0.20 | 0.0009 | 0.0017 | 0.04 | 0.0010 | 0.0021 |
| w/o colour-matched scoring | 0.31 | 0.0012 | 0.0030 | 0.12 | 0.0015 | 0.0010 | 0.04 | 0.0008 | 0.0011 |
| w/o channel transform | 0.05 | 0.0003 | 0.0010 | 0.18 | 0.0009 | 0.0020 | 0.05 | 0.0007 | 0.0004 |
| w/o | 0.17 | 0.0003 | 0.0006 | 0.12 | 0.0010 | 0.0021 | 0.06 | 0.0005 | 0.0005 |
| w/o PAT | 0.01 | 0.0000 | 0.0004 | 0.05 | 0.0004 | 0.0021 | 0.01 | 0.0004 | 0.0006 |
3D Gaussian Splatting
3D Gaussian Splatting represents scenes as optimizable 3D Gaussian primitives for fast, photorealistic rendering from new viewpoints.
See all 1,093 papers