EntON: Eigenentropy-Optimized Neighborhood Densification in 3D Gaussian Splatting
Organizations: Institute of Photogrammetry and Remote Sensing (IPF), Karlsruhe Institute of Technology (KIT), Karlsruhe, Germany
Abstract
We present a novel Eigenentropy-optimized neighboorhood densification strategy EntON in 3D Gaussian Splatting (3DGS) for geometrically accurate and high-quality rendered 3D reconstruction. While standard 3DGS produces Gaussians whose centers and surfaces are poorly aligned with the underlying object geometry, surface-focused reconstruction methods frequently sacrifice photometric accuracy. In contrast to the conventional densification strategy, which relies on the magnitude of the view-space position gradient, our approach introduces a geometry-aware strategy to guide adaptive splitting and pruning. Specifically, we compute the 3D shape feature Eigenentropy from the eigenvalues of the covariance matrix in the k-nearest neighborhood of each Gaussian center, which quantifies the local structural order. These Eigenentropy values are integrated into an alternating optimization framework: During the optimization process, the algorithm alternates between (i) standard gradient-based densification, which refines regions via view-space gradients, and (ii) Eigenentropy-aware densification, which preferentially densifies Gaussians in low-Eigenentropy (ordered, flat) neighborhoods to better capture fine geometric details on the object surface, and prunes those in high-Eigenentropy (disordered, spherical) regions. We provide quantitative and qualitative evaluations on two benchmark datasets: small-scale DTU dataset and large-scale TUM2TWIN dataset, covering man-made objects and urban scenes. Experiments demonstrate that our Eigenentropy-aware alternating densification strategy improves geometric accuracy by up to 33% and rendering quality by up to 7%, while reducing the number of Gaussians by up to 50% and training time by up to 23%. Overall, EnTON achieves a favorable balance between geometric accuracy, rendering quality and efficiency by avoiding unnecessary scene expansion.
Figures & tables
| Method | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3DGS | 0.95 | 0.96 | 0.99 | 0.97 | 0.86 | 0.90 | 0.92 | 0.95 | 0.91 | 0.96 | 0.96 | 0.95 | 0.96 | 0.95 | 0.95 | 0.96 |
| EntON | 0.82 | 0.82 | 0.82 | 0.82 | 0.81 | 0.81 | 0.82 | 0.82 | 0.82 | 0.81 | 0.83 | 0.83 | 0.82 | 0.82 | 0.82 | 0.82 |
| Method | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3DGS | 1.82 | 1.84 | 1.72 | 1.55 | 2.17 | 1.70 | 1.66 | 2.37 | 1.90 | 1.71 | 1.50 | 1.51 | 1.47 | 1.30 | 1.34 | 1.61 |
| 2DGS | 1.25 | 1.51 | 0.97 | 0.73 | 2.03 | 1.46 | 1.26 | 1.97 | 1.76 | 1.51 | 0.78 | 1.37 | 0.94 | 0.69 | 0.75 | 1.33 |
| PGSR | 0.92 | 1.15 | 0.77 | 0.67 | 1.43 | 0.99 | 0.97 | 1.28 | 1.79 | 1.13 | 0.60 | 0.96 | 0.66 | 0.68 | 0.79 | 1.00 |
| EntON( ) | 1.13 | 1.22 | 0.79 | 0.57 | 1.73 | 1.13 | 1.06 | 1.82 | 1.79 | 1.27 | 0.72 | 1.09 | 0.73 | 0.66 | 0.71 | 1.14 |
| EntON( ) | 1.17 | 1.32 | 0.88 | 0.62 | 1.77 | 1.23 | 1.12 | 1.85 | 1.80 | 1.32 | 0.82 | 1.11 | 0.80 | 0.73 | 0.77 | 1.19 |
| EntON( ) | 1.13 | 1.29 | 0.82 | 0.58 | 1.68 | 1.15 | 1.05 | 1.71 | 1.79 | 1.24 | 0.76 | 1.14 | 0.75 | 0.68 | 0.72 | 1.13 |
| Method | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3DGS | 35.86 | 30.28 | 34.59 | 34.06 | 37.22 | 34.02 | 33.28 | 34.51 | 33.53 | 37.59 | 37.97 | 31.55 | 35.39 | 36.47 | 36.33 | 34.84 |
| 2DGS | 32.69 | 28.51 | 31.74 | 32.13 | 35.10 | 31.92 | 31.01 | 31.51 | 31.27 | 34.15 | 35.92 | 30.17 | 32.60 | 35.06 | 34.38 | 32.54 |
| PGSR | 31.77 | 27.67 | 30.92 | 31.99 | 34.20 | 31.82 | 30.15 | 30.71 | 30.83 | 34.63 | 36.00 | 30.90 | 32.55 | 35.84 | 34.80 | 32.32 |
| EntON( ) | 35.38 | 28.70 | 33.51 | 35.32 | 37.01 | 35.66 | 32.05 | 35.05 | 33.02 | 37.49 | 37.74 | 30.46 | 34.46 | 36.24 | 35.99 | 34.60 |
| EntON( ) | 34.36 | 29.44 | 34.51 | 34.50 | 36.87 | 35.93 | 31.47 | 35.36 | 32.95 | 37.24 | 37.86 | 30.52 | 34.06 | 36.32 | 36.24 | 34.71 |
| EntON( ) | 34.68 | 28.72 | 34.90 | 35.13 | 36.45 | 34.94 | 31.60 | 34.94 | 32.93 | 37.42 | 37.87 | 30.25 | 34.47 | 35.94 | 36.47 | 34.75 |
| Method | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | Mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3DGS | 611 749 | 695 233 | 778 308 | 622 019 | 223 472 | 233 292 | 249 407 | 200 975 | 556 486 | 238 905 | 215 615 | 200 024 | 276 819 | 291 762 | 266 299 | 392 129 |
| 2DGS | 317 153 | 391 404 | 354 076 | 341 317 | 151 758 | 159 384 | 169 785 | 123 622 | 240 807 | 127 348 | 105 397 | 102 635 | 132 201 | 160 033 | 144 754 | 208 572 |
| PGSR | 338 583 | 368 363 | 394 813 | 376 698 | 127 514 | 221 565 | 253 433 | 122 908 | 211 997 | 205 436 | 134 614 | 175 274 | 166 209 | 211 044 | 195 750 | 232 004 |
| EntON( ) | 328401 | 370351 | 414967 | 373220 | 156504 | 224221 | 179262 | 140561 | 260293 | 186702 | 125623 | 116045 | 155316 | 171382 | 164187 | 228578 |
| EntON( ) | 329222 | 403205 | 409569 | 365176 | 156361 | 207048 | 173000 | 151514 | 285136 | 185796 | 136097 | 114874 | 159414 | 175780 | 169528 | 233116 |
| EntON( ) | 316775 | 346756 | 409775 | 366452 | 150623 | 184157 | 153795 | 148258 | 287247 | 173638 | 130814 | 104196 | 163856 | 165875 | 158206 | 211925 |
| Method | 24 | 37 | 40 | 55 | 63 | 65 | 69 | 83 | 97 | 105 | 106 | 110 | 114 | 118 | 122 | Mean |
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| 3DGS | 18.48 | 15.61 | 15.95 | 13.05 | 11.86 | 11.97 | 11.85 | 11.22 | 14.20 | 11.88 | 11.03 | 10.38 | 11.84 | 11.02 | 10.93 | 12.88 |
| 2DGS | 21.87 | 20.24 | 19.53 | 18.22 | 17.22 | 18.27 | 17.44 | 18.00 | 19.37 | 18.12 | 17.32 | 17.16 | 18.17 | 17.19 | 17.51 | 18.11 |
| PGSR | 33.45 | 30.04 | 32.58 | 28.86 | 27.55 | 27.04 | 31.04 | 28.08 | 28.38 | 40.17 | 38.07 | 38.00 | 40.03 | 22.20 | 37.34 | 32.89 |
| EntON( ) | 12.35 | 10.97 | 11.91 | 10.76 | 10.06 | 9.60 | 9.57 | 9.07 | 9.77 | 9.46 | 9.28 | 9.09 | 9.36 | 9.23 | 9.28 | 10.52 |
| EntON( ) | 13.02 | 11.77 | 12.74 | 11.18 | 10.33 | 9.75 | 9.80 | 9.33 | 10.26 | 9.71 | 9.80 | 8.80 | 9.66 | 9.67 | 9.95 | 10.52 |
| EntON( ) | 12.49 | 11.27 | 12.34 | 10.68 | 10.17 | 9.54 | 9.65 | 9.39 | 9.93 | 9.41 | 9.78 | 8.73 | 9.80 | 9.18 | 9.34 | 10.21 |
| scene | 3DGS | 2DGS | PGSR | EntON( ) | EntON( ) | EntON( ) | EntON( ) |
|---|---|---|---|---|---|---|---|
| building1 | 0.184 | 0.193 | 0.197 | 0.184 | 0.179 | 0.182 | 0.187 |
| building2 | 0.185 | 0.160 | 0.177 | 0.168 | 0.169 | 0.167 | 0.163 |
| mean | 0.185 | 0.177 | 0.187 | 0.176 | 0.174 | 0.175 | 0.175 |
| scene | 3DGS | 2DGS | PGSR | EntON( ) | EntON( ) | EntON( ) | EntON( ) |
|---|---|---|---|---|---|---|---|
| building1 | 32.36 | 29.90 | 30.05 | 31.55 | 32.57 | 32.09 | 31.94 |
| building2 | 31.00 | 28.00 | 27.69 | 30.84 | 30.50 | 30.56 | 30.78 |
| mean | 31.68 | 28.95 | 28.87 | 31.20 | 31.54 | 31.26 | 31.36 |
| scene | 3DGS | 2DGS | PGSR | EntON( ) | EntON( ) | EntON( ) | EntON( ) |
|---|---|---|---|---|---|---|---|
| building1 | 3 622 623 | 3 457 686 | 3 495 252 | 2 716 037 | 2 693 175 | 2 500 641 | 2 475 797 |
| building2 | 3 037 856 | 2 087 933 | 1 625 555 | 2 306 556 | 2 247 377 | 2 225 013 | 2 278 891 |
| mean | 3 330 240 | 2 772 810 | 2 560 404 | 2 511 297 | 2 470 276 | 2 362 827 | 2 377 344 |
| scene | 3DGS | 2DGS | PGSR | EntON( ) | EntON( ) | EntON( ) | EntON( ) |
|---|---|---|---|---|---|---|---|
| building1 | 18.35 | 25.32 | 40.48 | 27.75 | 26.24 | 22.82 | 20.56 |
| building2 | 17.42 | 22.77 | 37.97 | 22.21 | 20.93 | 19.19 | 18.04 |
| mean | 17.89 | 24.05 | 39.23 | 24.98 | 23.59 | 21.00 | 19.30 |
| Scene | scan40 | scan55 | scan106 | scan122 |
|---|---|---|---|---|
| Mean Eigenentropy (Gaussians, >1 mm distance) | 0.9863 | 0.9617 | 0.9594 | 0.9531 |
3D Gaussian Splatting
3D Gaussian Splatting represents scenes as optimizable 3D Gaussian primitives for fast, photorealistic rendering from new viewpoints.
See all 1,019 papers