TSGL: Teacher-Student Graph Learning for 3DGS Compression
Organizations: York University, Canada
Abstract
3D Gaussian Splatting (3DGS) is a popular representation for novel view synthesis. However, 3DGS contains millions of Gaussian primitives, each with rich attributes, resulting in large file sizes. We propose a novel 3DGS compression method based on Teacher-Student Graph Learning (TSGL) that operates directly on a trained model, without 3DGS retraining or access to training images. Specifically, for each block of Gaussian primitives, using decoded positions and DC spherical harmonic (SH) coefficients as predictors, we learn a signal-dependent geometry graph G encoding the pairwise similarities between neighbouring Gaussians via a teacher-student model. Given G, we perform Graph Fourier Transform (GFT) on the remaining attributes, so that signal energies are predominantly projected into the low-frequency coefficients for compact representation. On three standard benchmarks, the method reaches 27x to 33x compression with less than 0.6 dB of PSNR loss, improving on recent post-training compression methods in both size and rendering quality.
Figures & tables
| Mip-NeRF 360 | Tanks & Temples | Deep Blending | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | PSNR | SSIM | LPIPS | Size (MB) | PSNR | SSIM | LPIPS | Size (MB) | PSNR | SSIM | LPIPS | Size (MB) |
| 3DGS [ 9 ] | 27.29 | 0.812 | 0.221 | 795.26 | 23.36 | 0.838 | 0.186 | 421.91 | 29.43 | 0.898 | 0.246 | 703.77 |
| GGSC [ 23 ] | 18.42 | 0.449 | 0.498 | 71.21 | 16.43 | 0.480 | 0.489 | 29.29 | 25.67 | 0.807 | 0.386 | 109.85 |
| MesonGS [ 22 ] | 26.45 | 0.791 | 0.244 | 34.41 | 22.95 | 0.825 | 0.202 | 17.56 | 29.13 | 0.894 | 0.255 | 29.52 |
| EntropyGS [ 8 ] | 25.66 | 0.783 | 0.246 | 28.46 | 22.33 | 0.806 | 0.217 | 15.23 | 27.48 | 0.882 | 0.266 | 25.95 |
| FlexGaussian [ 20 ] | 26.38 | 0.780 | 0.251 | 40.80 | 22.44 | 0.804 | 0.219 | 16.30 | 28.61 | 0.884 | 0.269 | 25.48 |
| Stage | Mip-NeRF 360 | T&T | Deep Blending | |||
|---|---|---|---|---|---|---|
| PSNR | Size | PSNR | Size | PSNR | Size | |
| Original 3DGS [ 9 ] | 27.29 | 795.26 | 23.36 | 421.91 | 29.43 | 703.77 |
| + Opacity pruning | 27.29 | 679.49 | 23.35 | 333.49 | 29.43 | 599.18 |
| + Importance pruning | 27.28 | 543.59 | 23.35 | 266.79 | 29.43 | 479.34 |
| + G-PCC, VQ DC | 27.27 | 476.37 | 23.34 | 234.02 | 29.41 | 419.51 |
| + Coding (no transform) | 25.70 | 33.07 | 22.44 | 15.95 | 28.13 | 22.35 |