PaveSplat: Resolution-Robust Feed-Forward Gaussian Splatting with Residually Corrected Surface-Aligned Covariances
Organizations: ETRI, South Korea
Abstract
We present PaveSplat, a feed-forward Gaussian splatting method that adds a learned residual to the analytic surface-aligned covariance, keeping surfels paving the visible surface across rendering resolutions. Pixel-aligned feed-forward Gaussian splatting predicts one primitive per pixel from a few images in a single pass, and its rendering quality depends on how well these primitives cover the surface. Recent surfel-based methods compute the surface-aligned covariance analytically from predicted depth. However, this covariance has no way to correct the surfel orientation where the depth-derived frame is ill-posed. The surfels then cover the surface loosely; at the training resolution each surfel's one-pixel minimum footprint covers the gaps, but they show up as holes when the same prediction is re-rendered at a higher resolution. To address this, we keep the analytic covariance as an initialization, with its axes aligned to the surface tangents, and add an identity-initialized unit-quaternion residual that reorients a surfel only where this improves rendering, turning surfels that the analytic frame mis-aims back onto the surface. On RealEstate10K, PaveSplat achieves the best PSNR, SSIM, and LPIPS among single-Gaussian-per-pixel methods at every scale (1x-8x). The native-resolution gain is small; the benefit appears when the same prediction is rendered at higher display resolutions without re-running the network. On zero-shot DL3DV, it leads PSNR within this group at every scale and ranks first or second on SSIM/LPIPS. A coverage-hole analysis shows fewer uncovered pixels than both baselines under high-resolution re-rendering.
Figures & tables
| ( Standard ) | (HRRC) | (HRRC) | (HRRC) | |||||||||
| Method | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS | PSNR | SSIM | LPIPS |
| pixelSplat [ 1 ] | 26.073 | 0.864 | 0.136 | 25.262 | 0.855 | 0.208 | 24.378 | 0.864 | 0.275 | 24.003 | 0.898 | 0.280 |
| HiSplat [ 14 ] | 27.194 | 0.882 | 0.117 | 25.097 | 0.867 | 0.191 | 24.097 | 0.876 | 0.244 | 23.816 | 0.910 | 0.248 |
| MVSplat [ 3 ] | 26.387 | 0.869 | 0.128 | 20.294 | 0.808 | 0.279 | 17.882 | 0.754 | 0.421 | 17.195 | 0.770 | 0.438 |
| TranSplat [ 23 ] | 26.688 | 0.875 | 0.125 | 20.499 | 0.814 | 0.275 | 18.071 | 0.760 | 0.423 | 17.383 | 0.776 | 0.438 |
| DepthSplat [ 18 ] | 27.506 | 0.890 | 0.112 | 19.914 | 0.772 | 0.332 | 16.299 | 0.631 | 0.491 | 15.079 | 0.619 | 0.508 |
| Configuration | frame | black% | PSNR | PSNR | ||
| SurfSplat ‡ | normal | – | 0.667 | 1.00 | 27.519 | 23.342 |
| tangent frame | tangent | – | 0.580 | 1.11 | 27.544 | 23.850 |
| residual (Ours) | tangent | ✓ | 0.585 | 0.78 | 27.686 | 24.266 |
3D Gaussian Splatting
3D Gaussian Splatting represents scenes as optimizable 3D Gaussian primitives for fast, photorealistic rendering from new viewpoints.
See all 1,093 papers