ClearGS: Reliability-Aware Gaussian Splatting from Handheld Videos
Organizations: Shenzhen University of Advanced Technology · HONOR · University of New South Wales · Southern University of Science and Technology
Abstract
We present ClearGS for 3D Gaussian Splatting (3DGS) from handheld videos with uneven viewpoint coverage and mixed frame quality. Rather than selecting frames with binary decisions, ClearGS uses Reliability-aware View Allocation (RVA) to assign graded raw-supervision weights based on appearance reliability, degradation risk, and geometric utility, while weakly reactivating useful suppressed frames to maintain trajectory coverage. Since weighting cannot restore details lost to blur or distortion, ClearGS further introduces Render-Guided In-Video Restoration (RIVR). The current 3DGS render provides a pose-aligned structural candidate, a frozen no-reference restoration expert restores the corresponding raw video observation without any clean reference image, and no-reference perceptual scores select among the render, restored observation, and high-frequency fused candidate. ClearGS then applies Full-Trajectory Repair Consolidation to revisit accepted repairs and preserve details introduced early. On GS2E and GSOTM, ClearGS achieves state-of-the-art overall performance, with consistent CLIP-IQA and MUSIQ gains and LPIPS reductions in most degradation settings, without paired sharp supervision or matched clean references.
Figures & tables
| Part | Quantity / role | Definition or condition | Parameters / weight |
| Appearance | ordered quality cues: sharpness, structural clarity, texture reliability, artifact cleanliness, exposure quality | ||
| ordered degradation cues: motion blur, defocus, ghosting, exposure failure, unreliable texture, artifacts | |||
| appearance reliability score | |||
| degradation risk score | |||
| appearance-reliable frame set | |||
| Geometry | normalized camera-center distance between frames and | Euclidean distance normalized to |
| Candidate | Construction | Role |
|---|---|---|
| Render | Pose-aligned structural candidate | |
| Restored | Restoration of the raw target observation | |
| Fused | Render base with restored high-frequency detail |
| Method | LPIPS | CLIP-IQA | MUSIQ | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GS2E | GSOTM | GS2E | GSOTM | GS2E | GSOTM | ||||||||||||||||
| Slight | Medium | Severe | MB | RS | MB+RS | PN | Slight | Medium | Severe | MB | RS | MB+RS | PN | Slight | Medium | Severe | MB | RS | MB+RS | PN | |
| All-view | 0.397 | 0.414 | 0.430 | 0.323 | 0.334 | 0.419 | 0.476 | 0.266 | 0.261 | 0.256 | 0.194 | 0.212 | 0.196 | 0.227 | 34.82 | 32.02 | 30.11 | 36.75 | 50.25 | 34.51 | 34.06 |
| Select-G (Ours) | 0.386 | 0.401 | 0.415 | 0.285 | 0.333 | 0.393 | 0.472 | 0.266 | 0.256 | 0.261 | 0.201 | 0.211 | 0.187 | 0.224 | 36.53 | 34.51 | 34.22 | 42.31 | 50.55 | 39.46 | 35.42 |
| DiFiX3D ( Wu et al. 2025a ) | 0.349 | 0.372 | 0.388 | 0.224 | 0.224 | 0.322 | 0.249 | 0.258 | 0.255 | 0.253 | 0.231 | 0.253 | 0.213 | 0.230 | 41.53 | 39.03 | 36.93 | 41.64 | 59.77 | 39.94 | 51.64 |
| GeoQuery ( Cao et al. 2026 ) | 0.350 | 0.373 | 0.389 | 0.231 | 0.224 | 0.332 | 0.249 | 0.256 | 0.253 | 0.252 | 0.230 | 0.250 | 0.216 | 0.231 | 41.33 | 38.70 | 37.20 | 41.86 | 59.50 | 40.02 | 51.27 |
| Variant | PSNR | SSIM | LPIPS | ||||||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| GS2E | GSOTM | GS2E | GSOTM | GS2E | GSOTM | ||||||||||||||||
| S | M | V | MB | RS | MB+RS | PN | S | M | V | MB | RS | MB+RS | PN | S | M | V | MB | RS | MB+RS | PN | |
| RVA w/o cov. | 20.123 | 19.538 | 19.499 | 21.621 | 18.010 | 17.624 | 18.413 | 0.607 | 0.592 | 0.589 | 0.730 | 0.530 | 0.534 | 0.573 | 0.388 | 0.413 | 0.415 | 0.290 | 0.339 | 0.387 | 0.472 |
| Full RVA | 19.934 | 20.076 | 20.011 | 22.545 | 18.124 | 18.010 | 18.458 | 0.606 | 0.609 | 0.608 | 0.739 | 0.530 | 0.541 | 0.573 | 0.386 | 0.401 | 0.415 | 0.285 | 0.333 | 0.393 | 0.472 |
| Metric | Variant | GS2E | GSOTM | |||||
|---|---|---|---|---|---|---|---|---|
| S | M | V | MB | RS | MB+RS | PN | ||
| LPIPS | w/o Obs. | 0.385 | 0.401 | 0.414 | 0.247 | 0.294 | 0.358 | 0.398 |
| w/o | 0.336 | 0.348 | 0.365 | 0.171 | 0.213 | 0.298 | 0.196 | |
| Full RIVR | 0.333 | 0.342 | 0.350 | 0.193 | 0.225 | 0.302 | 0.197 | |
| CLIP-IQA | w/o Obs. | 0.283 | 0.270 | 0.279 | 0.217 | 0.239 | 0.209 | 0.258 |
| w/o | 0.280 | 0.275 | 0.282 | 0.263 | 0.280 | 0.221 | 0.269 | |
3D Gaussian Splatting
3D Gaussian Splatting represents scenes as optimizable 3D Gaussian primitives for fast, photorealistic rendering from new viewpoints.
See all 1,019 papers