UHD-GPGNet: UHD Video Denoising via Gaussian-Process-Guided Local Spatio-Temporal Modeling
Organizations: Qingdao University, Qingdao, China · National University of Defense Technology, Changsha, China · SUN YAT-SEN University, Guangzhou, China · Shandong Normal University, Jinan, China ·
Abstract
Ultra-high-definition (UHD) video denoising requires simultaneously suppressing complex spatio-temporal degradations, preserving fine textures and chromatic stability, and maintaining efficient full-resolution 4K deployment. In this paper, we propose UHD-GPGNet, a Gaussian-process-guided local spatio-temporal denoising framework that addresses these requirements jointly. Rather than relying on implicit feature learning alone, the method estimates sparse GP posterior statistics over compact spatio-temporal descriptors to explicitly characterize local degradation response and uncertainty, which then guide adaptive temporal-detail fusion. A structure-color collaborative reconstruction head decouples luminance, chroma, and high-frequency correction, while a heteroscedastic objective and overlap-tiled inference further stabilize optimization and enable memory-bounded 4K deployment. Experiments on UVG and RealisVideo-4K show that UHD-GPGNet achieves competitive restoration fidelity with substantially fewer parameters than existing methods, enables real-time full-resolution 4K inference with significant speedup over the closest quality competitor, and maintains robust performance across a multi-level mixed-degradation schedule.A real-world study on phone-captured 4K video further confirms that the model, trained entirely on synthetic degradation, generalizes to unseen real sensor noise and improves downstream object detection under challenging conditions.
Figures & tables
| Method | PSNR | SSIM | Params(M) | FLOPs(G) |
| FastDVDnet | 29.434 | 0.7675 | 2.479 | 334.4 |
| ASwin | 32.764 | 0.9688 | 8.910 | 841.0 |
| BSVD | 28.791 | 0.7178 | 9.816 | 3107.0 |
| RVRT | 28.751 | 0.7316 | 12.787 | 888.9 |
| TAP † | 31.061 | 0.8977 | 34.482 | 3183.2 |
| UHD-GPGNet | 32.759 | 0.9592 | 0.707 | 347.3 |
| Component | |||
| Exposure | 0.95–1.05 | 0.90–1.10 | 0.85–1.15 |
| Sensor+ grain | shot 1.5e-3–1.2e-2 read 4e-4–4e-3 8e-4–8e-3 | shot 3e-3–2.4e-2 read 8e-4–8e-3 1.6e-3–1.6e-2 | shot 4.5e-3–3.6e-2 read 1.2e-3–1.2e-2 2.4e-3–2.4e-2 |
| Flicker | ; 0.85–0.97 std (0.02, 0.003) | ; 0.85–0.97 std (0.04, 0.006) | ; 0.85–0.97 std (0.06, 0.009) |
| Chroma | Cb/Cr std 0.002 | Cb/Cr std 0.004 | Cb/Cr std 0.006 |
| H.264 | CRF 28 | CRF 32 | CRF 36 |
| Method | Avg. SSIM | Drop | |||
| FastDVDnet | 33.43 | 29.17 | 26.58 | 0.768 | 6.85 |
| ASwin | 36.23 | 32.37 | 29.50 | 0.962 | 6.73 |
| BSVD | 32.29 | 28.53 | 26.18 | 0.718 | 6.11 |
| RVRT | 32.43 | 28.52 | 27.14 | 0.734 | 5.29 |
| TAP † | 35.30 | 31.02 | 28.33 | 0.910 | 6.97 |
| UHD-GPGNet | 36.43 | 32.14 | 30.22 | 0.951 | 6.21 |
| Method | Peak Mem. (GiB) | FPS | PSNR | SSIM |
| FastDVDnet | 1.32 | 62.52 | 30.250 | 0.7714 |
| ASwin | 7.31 | 0.95 | 34.177 | 0.9631 |
| BSVD | 3.29 | 12.95 | 29.640 | 0.7279 |
| RVRT | 5.20 | 2.04 | 29.485 | 0.7360 |
| TAP † | 4.94 | 3.33 | 32.496 | 0.9107 |
| UHD-GPGNet | 3.95 | 28.06 | 34.213 | 0.9639 |
| Variant | Det. gate | GP | Hetero | Y/C | HF | PSNR | SSIM |
| Backbone | 31.78 | 0.881 | |||||
| + Det. gate | 31.95 | 0.885 | |||||
| + Attn+Var | attn | 32.11 | 0.891 | ||||
| + Attn+Var+P | attn+p | 32.15 | 0.893 | ||||
| + Sparse GP | 32.32 | 0.898 | |||||
| + Hetero obj. | 32.41 | 0.902 |
| Setting | Err–Unc Corr. | Chroma Flicker | CbCr PSNR | Seam Score | Ref. PSNR |
| No GP | 0.52 | 0.0234 | 37.19 | 0.0121 | 32.18 |
| No hetero | 0.59 | 0.0198 | 37.85 | 0.0113 | 32.29 |
| RGB-only | 0.61 | 0.0231 | 36.87 | 0.0107 | 32.21 |
| No overlap | 0.61 | 0.0185 | 37.96 | 0.0292 | 32.44 |
| Full model | 0.75 | 0.0125 | 39.12 | 0.0062 | 32.60 |
| Avg Det | Avg Conf | Temp Cons | NIQE | BRISQUE | |
| Raw input | 6.2 | 0.414 | 0.863 | 3.66 | 19.8 |
| Denoised | 6.5 | 0.423 | 0.878 | 3.55 | 19.0 |
| +0.3 | +0.009 | +0.015 | 0.11 | 0.8 |
Image Restoration
Image restoration uses computational methods to recover useful visual content from noisy, blurred, low-resolution, or otherwise degraded images.
See all 372 papers