sRGB Real Noise Modeling via Noise-Aware Sampling with Normalizing Flows
Organizations: Dept. of Computer Science, Hanyang University · Dept. of Artificial Intelligence, Hanyang University · Dept. of Data Science, Hanyang University
Abstract
Noise poses a widespread challenge in signal processing, particularly when it comes to denoising images. Although convolutional neural networks (CNNs) have exhibited remarkable success in this field, they are predicated upon the belief that noise follows established distributions, which restricts their practicality when dealing with real-world noise. To overcome this limitation, several efforts have been taken to collect noisy image datasets from the real world. Generative methods, employing techniques such as generative adversarial networks (GANs) and normalizing flows (NFs), have emerged as a solution for generating realistic noisy images. Recent works model noise using camera metadata, however requiring metadata even for sampling phase. In contrast, in this work, we aim to estimate the underlying camera settings, enabling us to improve noise modeling and generate diverse noise distributions. To this end, we introduce a new NF framework that allows us to both classify noise based on camera settings and generate various noisy images. Through experimental results, our model demonstrates exceptional noise quality and leads in denoising performance on benchmark datasets.
Figures & tables
| Key features | Flow-sRGB | NeCA | Ours |
| Sampling without metadata | ✗ | ✗ | ✓ |
| Single unified model | ✓ | ✗ | ✓ |
| Correlated noise generation | ✗ | ✓ | ✓ |
| Camera | Metrics | C2N | Flow-sRGB | NeCA-S | NeCA-W | NAFlow |
|---|---|---|---|---|---|---|
| G4 | KLD | 0.1660 | 0.0507 | 0.4025 | 0.0242 | 0.0254 |
| AKLD | 0.2007 | 0.1504 | 1.6803 | 0.1524 | 0.1367 | |
| GP | KLD | 0.1315 | 0.0781 | 0.1713 | 0.0432 | 0.0352 |
| AKLD | 0.1968 | 0.1797 | 0.7379 | 0.1273 | 0.1180 | |
| IP | KLD | 0.0581 | 0.5128 | 0.3424 | 0.0410 | 0.0339 |
| AKLD | 0.2929 | 1.7490 | 1.2924 | 0.1145 | 0.1522 |
| Metrics | C2N | NoiseFlow | Flow-sRGB | NeCA-S | NeCA-W | NAFlow | Real Noise |
|---|---|---|---|---|---|---|---|
| PSNR | 33.76 | 33.81 | 34.74 | 36.10 | 36.82 | 37.22 | 37.63 |
| SSIM | 0.901 | 0.894 | 0.912 | 0.927 | 0.932 | 0.935 | 0.935 |
| Table 7: KLD score conditioning on learnable parameters of Gaussian distribution in Eq. 4 . Training Training KLD ✗ ✗ 0.0544 ✓ ✗ 0.0449 ✗ ✓ 0.0340 ✓ ✓ 0.0291 | Table 8: KLD score depending on different number of scale-level blocks in Fig. 3 . Scale-level KLD ↓ 0.0349 0.0313 0.0291 N/A |
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
Image Denoising
Image denoising removes unwanted noise while preserving the edges, textures, and colors needed for faithful images.
See all 157 papers