BluRef: Unsupervised Image Deblurring with Dense-Matching References
Organizations: University of Wisconsin-Madison · Qualcomm AI Research · Posts & Telecommunications Inst. of Tech. · Adelaide University
Abstract
This paper introduces a novel unsupervised approach for image deblurring that utilizes a simple process for training data collection, thereby enhancing the applicability and effectiveness of deblurring methods. Our technique does not require meticulously paired data of blurred and corresponding sharp images; instead, it uses unpaired blurred and sharp images of similar scenes to generate pseudo-ground truth data by leveraging a dense matching model to identify correspondences between a blurry image and reference sharp images. Thanks to the simplicity of the training data collection process, our approach does not rely on existing paired training data or pre-trained networks, making it more adaptable to various scenarios and suitable for networks of different sizes, including those designed for low-resource devices. We demonstrate that this novel approach achieves state-of-the-art performance, marking a significant advancement in the field of image deblurring.
Figures & tables
| GoPro | RB2V | |||||
| Delta ( ) | 1 frame | 10 frames | 20 frames | 1 frame | 10 frames | 20 frames |
| Unsupervised Deblurring | ||||||
| DualGAN | 22.23 / 0.721 | 22.10 / 0.719 | 21.24 / 0.702 | 21.01 / 0.512 | 20.87 / 0.500 | 20.92 / 0.505 |
| UID-GAN | 23.42 / 0.732 | 23.18 / 0.724 | 22.38 / 0.724 | 22.22 / 0.578 | 22.01 / 0.551 | 22.13 / 0.569 |
| UAUD | 24.25 / 0.792 | 24.02 / 0.750 | 23.77 / 0.745 | 22.87 / 0.590 | 22.29 / 0.581 | 22.28 / 0.581 |
| BluRef (Ours) | ||||||
| Number of Refs. | 4 frames | 6 frames | 8 frames | 10 frames |
| PSNR / SSIM | 31.42 / 0.942 | 31.94 / 0.960 | 31.93 / 0.961 | 31.05 / 0.924 |
| Dataset | GoPro | RB2V |
| 36.1% | 33.7% | |
| 28.4% | 25.2% |
| Models | NIQE /FID |
| BSRGAN | 13.34/10.25 |
| Blur2Blur (GoPro as intermediate blur) | 12.01/8.93 |
| Blur2Blur (RSBlur as intermediate blur) | 10.07 / 6.28 |
| BluRef | 10.43/6.45 |
| BluRef + Blur2Blur (RSBlur as intermediate blur) | 8.47/5.62 |
| GoPro | RB2V | |
| BluRef | 31.87 / 0.955 | 27.72 / 0.808 |
| Blur2Blur (RSBlur) | 31.20 / 0.932 | 27.97 / 0.812 |
| BluRef + Blur2Blur (RSBlur) | 33.30 / 0.963 | 29.62 / 0.872 |
| Supervised - uppperbound | 33.32 / 0.962 | 28.54 / 0.824 |
| Annotation for training | GoPro | RB2V |
| Real ground truth | 33.32 / 0.962 | 28.54 / 0.824 |
| BluRef pseudo-ground truth | 31.97 / 0.949 | 27.73 / 0.817 |
| NAFNet (light) | BSRGAN + NAFNet | RSBlur + NAFNet |
| 10.25/6.85 | 13.34/10.25 | 11.4/7.87 |
Image Deblurring
Image deblurring restores sharp images from motion, defocus, and other blur by estimating lost detail and modeling image formation.
See all 62 papers