Noise2Match: Self-Supervised Low-Dose CT Denoising via Adaptive Inter-Slice Matching
Organizations: Jiangsu Key Laboratory for Biomaterials and Devices, School of Biological Science and Medical Engineering, Southeast University, Nanjing 210009, China. · Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University, Shanghai 201203, China · Jiangsu Key Laboratory for Cardiovascular Information and Health Engineering Medicine, Institute of Clinical Medicine, Nanjing Drum Tower Hospital, Medical School, Nanjing University, Nanjing 210093, China
Abstract
With the rapid development of deep learning, supervised convolutional neural network methods have greatly improved the performance of low-dose computed tomography (CT) denoising. However, they require paired noisy-clean training data, which is difficult to obtain in practice. Some classic self-supervised denoising methods rely on the assumption of pixel-wise independent noise, making them ineffective for correlated noise in low-dose CT (LDCT) images. Considering the high similarity and weaker noise correlation between adjacent CT slices, several recently proposed self-supervised methods use adjacent LDCT slices for training. Nevertheless, these approaches fail to effectively account for the non-rigid misalignment between slices caused by anatomical variation, hindering them from satisfying the equal-mean condition required by the classic Noise2Noise framework. In this paper, we propose Noise2Match, a self-supervised LDCT denoising method based on adaptive inter-slice matching. Noise2Match introduces an inter-slice matching network to model the label transition process between adjacent slices, and then applies correction to the denoiser's outputs to better satisfy the equal-mean condition. We theoretically prove that, under idealized conditions, training Noise2Match using adjacent LDCT slices is equivalent to supervised training with paired noisy-clean images. We further find that Noise2Match can also effectively perform low-dose conebeam CT (CBCT) denoising, which could be attributed to its correction operation that reduces inter-slice noise correlation. To the best of our knowledge, Noise2Match is the first effective image-domain self-supervised method for low-dose CBCT. Extensive experiments demonstrate that Noise2Match outperforms existing image-domain selfsupervised methods, offering broader applicability and higher practical value.
Figures & tables
| Methods | Mayo 2016 | Mayo 2020 | ||||
|---|---|---|---|---|---|---|
| PSNR (dB) | SSIM | RMSE (HU) | PSNR (dB) | SSIM | RMSE (HU) | |
| LDCT | 34.75 0.95 | 0.8211 0.0342 | 36.81 4.23 | 36.44 3.04 | 0.8682 0.0662 | 26.68 11.29 |
| BM3D | 37.25 0.88 | 0.8952 0.0253 | 27.58 2.91 | 39.03 2.80 | 0.8977 0.0291 | 25.21 6.00 |
| RED-CNN | 40.56 0.89 | 0.9435 0.0123 | 18.83 1.99 | 43.54 2.85 | 0.9691 0.0184 | 14.16 5.95 |
| Noise2Clean | 40.52 0.90 | 0.9437 0.0127 | 18.93 2.01 | 43.41 2.95 | 0.9698 0.0173 | 14.44 6.49 |
| Noise2Void | 35.42 0.91 | 0.8420 0.0317 | 34.06 3.76 | 38.35 2.97 | 0.8762 0.0582 | 26.13 10.96 |
| Methods | PSNR (dB) | SSIM | RMSE (HU) | |
|---|---|---|---|---|
| Mayo 2016 | LDCT | 36.39 1.86 | 0.8605 0.0493 | 31.06 7.62 |
| Noise2Void | 36.81 1.83 | 0.8747 0.0467 | 29.56 7.14 | |
| Neighbor2Neighbor | 37.27 1.76 | 0.8919 0.0444 | 27.99 6.47 | |
| SDCNN | 38.03 1.22 | 0.9085 0.0299 | 25.34 3.90 | |
| MM-Net | 39.01 1.41 | 0.9246 0.0309 | 22.71 4.09 | |
| Noise2Sim | 39.44 1.44 | 0.9411 0.0229 | 21.53 3.81 |
| Methods | Real-World CBCT | ICASSP CBCT | |||||
|---|---|---|---|---|---|---|---|
| CNR | Std (HU) | PSNR (dB) | SSIM | RMSE (HU) | CNR | Std (HU) | |
| LDCT | 0.73 | 94.63 | 29.30 0.66 | 0.7260 0.0378 | 67.45 6.60 | 0.90 | 138.06 |
| Noise2Void | 0.92 | 76.30 | 31.33 0.97 | 0.8390 0.0243 | 54.59 5.63 | 1.46 | 82.92 |
| Neighbor2Neighbor | 0.95 | 72.61 | 31.37 0.90 | 0.8466 0.0194 | 53.03 5.76 | 1.79 | 76.15 |
| SDCNN | 2.66 | 32.64 | 31.29 1.16 | 0.8765 0.0255 | 53.97 7.87 | 3.87 | 41.33 |
| MM-Net | 1.03 | 69.53 | 31.84 0.94 | 0.8655 0.0293 | 49.50 6.12 | 2.17 | 64.14 |
| Dataset | Jacobian determinant | Folding ratio |
|---|---|---|
| Mayo 2016 | 0.9999 0.0495 | 0% |
| Mayo 2020 | 1.0001 0.0727 | 0% |
| Real-World CBCT | 1.0002 0.0604 | 0% |
| ICASSP CBCT | 1.0007 0.0703 | 0% |
| PSNR (dB) | SSIM | RMSE (HU) | ||||
|---|---|---|---|---|---|---|
| - | - | - | - | 37.86 0.81 | 0.9229 0.0211 | 24.83 2.13 |
| ✓ | ✓ | - | - | 35.90 0.91 | 0.8552 0.0299 | 32.22 3.53 |
| ✓ | ✓ | ✓ | - | 39.68 0.85 | 0.9368 0.0187 | 20.38 2.02 |
| ✓ | ✓ | ✓ | ✓ | 40.08 0.84 | 0.9410 0.0167 | 19.89 1.96 |
| PSNR (dB) | SSIM | RMSE (HU) | ||
|---|---|---|---|---|
| Mayo 2016 | 1 | 40.08 0.84 | 0.9410 0.0167 | 19.89 1.96 |
| 2 | 39.37 0.96 | 0.9334 0.0172 | 21.92 2.27 | |
| 3 | 38.59 0.97 | 0.9261 0.0156 | 23.64 2.64 | |
| 4 | 38.10 1.18 | 0.9182 0.0187 | 25.10 3.52 | |
| Mayo 2020 | 1 | 42.88 2.48 | 0.9648 0.0189 | 15.32 6.46 |
| 2 | 40.93 1.84 | 0.9587 0.0150 | 19.02 5.23 |
| PSNR (dB) | SSIM | RMSE (HU) | |
|---|---|---|---|
| 60 | 40.08 0.82 | 0.9406 0.0170 | 19.90 1.96 |
| 70 | 40.07 0.84 | 0.9409 0.0169 | 19.92 1.97 |
| 80 | 40.08 0.84 | 0.9410 0.0167 | 19.89 1.96 |
| 90 | 40.05 0.85 | 0.9411 0.0152 | 19.98 2.01 |
| 100 | 40.07 0.83 | 0.9407 0.0173 | 19.91 1.96 |
Self-Supervised Image Denoising
Self-supervised image denoising learns to remove noise from images without requiring clean training targets.
See all 25 papers