RIQE: a NIQE-style reference model for Computed Tomography
Organizations: EOC
Abstract
The Natural Image Quality Evaluator (NIQE) scores an image by its statistical distance from a model fitted on pristine images, and its distributed model is fitted on photographs. We release the Radiology Image Quality Evaluator (RIQE), a NIQE-style model fitted on 3,792 full-dose slices from 158 patients of the public LDCT-and-Projection-data collection, with a declared intensity mapping, a manifest of every slice and a script that reproduces the fit. On 40 held-out patients, RIQE ranks reduced-dose reconstructions, simulated by projection-domain noise insertion, worse than the full-dose reconstruction of the same slice in 240 of 240 chest and 230 of 240 abdominal pairs, and ranks images with 20% more noise worse than their source in 97.5-100% of cases. Its preferences among filtered images, however, do not follow lesion signal. With a 4 mm, +10 HU lesion inserted in noisy abdominal slices, RIQE prefers bilateral filtering to the unfiltered image in every image up to a 32 HU residual, at which 29% of the lesion's matched-filter signal remains and its detectability index falls from 0.51 to 0.33; it never prefers Gaussian smoothing, which at the same 32 HU residual leaves 70% of the signal and a detectability index of 0.48. Fitted on photographs with the parameters published for NIQE, the same code ranks every simulated reduced-dose abdominal image better than its full-dose counterpart. RIQE is suited to ranking a degraded image against its source; under the conditions tested it should not be the sole criterion for selecting, comparing or tuning denoisers.
Figures & tables
| Experiment | Available | Selection | Excluded | Analysed (patients / units) |
|---|---|---|---|---|
| Model fitting | 158 fitting patients, 24 slices each | – | – | 158 / 3,792 slices |
| Hyperparameter search | inner split 118 / 40 patients | 4 evenly spaced slices per validation patient; all 24 for dose pairs | – | 40 / 160 slices, 480 dose pairs |
| Reduced dose (test) | 20 Siemens patients with reduced-dose series | all kept slices | 0 unscoreable | 20 / 480 pairs |
| Noise, blur, filtering (test) | 40 patients, 960 kept slices | 6 evenly spaced slices per patient | 0 unscoreable | 40 / 240 slices, 7,200 filtered |
| Denoisers on reduced dose | 20 Siemens test patients | slices of the test bank with a reduced-dose counterpart | 0 unscoreable | 20 / 120 slices |
| Inserted lesions | 20 abdominal test patients | central slice; sites by rule | 2 without 4 mm sites | 20 / 20 slices |
| Degradation | Chest (%) | Abdomen (%) |
|---|---|---|
| Reduced dose (10%/25% of routine), same slice | 100.0 [100.0, 100.0] | 95.8 [91.2, 99.6] |
| patients with every pair correct | 10/10 [69.2, 100.0] | 6/10 [26.2, 87.8] |
| Added noise, +5% of native | 85.0 [75.8, 93.3] | 89.2 [81.7, 95.8] |
| Added noise, +10% of native | 92.5 [85.0, 98.3] | 98.3 [95.8, 100.0] |
| Added noise, +20% of native | 97.5 [95.0, 100.0] | 100.0 [100.0, 100.0] |
| Added noise, +50% of native | 100.0 [100.0, 100.0] | 100.0 [100.0, 100.0] |
| Residual (HU) | ||||||
|---|---|---|---|---|---|---|
| Denoiser | 2 | 4 | 8 | 16 | 32 | 64 |
| Gaussian | 50 (+0.00) | 48 (+0.00) | 39 (+0.02) | 32 (+0.08) | 20 (+0.44) | 0 (+2.70) |
| Wavelet | 56 ( 0.01) | 56 ( 0.02) | 42 (+0.08) | 27 (+0.38) | 9 (+1.15) | 3 (+2.27) |
| TV | 82 ( 0.06) | 70 ( 0.09) | 50 ( 0.01) | 29 (+0.74) | 5 (+3.35) | 2 (+5.35) |
| NLM | 60 ( 0.01) | 57 ( 0.02) | 47 (+0.01) | 37 (+0.56) | 20 (+1.70) | 5 (+2.87) |
| Bilateral | 94 ( 0.05) | 96 ( 0.11) | 85 ( 0.15) | 59 ( 0.04) | 38 (+0.38) | 18 (+1.84) |
| Residual (HU): preferred (%) / signal retained | ||||||
| Denoiser | 2 | 4 | 8 | 16 | 32 | 64 |
| Gaussian | 0 / 0.98 | 0 / 0.97 | 0 / 0.93 | 0 / 0.86 | 0 / 0.70 | 0 / 0.34 |
| Wavelet | 0 / 0.99 | 6 / 0.98 | 39 / 0.96 | 61 / 0.89 | 0 / 0.69 | 0 / 0.29 |
| TV | 61 / 0.97 | 56 / 0.94 | 6 / 0.87 | 0 / 0.72 | 0 / 0.39 | 0 / 0.05 |
| NLM | 0 / 0.99 | 0 / 0.97 | 0 / 0.88 | 0 / 0.66 | 0 / 0.23 | 0 / 0.06 |
| Bilateral | 100 / 0.98 | 100 / 0.94 | 100 / 0.83 | 100 / 0.63 | 100 / 0.29 | 0 / 0.01 |
| Contrast | Patients | Null | ||
|---|---|---|---|---|
| Anchor: full vs reduced dose, same slices | 80 / 80 | 1.84 | 0.25 | 1.00 |
| Abdomen 5 mm: GE STANDARD vs Siemens B30f | 40 / 40 | 0.97 | 0.19 | 0.49 |
| Vendor: all GE vs all Siemens | 78 / 80 | 1.21 | 0.27 | 0.59 |
| Pixel-spacing tertiles, GE abdomen | 13 / 13 | 1.30 | 0.33 | 0.61 |
| Pixel-spacing tertiles, Siemens abdomen | 13 / 13 | 1.43 | 0.32 | 0.69 |
| GE: chest 1.25 mm vs abdomen 5 mm | 38 / 40 | 1.43 | 0.32 | 0.70 |
| RIQE | Photographs, | Photographs, | |
|---|---|---|---|
| (CT) | RIQE settings | NIQE parameters | |
| Reduced dose ranked worse, chest (%) | 100.0 | 100.0 | 98.3 |
| Reduced dose ranked worse, abdomen (%) | 95.8 | 31.2 | 0.0 |
| Noise +20% of native detected (%) | 98.8 | 70.8 | 3.3 |
| Noise +100% of native detected (%) | 100.0 | 78.8 | 39.6 |
| Filtered full-dose preferred (%) | 41.2 | 31.3 | 16.9 |