The Prior-Force Family of Implicit Denoiser Priors and Its Decisions in Linear Inverse Problems
Organizations: Shenzhen Key Laboratory of Advanced Machine Learning and Applications, School of Mathematical Sciences, Shenzhen University, Shenzhen, 518060, China · National Center for Applied Mathematics Shenzhen (NCAMS), Shenzhen, 518055, China
Abstract
Implicit priors given by Gaussian denoisers successfully regularize a wide range of inverse problems in approaches such as plug-and-play (PnP), regularization by denoising (RED) and score-based methods. Such a prior depends on the noise level, and how it selects among signals consistent with the data remains largely uncharacterized. To put implicit and explicit priors on the same footing, we define the prior-force family of any Gaussian denoiser at noise variance (inverse in the graph sense), the normalized denoising residual as an operator on clean signals. At a common effective prior weight, the equilibrium equations differ only in their prior terms: PnP uses , RED/score-based methods the score force (the normalized residual as an operator on noisy inputs), and maximum a posteriori (MAP) estimation the MAP force (the negative log-prior gradient). For the minimum mean-square error (MMSE) denoisers of a prior , we compare the corresponding energies at three levels. Without observation, raising the noise level favors PnP minima that retain more posterior variance. On signals consistent with the data, the leading-order PnP energy for separated modes is the proximal hull of the MAP energy, which lets PnP select signals between modes; modes of equal data fit are ranked by peak height at small noise levels and by mass at large ones. For recovery, at the truth bounds the local bias, and an oracle noise level balances this bias against denoiser error. These results show that the noise level is a parameter of the prior rather than a step size. Experiments with exact priors support these predictions, including the mixture components that PnP selects on unseen data.
Figures & tables
| method | prior term | evaluated at | energy (Bayes denoiser) | |
|---|---|---|---|---|
| MAP | — | — | ||
| PnP family | denoised output | , curvature | ||
| RED / score | noisy input | , Moreau envelope of |
| result | statement | status | here |
|---|---|---|---|
| variance-ordering law | gap derivative along branches, on fibers | new; pointwise [ 10 ] | Theorem 3.2 |
| fiber stability | Schur-complement criterion | new | Theorem 4.3 |
| proximal hull | ; core or bridge | new (statement) | Theorem 4.7 |
| proximal hull, mixtures | , every separation | new | Theorem 4.7 |
| height against mass | PnP score MAP score penalty on narrow modes | new | Theorems 4.10 and 4.11 |
| selection bias | bounds by , local and statistical | new | Theorems 5.1 and 5.2 |
| concept in the literature | object here | source | here |
|---|---|---|---|
| MMSE denoiser is proximal | [ 9 , 13 ] | Proposition 2.2 | |
| denoiser as resolvent of a monotone operator | [ 15 ] | Section 2.2.1 | |
| PnP and RED as monotone inclusions | ( 4 ), ( 5 ) | [ 16 ] | Proposition 2.1 |
| fixed points of PnP-ADMM, DRS, consensus equilibrium | ( 4 ), effective | [ 45 , 4 ] | Proposition 2.1 |
| non-variational regularization | ( 4 ) | [ 20 ] | Proposition 2.1 |
| upper Moreau envelope, weak convexity | Moreau envelope of | [ 14 ] | Proposition 2.2 |
| statement | tested against | result |
|---|---|---|
| , ( 9 ) | finite differences | |
| , attained at ( Remark 3.3 ) | two-point prior, | |
| rigidity ( Proposition 2.5 (ii)) | drift of in | Gaussian; otherwise |
| small-scale expansion ( 20 ) | halving | error ratios , (predicted ) |
| ( Proposition 2.4 (i)) | critical points | residual |
| congruence ( 19 ), equal inertia | finite-difference Hessians | ; inertia equal at all |
| condition | instances | scores | trivial | departures predicted | false alarms |
|---|---|---|---|---|---|
| new images | |||||
| top rows observed | |||||
| noise | |||||
| all |