Stabilizing Illumination Conditioning in SSM-Based Low-Light Image Enhancement with Bottleneck Prompt Sidecars
Organizations: School of Computing and Data Science, Xiamen University Malaysia, Sepang, Selangor 43900, Malaysia · School of Artificial Intelligence and Robotics, Xiamen University Malaysia, and with the School of Engineering and Applied Science, University of Pennsylvania, Philadelphia, PA 19104, USA · School of Artificial Intelligence and Robotics and the S.M.A.R.T. Nexus Center of Excellence, Xiamen University Malaysia, Sepang, Selangor 43900, Malaysia · School of Energy and Chemical Engineering, Xiamen University Malaysia, Sepang, Selangor 43900, Malaysia ·
Abstract
Low-light image enhancement (LLIE) requires more than brightness amplification because real low-light images often exhibit spatially varying illumination, amplified noise, color distortion, and local detail loss. Recent SSM- and Mamba-based restorers provide efficient long-range modeling, yet the route for introducing illumination priors into such backbones remains insufficiently studied. This study addresses safe illumination conditioning for SSM-based LLIE through a bottleneck-side PromptAdapter. A lightweight illumination estimator first predicts a single-channel illumination map, which is then converted into prompt tokens and injected through a residual sidecar adapter at the bottleneck, thereby avoiding direct modification of the state-space core. Under a locked three-seed evaluation protocol on LOL-v1, LOLv2-Real, and LOLv2-Synthetic, the PromptAdapter improves over the Base model by 0.94 dB, 1.24 dB, and 0.93 dB in PSNR, respectively, while also improving SSIM, LPIPS, and masked dark-region metrics. The clearest real-data evidence appears on LOLv2-Real. A Learned-Fixed control on LOL-v1 indicates that the present results support the utility of the sidecar conditioning pathway more strongly than a strict claim of illumination-conditioned superiority, and the LOLv2-Synthetic result remains stability-conditioned. These findings suggest that, in SSM-based LLIE, conditioning design can be as important as the conditioning signal itself.
Figures & tables
| Variant | Params (M) | FLOPs (G) |
|---|---|---|
| Base | 2.46 | 5.16 |
| Prompt-Adapter | 2.52 | 5.18 |
| Learned-Fixed | 2.47 | 5.17 |
| Dataset | Variant | PSNR | SSIM | LPIPS | mPSNR | mSSIM |
|---|---|---|---|---|---|---|
| LOL-v1 | Base | 25.01 0.34 | 0.9077 0.0011 | 0.2292 0.0017 | 24.95 0.21 | 0.9033 0.0009 |
| LOL-v1 | Prompt-Adapter | 25.95 0.18 | 0.9094 0.0010 | 0.2273 0.0066 | 25.96 0.28 | 0.9053 0.0006 |
| LOL-v1 | Learned-Fixed | 25.99 0.59 | 0.9101 0.0017 | 0.2289 0.0063 | 26.09 0.67 | 0.9063 0.0021 |
| LOLv2-Real | Base | 20.73 0.47 | 0.8855 0.0016 | 0.2415 0.0056 | 20.99 0.43 | 0.8818 0.0018 |
| LOLv2-Real | Prompt-Adapter | 21.97 0.34 | 0.8903 0.0075 | 0.2309 0.0153 | 22.42 0.38 | 0.8876 0.0077 |
| LOLv2-Synthetic | Base | 25.44 0.17 | 0.9634 0.0007 | 0.0764 0.0011 | 26.89 0.40 | 0.9498 0.0009 |
| Method | LOL-v1 | LOLv2-Real | LOLv2-Syn | Relevance | Protocol note |
|---|---|---|---|---|---|
| SNR-Net | 24.61 / 0.842 | 21.48 / 0.849 | 24.14 / 0.928 | degradation-aware CNN | PSNR/SSIM only |
| Retinexformer | 25.16 / 0.845 | 22.80 / 0.840 | 25.67 / 0.930 | illumination-guided Transformer | official ICCV 2023 table |
| RetinexMamba † | 24.03 / 0.827 | 22.45 / 0.844 | 25.89 / 0.935 | SSM/Mamba-family reference | protocol footnote a |
| Base (this study) | 25.01 / 0.9077 | 20.73 / 0.8855 | 25.44 / 0.9634 | reproduced base model | Y-channel (BT.601) |
| Prompt-Adapter (this study) | 25.95 / 0.9094 | 21.97 / 0.8903 | 26.37 / 0.9661 | reproduced safe-conditioning route | Y-channel (BT.601); synthetic caveat |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Variant | Seed | PSNR | SSIM | LPIPS | mPSNR | mSSIM |
|---|---|---|---|---|---|---|---|
| LOL-v1 | Base | 3407 | 25.2991 | 0.9081 | 0.2288 | 25.1429 | 0.9035 |
| LOL-v1 | Base | 3408 | 24.6306 | 0.9065 | 0.2310 | 24.7266 | 0.9023 |
| LOL-v1 | Base | 3409 | 25.1019 | 0.9086 | 0.2277 | 24.9871 | 0.9041 |
| LOL-v1 | Prompt-Adapter | 3407 | 25.9464 | 0.9098 | 0.2218 | 25.9856 | 0.9059 |
| LOL-v1 | Prompt-Adapter | 3408 | 26.1289 | 0.9100 | 0.2346 | 26.2300 | 0.9052 |
| LOL-v1 | Prompt-Adapter | 3409 | 25.7692 | 0.9083 | 0.2255 | 25.6722 | 0.9047 |
Low-Light Image Enhancement
Low-light image enhancement restores visibility, color, and detail in underexposed images while limiting noise, blur, and color distortion.
See all 95 papers