cs.CVNov 14, 2026

Generate, Align, and Restore: MLLM-Empowered Diffusion for Generalizable Low-light Image Enhancement

Authors: Kaisheng Pang, Feng Li, Chen Zhang, Junjun Jiang, Haoang Li, Sam Kwong, Runmin Cong

Organizations: Thrust of Robotics and Autonomous Systems, The Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China · Key Laboratory of Knowledge Engineering with Big Data, Ministry of Education of China, Hefei 230601, China · Innovation School of Artificial Intelligence, Hefei University of Technology, Hefei 230601, China · School of Control Science and Engineering, Shandong University, Jinan 250061, China · 

Abstract

Low-light image enhancement (LLIE) is essential to numerous vision applications operating under adverse illumination. Despite substantial advances, real-world nighttime enhancement remains challenging due to the scarcity of strictly aligned day-night pairs and complex degradations involving extreme darkness and heterogeneous artificial light sources, leading to fragile generalization. To overcome these challenges, we propose MrLIE (MLLM-empowered reference Low-light Image Enhancement), a novel reference-based unsupervised LLIE framework that synergizes the generative and reasoning capabilities of multimodal large language models (MLLMs) with conditional diffusion. MrLIE employs the MLLM as a high-fidelity reference synthesizer and diagnostic critic, iteratively generating, diagnosing, and correcting normal-light references directly from degraded nighttime observations. Based on this, our method governs the enhancement process through two complementary mechanisms, in which a confidence offset module rectifies spatial-geometric inconsistencies for reference reliability and a structure-anchored injection scheme harmonizes aligned reference cues, low-light structural constraints, and ControlNet additive anchoring during the denoising process. Extensive experiments on diverse benchmarks demonstrate that MrLIE achieves superior perceptual quality, natural appearance, and robust generalization.

Figures & tables

Explore similar work

May 27, 2026

Internally Referenced Low-Light Enhancement

Self-supervised low-light image enhancement (LLIE) is highly appealing as it eliminates the reliance on external paired data. However, the lack of external references causes networks to struggle with decoupling entangled illumination, delicate textures, and amplified noise. To resolve this challenge, we propose an Internally Referenced LLIE framework that extracts reliable physical and structural references from the degraded input image itself. First, we introduce a local exposure-simulated scheme to extract a low-frequency pseudo ground-truth. This serves as an internal physical reference to guide global illumination estimation and correct color casts. Second, we propose a dual-domain preservation strategy with spatial and spectral constraints to construct internal structural references. Specifically, an Illumination-Aligned Perceptual loss preserves global structures under illumination shifts, while a Shift-Invariant Spectral Correlation loss captures fine-grained local structures and suppresses high-frequency noise. Finally, we propose a Gain-Adaptive Feature Modulation (GAFM) mechanism to address highly spatially-variant residual noise. By transforming the self-estimated illumination map into an internal spatial gain prior, GAFM dynamically guides a blind-spot network for spatially-aware denoising. Extensive experiments demonstrate that our method achieves state-of-the-art performance, delivering superior noise suppression and textural fidelity. Code will be publicly released at https://visonj.github.io/IRLE/.
May 25, 2026

ControlLight: Towards Controllable, Consistent, and Generalizable Low-Light Enhancement

Existing deep learning-based low-light enhancement methods are typically trained on limited datasets with single enhancement targets, which restricts their generalization ability and controllability in real-world applications. To overcome these limitations, we propose ControlLight, a controllable, consistent, and generalizable framework for low-light enhancement. We first construct a large-scale dataset of real-world degraded images with continuous illumination-strength supervision. To further ensure consistent outputs under different control strengths, we introduce a misalignment-aware weighted flow matching loss that preserves image structure across continuous enhancement strengths. ControlLight allows users to edit real-world degraded low-light images toward satisfactory enhancement results by flexibly controlling the strength while preserving visual consistency and realism. Extensive experiments show that ControlLight achieves state-of-the-art performance against existing low-light enhancement approaches while demonstrating strong continuous controllability and generalization to real-world scenarios.
Oct 22, 2026

GLOW-FM: Efficient Generative Low-Light Image Enhancement with One-Step Latent Flow Matching

Low-light image enhancement (LLIE) aims to recover well-exposed and perceptually faithful images from severely degraded observations. Recent diffusion-based generative methods achieve strong perceptual quality by leveraging powerful image priors, but their iterative sampling incurs substantial computational cost, limiting practical deployment. Despite recent efficiency gains in generative LLIE, high-quality enhancement with a single function evaluation and low overall computation remains challenging, particularly under diverse real-world low-light conditions. We introduce GLOW-FM, a one-step latent flow-matching framework for efficient generative LLIE. GLOW-FM performs conditional transport in the latent space of a frozen Tiny-VAE and leverages Terminal Velocity Matching (TVM) to enable enhancement with a single function evaluation. Matched comparisons with alternative one-step objectives support TVM as an effective design choice, and, to the best of our knowledge, this is its first adaptation to image restoration and specifically to LLIE. Extensive experiments on challenging real-world benchmarks demonstrate that GLOW-FM achieves competitive image quality and state-of-the-art cross-dataset generalization while requiring only a single function evaluation and 34 GFLOPs for the small variant. These findings highlight the potential of GLOW-FM to bring generative LLIE closer to practical deployment through single-step inference and compact latent modeling. Code will be made publicly available upon publication.