Organizations: School of Electronic Information, Wuhan University, Wuhan 430072, China · School of Artificial Intelligence, Wuhan University, Wuhan 430072, China
By combining complementary benefits of short- and long-exposure images, Dual-Exposure Imaging (DEI) enhances image quality in low-light scenarios. However, existing DEI approaches inevitably suffer from producing artifacts due to spatial displacement from scene motion and image feature discrepancies from different exposure times. To tackle this problem, we propose a novel Event-based DEI (E-DEI) algorithm, which reconstructs high-quality images from dual-exposure image pairs and events, leveraging high temporal resolution of event cameras to provide accurate inter-/intra-frame dynamic information. Specifically, we decompose this complex task into an integration of two sub-tasks, i.e., event-based motion deblurring and low-light image enhancement tasks, which guides us to design E-DEI network as a dual-path parallel feature propagation architecture. We propose a Dual-path Feature Alignment and Fusion (DFAF) module to effectively align and fuse features extracted from dual-exposure images with assistance of events. Furthermore, we build a real-world Dataset containing Paired low-/normal-light Images and Events (PIED). Experiments on multiple datasets show the superiority of our method. The code and dataset are available at github.
Figures & tables
Fig. 1: (a) Illustration of the proposed Event-based Dual-Exposure Imaging (E-DEI) strategy. (b-c) The short- and long-exposure image pairs are continuously captured under the dynamic scenes. The corresponding image reconstruction results via (d) the state-of-the-art Frame-based DEI (F-DEI) method and (e) our E-DEI. Due to the missing inter/intra-frame motion information, F-DEI suffers from texture blur and artifacts, while E-DEI can successfully generate the high-quality visual images.
Fig. 2: Comparison between (a) existing Frame-based Dual-Exposure Imaging (F-DEI) and (b) our Event-based Dual-Exposure Imaging (E-DEI). The key idea of our E-DEI is to introduce the high temporal resolution event data to complement the missing intra- and inter-frame motion information. As a result, our algorithm produces sharp and clear images without artifacts.
Fig. 3: (a) The overall architecture of the proposed network of Event-based Dual-Exposure Imaging (E-DEI), which is a dual-path feature propagation and supervision framework. (b) The proposed Dual-path Feature Alignment and Fusion (DFAF) module, where features of the Deblurring path are spatially aligned to the short-exposure target time with features of the Enhancement path as the temporal reference, and then we integrate features of the two paths for the high-quality reconstruction.
Fig. 4: Details of the proposed Cross-Guided Fusion (CGF) module, which is designed to fuse the results and features of the Deblurring and Enhancement paths for the final result.
Fig. 5: (a) The illustration of a beam splitter-based hybrid camera system for building the PIED dataset. (b) PIED contains the normal- and low-light image pairs (upper row) and the corresponding events (bottom row) with three diverse motion patterns.
Dataset
Image
Resolution
FPS
Motion pattern
LL
NL
SDE [ 21 ]
✓
✓
346 × 260
< 30
Camera motion
EVFI-LL [ 20 ]
✓
✗
784 × 611
64
Moving object
RLED [ 19 ]
✗
✓
1120 × 660
10,25
Camera+Object
Ours
✓
✓
1280 × 720
72
Camera+Object
TABLE I: Comparisons of our dataset with the existing event-based low-light datasets. LL/NL means low-/normal-light images
Fig. 6: Statistical properties of the E-DEI dataset. Distributions of (a) Motion magnitude, (b) Illumination, (c) Texture richness, and (d) Event firing rate.
Method
Event
REDS-LL
PIED
PSNR ↑
SSIM ↑
PSNR ↑
SSIM ↑
Low-light image enhancement
Uretinex-Net [ 23 ]
✗
25.621
0.9020
25.829
0.8613
EMNet [ 70 ]
✗
30.317
0.9253
26.776
0.8982
EvLowLight [ 18 ]
✓
25.519
0.9217
26.808
0.8666
EvLight [ 21 ]
✓
31.211
0.9375
28.203
0.9102
Motion deblurring
MSSNet [ 58 ]
✗
30.181
0.8883
28.890
0.8538
TABLE II: Quantitative comparisons of the proposed E-DEI to the state-of-the-art methods on the REDS-LL and PIED datasets. The best performance is highlighted in bold and second best is underlined .
Fig. 7: Qualitative comparisons with state-of-the-art methods on the REDS-LL (upper low) and PIED (lower row) datasets. For a better view, details are zoomed in and the brightness of short-exposure images is rescaled.
Ex.
Event
PSNR ↑
SSIM ↑
Deblurring
Enhancement
1
✗
✗
34.522
0.9471
2
✓
✗
37.756
0.9684
3
✗
✓
36.281
0.9601
4
✓
✓
37.895
0.9695
TABLE III: Ablation study on the feeding strategies of the event streams.
Architecture
L^s
L^
PSNR ↑
SSIM ↑
PSNR ↑
SSIM ↑
Serial pipeline
35.984
0.9581
36.702
0.9658
Parallel design (Ours)
37.895
0.9695
37.904
0.9695
TABLE IV: Quantitative comparisons of the proposed E-DEI, which is a parallel architecture, to the serial pipeline design.
Ex.
Backbone
DFAF module
PSNR ↑
SSIM ↑
Enc.
Dec.
DA
CAF
1
SP
SP
✗
✗
37.376
0.9657
2
DP
SP
✓
✓
37.637
0.9673
3
DP
DP
✗
✗
36.199
0.9591
4
DP
DP
✓
✗
35.876
0.9645
5
DP
DP
✗
✓
37.624
0.9674
TABLE V: Ablation study of the dual-path backbone and modules of our network on the REDS-LL dataset. Enc. and Dec. indicate the architecture of the encoder and decoder. DP and SP mean the dual- and single-path backbone.
Fig. 8: Qualitative ablations of the backbone and modules of our network and their absolute differences to the ground-truth clear image. Enc. and Dec. indicate the architecture of the encoder and decoder.
Fig. 9: Visualization of intermediate features from the DFAF module of our E-DEI. (a) and (d) the input dual-exposure image pairs. (b-c) Fl and Fl′ are the features before and after the DA block in the Delurring path. (e-f) Fs and Fs′ are the features before and after the CAF block in the Enhancement path.
Fig. 10: Evaluation of our E-DEI supervised by Eq. 20 with the different values of the balancing parameter λ3 in the first stage training.
Fig. 11: (a) Sensitivity analysis of the E-DEI network to the temporal misalignment between cross-modal image pairs and event streams. (b) Generalization of the E-DEI network to the unseen exposure-time ratios.
Method
Event
Param
Runtime
FLOPs
(M) ↓
( ms ) ↓
(G) ↓
Uretinex-Net [ 23 ]
✗
0.34
123.7
1601.25
EMNet [ 70 ]
✗
12.52
774.4
1036.33
EvLowLight [ 18 ]
✓
15.03
766.9
4091.00
EvLight [ 21 ]
✓
22.73
674.6
2731.53
MSSNet [ 58 ]
✗
15.59
5.4
2040.46
TABLE VI: Quantitative comparisons of the network parameter and inference efficiency on the REDS-LL datasets. The items of runtime and FLOPs are evaluated with the input images and events at the resolution of 1280×720 .
Fig. 12: Failure cases under non-ideal scenes, e.g. , extremely dim environment (upper), blocked and discarded events (middle), and coupled degradations (lower).
Event-based low-light image enhancement (LIE) methods mainly focus on incorporating high dynamic range (HDR) information from events while overlooking the essential global illumination in images and the inherent noise sensitivity of event signals in real-world scenarios. To address these issues, we propose EIC-LIE, an event-illumination collaborative LIE framework. Concretely, we first design an Event-Illumination Collaborative Interaction (EICI) module, which contains two key processes: forward gathering, which gathers HDR features across varying lighting conditions, and backward injection, which provides complementary content for illumination and event representations. Next, we introduce an Illumination-aware Event Filter (IAEF) that dynamically reduces event noise based on brightness statistics derived from images. Additionally, we build a beam-splitter-based hybrid imaging system to collect high-quality event-image pairs with temporal synchronization from dynamic scenes, providing the first high-resolution, real-world event-based LIE dataset. Extensive experiments show that our EIC-LIE outperforms state-of-the-art methods on five real-world and synthetic datasets, significantly surpassing previous methods with improvements of up to 1.24dB in PSNR and 0.069 in SSIM. The code and dataset are released at https://github.com/QUEAHREN/EIC-LIE.
High-quality imaging of dynamic scenes in extremely low-light conditions is highly challenging. Photon scarcity induces severe noise and texture loss, causing significant image degradation. Event cameras, featuring a high dynamic range (120 dB) and high sensitivity to motion, serve as powerful complements to conventional cameras by offering crucial cues for preserving subtle textures. However, most existing approaches emphasize texture recovery from events, while paying little attention to image noise or the intrinsic noise of events themselves, which ultimately hinders accurate pixel reconstruction under photon-starved conditions. In this work, we propose NEC-Diff, a novel diffusion-based event-RAW hybrid imaging framework that extracts reliable information from heavily noisy signals to reconstruct fine scene structures. The framework is driven by two key insights: (1) combining the linear light-response property of RAW images with the brightness-change nature of events to establish a physics-driven constraint for robust dual-modal denoising; and (2) dynamically estimating the SNR of both modalities based on denoising results to guide adaptive feature fusion, thereby injecting reliable cues into the diffusion process for high-fidelity visual reconstruction. Furthermore, we construct the REAL (Raw and Event Acquired in Low-light) dataset which provides 47,800 pixel-aligned low-light RAW images, events, and high-quality references under 0.001-0.8 lux illumination. Extensive experiments demonstrate the superiority of NEC-Diff under extreme darkness. The project are available at: https://github.com/jinghan-xu/NEC-Diff.
Haoyue Liu, Jinghan Xu, Luxin Feng +4
National Key Lab of Multispectral Information Intelligent Processing Technology School of Artificial Intelligence and Automation, Huazhong University of Science and Technology · School of Computing, National University of Singapore
Event cameras, with their high dynamic range, show great promise for Low-light Image Enhancement (LLIE). Existing works primarily focus on designing effective modal fusion strategies. However, a key challenge is the dual degradation from intrinsic background activity (BA) noise in events and low signal-to-noise ratio (SNR) in images, which causes severe noise coupling during modal fusion, creating a critical performance bottleneck. We therefore posit that precise event denoising is the prerequisite to unlocking the full potential of event-based fusion. To this end, we propose BiEvLight, a hierarchical and task-aware framework that collaboratively optimizes enhancement and denoising by exploiting their intrinsic interdependence. Specifically, BiEvLight exploits the strong gradient correlation between images and events to build a gradient-guided event denoising prior that alleviates insufficient denoising in heavily noisy regions. Moreover, instead of treating event denoising as a static pre-processing stage-which inevitably incurs a trade-off between over- and under-denoising and cannot adapt to the requirements of a specific enhancement objective-we recast it as a bilevel optimization problem constrained by the enhancement task. Through cross-task interaction, the upper-level denoising problem learns event representations tailored to the lower-level enhancement objective, thereby substantially improving overall enhancement quality. Extensive experiments on the Real-world noise Dataset SDE demonstrate that our method significantly outperforms state-of-the-art (SOTA) approaches, with average improvements of 1.30dB in PSNR, 2.03dB in PSNR* and 0.047 in SSIM, respectively. The code will be publicly available at https://github.com/iijjlk/BiEvlight.
Zishu Yao, Xiang-Xiang Su, Shengning Zhou +3
College of Computer and Data Science, Fuzhou University, Fuzhou 350108, China · College of Computer Science and Technology, Shandong Technology and Business University, Yantai 264003, China