LC-ISP Benchmark: Learning Advanced ISP with Live and Capture Streams
Organizations: University of Electronic Science and Technology of China
Abstract
High-quality paired RAW-to-sRGB datasets are essential for data-driven ISP, yet existing datasets often rely on cross-device collection, causing misalignment and failing to faithfully reflect real capture conditions. We therefore introduce LC-ISP, a large-scale benchmark built from the intrinsic gap between a camera's live preview and offline capture streams. LC-ISP contains 53.9k spatially aligned groups, each comprising live RAW/live sRGB and multi-frame fused RGB/capture sRGB, and covers day, night, indoor, outdoor, and HDR scenes. It also provides capture-stream intermediates for modular supervision. We further develop a compact two-stage baseline that uses these intermediates as auxiliary targets. Under a 2.5-GFLOP budget for 448448 RAW inputs, it outperforms the strongest single-frame baseline by over 2 dB PSNR while improving texture, denoising, and color reproduction. LC-ISP supports realistic benchmarking, the design of supervision strategies, and the development of lightweight ISP models.
Figures & tables
| Dataset | Images | Illumination | HDR Scenes | Aligned Pairs | Environment | Patch Size | Bit Depth |
|---|---|---|---|---|---|---|---|
| ZRR [ 18 ] | 48,043 | Day | ✗ | ✗ | Outdoor | 448 448 | 10 |
| MAI [ 17 ] | 24,100 | Day | ✗ | ✗ | Outdoor | 224 224 | 12 |
| LC-ISP (Ours) | 53,892 | Day & Night | ✓ | ✓ | In/Outdoor | 448 448 | 12 |
| Category | Model | PSNR | SSIM | MS-SSIM | LPIPS | GFLOPs |
|---|---|---|---|---|---|---|
| Base | PyNet [ 18 ] | 23.28 | 0.7948 | 0.9091 | 0.2531 | 685.16 |
| AWNet [ 10 ] | 24.43 | 0.7970 | 0.9089 | 0.2561 | 131.96 | |
| MWISPNet [ 20 ] | 24.72 | 0.8020 | 0.9120 | 0.2495 | 176.80 | |
| LiteISPNet [ 47 ] | 24.73 | 0.8028 | 0.9122 | 0.2477 | 143.89 | |
| SYENet [ 13 ] | 20.00 | 0.7178 | 0.8561 | 0.3773 | 10.20 | |
| MobileIE [ 39 ] | 19.27 | 0.7111 | 0.8539 | 0.3937 | 4.96 |
| Method | PSNR | SSIM | MS-SSIM | LPIPS |
|---|---|---|---|---|
| MWISPNet | 21.37 | 0.7388 | 0.8745 | 0.3624 |
| Ours w/o | 22.78 | 0.7693 | 0.8894 | 0.2980 |
| Ours (Full) | 23.36 | 0.7748 | 0.8934 | 0.2850 |
| NAF+CSR w/o | 21.91 | 0.7556 | 0.8748 | 0.3121 |
| NAF+CSR | 22.56 | 0.7648 | 0.8869 | 0.3037 |
Computational Imaging
Computational imaging combines optical and sensor design with algorithms to recover or infer scene information from indirect, compressed, or noisy measurements.
See all 135 papers