LoopLUT: 3D Lookup Tables with Progressive Region Refinement for Real-Time 4K Image Enhancement
Organizations: Universiti Sains Malaysia · National University of Defense Technology · Sun Yat-sen University · Shandong Normal University · Shandong University of Finance and Economics
Abstract
Color enhancement of 4K images must meet a quality target under a tight compute budget. Three-dimensional lookup tables (3D LUTs) dominate real-time enhancement because they decide at low resolution and apply a per-pixel lookup at full resolution. A single global LUT, however, is spatially invariant, so an underexposed shadow and a well-exposed region that share a pixel value receive identical corrections. Spatially heterogeneous demands cannot be expressed by such a mapping. We propose LoopLUT, a region-cascaded 3D LUT with progressive refinement. A global LUT performs the overall correction, followed by K-1 loop iterations. In each iteration a gating head predicts at low resolution the region that still needs correction, then builds a residual LUT from the color statistics of that region alone. The cascaded gates form a partition of unity, so the output is a per-pixel convex combination of the K lookup results. Fusion is therefore performed by the gates themselves, with no separate fusion module and no interpolation error accumulating across rounds. The decision stage runs at a fixed 256x256 resolution, independent of output resolution, so a 4K image costs only K pure lookups. Extensive experiments across four benchmarks show that LoopLUT improves PSNR by up to 2.81 dB over the strongest prior method, while keeping real-time throughput at 4K. The same decomposition also generalizes well to underwater enhancement datasets.
Figures & tables
| LCDP | MIT-Adobe FiveK | Mobile-Spec | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Method | Venue | PSNR | SSIM | LPIPS | CIEDE | PSNR | SSIM | LPIPS | CIEDE | PSNR | SSIM | LPIPS | CIEDE |
| HDRNet | SIGGRAPH’17 | 21.75 | 0.8265 | 0.1860 | 10.98 | 20.57 | 0.7251 | 0.0960 | 9.10 | 20.34 | 0.7911 | 0.1652 | 6.57 |
| RUAS | CVPR’21 | 18.25 | 0.7568 | 0.2065 | 9.11 | 19.29 | 0.7095 | 0.1393 | 9.86 | 12.22 | 0.7470 | 0.1833 | 17.26 |
| LCDPNet | ECCV’22 | 23.29 | 0.8423 | 0.1587 | 8.43 | 15.13 | 0.6029 | 0.2437 | 17.17 | 25.25 | 0.9097 | 0.1404 | 5.21 |
| AdaInt | CVPR’22 | 20.93 | 0.7856 | 0.2258 | 9.42 | 18.76 | 0.7235 | 0.1474 | 12.21 | 26.98 | 0.9264 | 0.0850 | 4.02 |
| LightenDiffusion | ECCV’24 | 19.04 | 0.7743 | 0.1334 | 9.33 | 18.35 | 0.7050 | 0.1542 | 12.35 | 23.23 | 0.8383 | 0.2759 | 7.31 |
| Resolution | Pixels | GFLOPs | Latency | Device memory | ||||||
| (MP) | Decide | Exec | Total | Decide | Total | Through- | Peak | Traffic | Band- | |
| (ms) | (ms) | put (FPS) | (MB) | (MB) | width (GB/s) | |||||
| (LCDP native) | 1.75 | 6.135 | 0.362 | 6.497 | 1.84 | 5.10 | 196 | 93 | 774 | 159 |
| (FHD) | 2.07 | 6.135 | 0.429 | 6.564 | 1.84 | 5.67 | 176 | 104 | 880 | 163 |
| (4K) | 8.29 | 6.135 | 1.717 | 7.852 | 1.84 | 16.23 | 62 | 296 | 2914 | 188 |
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Method | Venue | PSNR | SSIM | LPIPS | CIEDE |
|---|---|---|---|---|---|
| HDRNet | SIGGRAPH’17 | 20.89 | 0.7809 | 0.1491 | 8.88 |
| RUAS | CVPR’21 | 16.59 | 0.7378 | 0.1764 | 12.08 |
| LCDPNet | ECCV’22 | 21.22 | 0.7850 | 0.1809 | 10.27 |
| AdaInt | CVPR’22 | 22.22 | 0.8118 | 0.1527 | 8.55 |
| LightenDiffusion | ECCV’24 | 20.21 | 0.7725 | 0.1878 | 9.66 |
| CSEC | CVPR’24 | 20.12 | 0.7748 | 0.1962 | 11.62 |