We present LoR-LUT, a unified low-rank formulation for compact and interpretable 3D lookup table (LUT) generation. Unlike conventional 3D-LUT-based techniques that rely on fusion of basis LUTs, which are usually dense tensors, our unified approach extends the current framework by jointly using residual corrections, which are in fact low-rank tensors, together with a set of basis LUTs. The approach described here improves the existing perceptual quality of an image, which is primarily due to the technique's novel use of residual corrections. At the same time, we achieve the same level of trilinear interpolation complexity, using a significantly smaller number of network, residual corrections, and LUT parameters. The experimental results obtained from LoR-LUT, which is trained on the MIT-Adobe FiveK dataset, reproduce expert-level retouching characteristics with high perceptual fidelity and a sub-megabyte model size. Furthermore, we introduce an interactive visualization tool, termed LoR-LUT Viewer, which transforms an input image into the LUT-adjusted output image, via a number of slidebars that control different parameters. The tool provides an effective way to enhance interpretability and user confidence in the visual results. Overall, our proposed formulation offers a compact, interpretable, and efficient direction for future LUT-based image enhancement and style transfer.
Figures & tables
Figure 1: Comparison between conventional adaptive 3D-LUTs and our LoR-LUT. (a) conventional adaptive 3D-LUTs rely on fusing several dense basis LUTs. (b) LoR-LUT replaces dense fusion with a compact low-rank residual, achieving similar flexibility with fewer parameters and identical interpolation complexity.
Figure 2: Trilinear interpolation in a 3D LUT. Each input color (r,g,b) lies within a cube defined by eight lattice vertices L[xi,yj,zk] . The output color y is a weighted sum of eight vertices of the cube, where wijk is a trilinear interpolation weight that decreases with distance from (r,g,b) along each axis.
Figure 3: Low-rank residual representation. Each rank-1 component factorizes the correction tensor into three axis-specific vectors and a color coefficient. Summing R such components yields a compact yet expressive residual tensor ΔL .
Figure 4: Overall architecture of LoR-LUT. Two lightweight networks predict the fusion weights and low-rank residual factors from the input image. The reconstructed LUT is then applied using the standard trilinear interpolation operator. The entire pipeline is differentiable and end-to-end trainable.
Module
Configuration
Output
Weight predictor
Conv( 3→16 ), Conv( 16→32 ), AvgPool, FC( 32→K )
α∈RK
Residual predictor
Conv( 3→16 ), Conv( 16→32 ), AvgPool, FC ×4
R×(3G+3)
Basis LUTs (if K>0 )
K learnable tensors of size G3×3
K×3G3
Table 1: Network architecture details. Layers used in the weight and residual predictors of LoR-LUT, together with the learnable basis LUTs when K>0 . Here G is the LUT grid size and R is the low-rank decomposition rank.
Figure 5: Visualization of low-rank residual correction in LoR-LUT. (a) Base LUT (identity, K=0 ); (b) residual output; and (c) combined base+residual result. The bottom row shows the corresponding 3D LUT cubes. The low-rank residual introduces subtle yet structured color shifts.
Method
Params
Interp.
IA-3D-LUT [ 15 ]
0.59M
Trilinear
AdaInt [ 12 ]
0.61M
Adaptive
SA-3D-LUT [ 11 ]
4.5M
Trilinear
LoR-LUT (ours)
37K
Trilinear
Table 2: Model size comparison. Number of learnable parameters for representative image-adaptive 3D-LUT methods. All methods use a LUT grid size of G=33 .
Method
PSNR ↑
SSIM ↑
LPIPS ↓
HDRNet [ 4 ]
22.15
0.840
0.182
DPE [ 2 ]
23.75
0.908
0.094
IA-3D-LUT [ 15 ]
22.27
0.837
0.183
AdaInt [ 12 ]
25.13
0.921
-
SepLUT [ 13 ]
25.32
0.918
-
LoR-LUT
Table 3: Quantitative comparison on MIT-Adobe FiveK (Expert C). LoR-LUT achieves the best perceptual quality
Figure 6: Qualitative comparison on MIT-Adobe FiveK (Expert C). From left to right: input image, HDRNet [ 4 ] , CSRNet [ 5 ] , CLUT [ 16 ] , IA-3DLUT [ 15 ] , our residual-only variant (LoR-LUT, K=0 ), our full model (LoR-LUT), and the expert ground truth (GT). Compared to prior LUT-based and CNN-based baselines, LoR-LUT produces more natural color tones, smoother local contrast, and better overall perceptual fidelity, closely matching the expert edit.
R
PSNR ↑
SSIM ↑
LPIPS ↓
ΔE00↓
Params
4
25.13
0.895
0.081
6.16
0.024M
8
25.35
0.901
0.079
5.85
0.037M
32
25.53
0.901
0.083
5.75
0.118M
Table 4: Effect of the low-rank R for the residual-only LoR-LUT ( K=0 ).
Method
Params
Model size
4K latency (T4)
LoR-LUT
(K=0,R=32)
0.12M
0.45MB
68.3ms
LoR-LUT
(K=8, R=32)
0.98M
3.74MB
69.0ms
LoR-LUT
(K=8, R=0)
0.87M
3.33MB
68.1ms
Table 5: Runtime and parameter analysis of LoR-LUT variants on 4K inputs (3840 × 2160). Latency is averaged over 100 runs on NVIDIA T4 and L4 GPUs. All models use grid size G=33 .
Figure 7: LoR-LUT Viewer for exploring low-rank residuals. The web-based tool takes an input image, displays the enhanced output and the corresponding 3D LUT cube, and exposes sliders for the magnitude of each rank-1 component.
Figure 8: Low-rank residual factors on an example image. Top: for each rank-1 component, we plot its three 1D factor curves along the R, G, and B axes of the LUT grid, revealing separable tonal trends such as highlight boosts or shadow roll-off. Bottom: the corresponding RGB coefficients indicate how strongly each component acts on each color channel. Together, these factors make individual components interpretable as ”color brushes” in the 3D LUT cube.
Color enhancement of 4K images must meet a quality target under a tight compute budget. Three-dimensional lookup tables (3D LUTs) dominate real-time enhancement because they decide at low resolution and apply a per-pixel lookup at full resolution. A single global LUT, however, is spatially invariant, so an underexposed shadow and a well-exposed region that share a pixel value receive identical corrections. Spatially heterogeneous demands cannot be expressed by such a mapping. We propose LoopLUT, a region-cascaded 3D LUT with progressive refinement. A global LUT performs the overall correction, followed by K-1 loop iterations. In each iteration a gating head predicts at low resolution the region that still needs correction, then builds a residual LUT from the color statistics of that region alone. The cascaded gates form a partition of unity, so the output is a per-pixel convex combination of the K lookup results. Fusion is therefore performed by the gates themselves, with no separate fusion module and no interpolation error accumulating across rounds. The decision stage runs at a fixed 256x256 resolution, independent of output resolution, so a 4K image costs only K pure lookups. Extensive experiments across four benchmarks show that LoopLUT improves PSNR by up to 2.81 dB over the strongest prior method, while keeping real-time throughput at 4K. The same decomposition also generalizes well to underwater enhancement datasets.
Yang Ye, Jiajun Ma, Chen Wu +5
Universiti Sains Malaysia · National University of Defense Technology · Sun Yat-sen University +2
Look-Up Table based methods have emerged as a promising direction for efficient image restoration tasks. Recent LUT-based methods focus on improving their performance by expanding the receptive field. However, they inevitably introduce extra computational and storage overhead, which hinders their deployment in edge devices. To address this issue, we propose ShiftLUT, a novel framework that attains the largest receptive field among all LUT-based methods while maintaining high efficiency. Our key insight lies in three complementary components. First, Learnable Spatial Shift module (LSS) is introduced to expand the receptive field by applying learnable, channel-wise spatial offsets on feature maps. Second, we propose an asymmetric dual-branch architecture that allocates more computation to the information-dense branch, substantially reducing inference latency without compromising restoration quality. Finally, we incorporate a feature-level LUT compression strategy called Error-bounded Adaptive Sampling (EAS) to minimize the storage overhead. Compared to the previous state-of-the-art method TinyLUT, ShiftLUT achieves a 3.8× larger receptive field and improves an average PSNR by over 0.21 dB across multiple standard benchmarks, while maintaining a small storage size and inference time. The code is available at: https://github.com/Sailor-t/ShiftLUT .
Lookup table (LUT) methods demonstrate considerable potential in accelerating image super-resolution inference. However, pursuing higher image quality through larger receptive fields and bit-depth triggers exponential growth in the LUT's index space, creating a storage bottleneck that limits deployment on resource-constrained devices. We introduce IQ-LUT, which achieves a reduction in LUT size while simultaneously enhancing super-resolution quality. First, we integrate interpolation and quantization into the single-input, multiple-output ECNN, which dramatically reduces the index space and thereby the overall LUT size. Second, the integration of residual learning mitigates the dependence on LUT bit-depth, which facilitates training stability and prioritizes the reconstruction of fine-grained details for superior visual quality. Finally, guided by knowledge distillation, our non-uniform quantization process optimizes the quantization levels, thereby reducing storage while also compensating for quantization loss. Extensive benchmarking demonstrates our approach substantially reduces storage costs (by up to 50x compared to ECNN) while achieving superior super-resolution quality.
Yuxuan Zhang, Zhikai Dong, Xinning Chai +4
Shanghai Jiao Tong University · Rockchip Electronics Co., Ltd