Progressive image compression reconstructs images from prefixes of a single bitstream and therefore involves sequential latent inference under partial observations. Existing trit-plane codecs mainly treat decoded trits as discrete symbols for probability prediction, without fully exploiting their role as interval constraints on the underlying continuous latents. We propose bound-conditioned latent inference (BLI), a framework that reformulates progressive trit-plane coding as sequential latent inference under shrinking interval constraints. At each coding step, the trits decoded so far define lower and upper bounds for each latent element. BLI uses the center and width of these bounds, together with hyperprior information shared by the encoder and decoder, to jointly refine the Gaussian parameters (μ,σ) for entropy modeling and the latent estimate y^ for reconstruction. As additional trits are decoded, the feasible intervals shrink monotonically, yielding tighter constraints for the next inference step and enabling flexible in-plane refinement schedules. Experiments on Kodak, CLIC, and JPEG-AI show that BLI achieves state-of-the-art rate-distortion performance among progressive image codecs, reducing BD-rate by 17.78% over DPICT and by 7.96% over CTC on Kodak, while replacing CTC's plane-specific predictors with a shared model that uses about 5.3× fewer parameters and achieves lower latency than CTC.
Figures & tables
Figure 1: Rate-allocation maps of the proposed bound-conditioned latent inference (BLI) codec. Each column corresponds to the same trit-plane level, i.e. , the same degree of latent quantization, while each row uses a different number of in-plane refinement steps. The top row encodes an entire trit-plane in a single step, whereas the middle and bottom rows divide each trit-plane into two and four substeps, respectively. Colors indicate spatial rate allocation, with warmer colors corresponding to higher coding rates and cooler colors to lower rates. More frequent bound-conditioned updates iteratively refine the latent distribution within the same quantization level, yielding better rate efficiency without changing the final trit-plane precision.
Figure 2: Overview of the BLI process. At coding step k , the trits decoded so far define bound tensors (Ck−1,Dk−1) , which represent the current feasible ranges of latent elements. Given these bounds and the hyperprior parameters (M0,Σ0) , BLI estimates the Gaussian parameters (Mk,Σk) for entropy coding and the latent tensor Y^k−1 for reconstruction under the current bounds. After a subset of trits is decoded using (Mk,Σk) , the bounds are updated to (Ck,Dk) , yielding tighter feasible ranges that, in turn, are used in the next coding step. This step-wise process iteratively refines the latent distribution and reconstruction.
Figure 3: Illustration of the BLI refinement process using a 1D sequence of latent elements. Given the current bounds (Ck−1,Dk−1) , BLI estimates (Mk,Σk) for entropy coding and Y^k−1 for reconstruction under those bounds. After selected trits are decoded, the bounds are updated to (Ck,Dk) , yielding tighter feasible intervals for the next BLI step. Red dots denote original latent values, blue dots denote latent estimates, and blue densities denote estimated Gaussian distributions.
Figure 4: Architecture of the BLI module. BLI predicts the Gaussian parameters (Mk,Σk) and the latent estimate Y^k−1 from the current bounds and hyperprior parameters.
Figure 5: R-D curves on Kodak against traditional, fixed-rate learned, and progressive learned codecs. The left plot reports PSNR, and the right plot reports MS-SSIM in dB.
Table 6
Figure 6: Qualitative comparison against representative traditional and progressive codecs.
Figure 7: Qualitative comparison with existing trit-plane codecs at trit-plane endpoints. Within each column, the same number of trits is transmitted for all three codecs. The numbers below each result indicate bpp and PSNR.
Figure 8: Step-wise updates to predicted Gaussian distributions for two latent elements during evaluation. We compare BLI with method I, the ablation variant without the bound-width input and interval-rescaled output constraint. Colors transition from blue to red as decoding proceeds.
Figure 10Table 11
Appendix figures & tables18 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 10: R-D curve comparison of the proposed BLI codec with existing progressive and fixed-rate image codecs. From top to bottom, the rows correspond to Kodak, CLIC 2021, and JPEG-AI. Best viewed digitally with zooming.
PSNR
MS-SSIM
Kodak
CLIC
JPEG-AI
Kodak
CLIC
JPEG-AI
Traditional
JPEG2000 [ Skodras et al., 2001 ]
47.54
58.41
55.73
183.09
232.17
205.86
BPG444 [ Bellard, 2014 ]
−7.92
0.21
0.74
64.25
74.67
89.49
VTM 12.0 [ Bross et al., 2021 ]
−2.14
−2.17
−0.85
69.49
72.06
94.68
Fixed-rate
STF [ Zou et al., 2022 ]
−14.85
−12.87
−11.69
−12.64
−7.73
−5.57
LIC-TCM [ Liu et al., 2023 ]
−18.69
−19.37
−18.18
−13.84
−7.74
−6.53
Appendix
Table 6: BD-rates (%) with respect to FTIC-DPICT.
Ci0←Mi0,Di0←3ni.
Appendix
Algorithm 1 Encoding in BLI
Ci0←Mi0,Di0←3ni.
Appendix
Algorithm 2 Decoding in BLI
Method
FLOPs (T)
Neural inference (s)
Non-neural processing (s)
Total latency (s)
FTIC-DPICT
41.42
0.08
5.77
5.85
FTIC-CTC
66.69
0.18
6.44
6.62
BLI
65.96
3.72
1.05
4.77
Appendix
Table 7: Comparison of computational complexity on the Kodak dataset.
Trans. ordering
Full BD-rate (%)
Endpoint BD-rate (%)
Random
−10.01
−19.63
Raster scan
−7.62
−18.52
σ ascending
−2.47
−18.02
R-D prioritized
−17.78
−19.59
Appendix
Table 8: Effect of the within-plane transmission ordering on the Kodak dataset. BD-rates (%) are measured relative to FTIC-DPICT.
Test-time variant
Entropy params. for coding
Latent recon.
BD-rate (%)
Recon. with Gaussian mean
(Mk,Σk)
Gaussian mean
−16.38
No entropy refinement
(M0,Σ0)
Y^k−1
−10.24
Full BLI
(Mk,Σk)
Y^k−1
−17.78
Appendix
Table 9: Test-time ablation of entropy modeling and latent reconstruction on the Kodak dataset. BD-rates (%) are measured relative to FTIC-DPICT.
bpp
Metric
BPG444
VTM 12.0
FTIC-DPICT
FTIC-CTC
BLI
0.10
LPIPS
0.3848
0.3494
0.4008
0.3465
0.3203
DISTS
0.2038
0.1994
0.2308
0.2089
0.1910
0.15
LPIPS
0.3207
0.3064
0.3569
0.3123
0.2868
DISTS
0.1771
0.1800
0.2049
0.1884
0.1736
0.20
LPIPS
0.2760
0.2663
0.3045
0.2661
0.2366
DISTS
0.1586
0.1606
0.1780
0.1630
0.1510
Appendix
Table 10: Comparison of perceptual quality on the Kodak dataset at low bitrates. Lower LPIPS and DISTS values indicate better perceptual quality.
Figure 11: Progressively reconstructed images of ‘kodim04.png’ and ‘kodim18.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 12: Progressively reconstructed images of ‘kodim08.png’ and ‘kodim13.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 13: Progressively reconstructed images of ‘kodim21.png’ and ‘kodim22.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 14: Progressively reconstructed images of ‘andrew-ruiz-376.png’ and ‘clem-onojeghuo-33741.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 15: Progressively reconstructed images of ‘daniel-robert-405.png’ and ‘mullermarc-184.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 16: Progressively reconstructed images of ‘thong-vo-428.png’ and ‘vita-vilcina-3055.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 17: Progressively reconstructed images of ‘00002_TE_2144x1424.png’ and ‘00003_TE_1944x1296.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 18: Progressively reconstructed images of ‘00005_TE_1336x872.png’ and ‘00009_TE_1976x1312.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 19: Progressively reconstructed images of ‘00010_TE_2000x1128.png’ and ‘00011_TE_1744x1160.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Figure 20: Progressively reconstructed images of ‘img_1280x720_3x8bit_RGB_color_SMPTE_RP_219_2002.png’ and ‘img_1280x720_3x8bit_RGB_color_rainbow_gradient.png’ obtained by the PSNR-trained model. The bitrate (bpp), PSNR (dB), and MS-SSIM (dB) are reported below each image.
Department of Electronic Engineering, Tsinghua University · Department of Automation, Tsinghua University · State Key Laboratory of Space Network and Communications +1