Can a distilled image generator save time by reusing features between its few remaining denoising steps? We study a fixed branch cache that replaces selected attention and MLP evaluations while preserving the student's noise schedule. One full trajectory and one raw-cache trajectory from the same initial noise supply a scalar correction for each branch type and reuse position. At 10242, one internal reuse reduces four-step Qwen-Image-Lightning denoising time from 1.279 to 0.977 seconds. Three reuses yield 1.51× speedup on eight-step Lightning and 1.53× on eight-step Hyper-FLUX. We evaluate image quality on all 200 DrawBench prompts. With the reuse positions held fixed, correction improves mean same-seed image fidelity over raw reuse by 0.66 and 0.87 dB on the two Lightning students. On Hyper-FLUX the PSNR difference is 0.01 dB, while LPIPS improves from 0.1625 to 0.1546. These results measure the effect of branch caching and correction while retaining each student's original sampling grid.
Figures & tables
Student
Denoising (s)
Denoising speedup
Image-ready speedup
ImageReward
CLIP
Lightning-4
1.279 / 0.977
1.309×
1.259×
1.2917 / 1.2980
32.5605 / 32.5591
Lightning-8
2.527 / 1.671
1.513×
1.461×
1.2747 / 1.2922
32.7055 / 32.6572
Hyper-FLUX-8
2.785 / 1.822
1.529×
1.475×
1.0250 / 1.0331
31.5979 / 31.5808
Table 1: Additional speedup over the same uncached student at the same step count. Paired cells show uncached / calibrated means, with the better displayed value in bold. Latency is the mean denoising time measured on NVIDIA H800 GPUs. Speedups use paired H800 measurements. ImageReward and CLIP use all 200 DrawBench prompts.
Figure 1: Branch calibration and reuse. Reproduced from our CalibCache manuscript. The top panel pairs full and raw-cache trajectories from the same initial noise. The lower panel applies the fitted gain to the current branch’s second difference. The diagram illustrates a reuse after an earlier cache step. In the four-step setting the correction runs once, at index 2, after two full evaluations. The eight-step schedule applies it at indices 2, 4 and 6.
Student
Method
Full
Sec. ↓
Speedup ↑
IR ↑
CLIP ↑
PSNR ↑
SSIM ↑
LPIPS ↓
Lightning-4
Native
4
1.284
1.00
1.292
32.56
∞
1.0000
0.0000
TeaCache
3.04
1.030
1.28
1.285
32.66
21.99
0.8290
0.0969
TaylorSeer
3.00
1.045
1.22
1.297
32.51
21.63
0.8418
0.0874
HiCache
3.00
1.034
1.21
1.296
32.52
21.74
0.8424
0.0865
CalibCache
3.00
0.980
1.31
1.298
32.56
22.27
0.8505
0.0783
Lightning-8
Native
8
2.494
1.00
1.275
32.71
∞
1.0000
0.0000
Table 2: Cache comparisons at the original scheduler steps. Quality metrics use DrawBench-200. Latency is the mean denoising time measured on NVIDIA H800 GPUs. Speedup is the ratio of mean times for each method and its own paired native run. Full counts full transformer evaluations per image. PSNR pools RGB squared errors against each same-seed native image before conversion to dB. Bold marks the best reported accelerated values at displayed precision. IR denotes ImageReward.
Student
Raw
Corrected
Difference [95% CI]
Lightning-4
23.30
23.97
+.66[+.59,+.74]
Lightning-8
20.68
21.55
+.87[+.74,+1.01]
Hyper-FLUX-8
22.62
22.63
+.01[−.04,+.07]
Table 3: Paired fidelity relative to each uncached student. Both methods reuse the same branches at the same steps. Each image contributes one dB value, whereas Table 2 pools squared errors. Intervals are paired prompt-bootstrap intervals for corrected minus raw.
Figure 2: “One dog on the street.” DrawBench index 40, seed 314199, from the fixed preview indices. Rows are Lightning-4, Lightning-8 and Hyper-FLUX-8. The broad composition survives in each row. In H8, raw reuse smooths the foreground paving visible in the native image. Images are downsampled for display.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Task
Four steps
Eight steps
Object
66.25 / 61.25
65.00 / 56.25
Animal
28.07 / 45.61
24.56 / 21.05
Person
23.29 / 28.77
27.40 / 30.14
Location
48.00 / 52.00
52.00 / 48.00
Background
85.71 / 85.71
85.71 / 100.00
Lighting
100.00 / 100.00
100.00 / 100.00
Appendix
Table 4: Designated-task accuracy (%) on the Mini subset. Columns give native / calibrated Lightning. Each prompt is scored only for its designated task. Macro averages give equal weight to the eight task percentages.
Lightning-4
Lightning-8
Method
Acc.
SSIM
LPIPS
Acc.
SSIM
LPIPS
Native
60.41
1.0000
0.0000
60.83
1.0000
0.0000
TeaCache
62.05
0.8455
0.1093
62.66
0.8178
0.1584
TaylorSeer
62.50
0.8555
0.1030
61.82
0.8221
0.1508
HiCache
63.52
0.8568
0.1011
61.21
0.8167
0.1537
CalibCache
63.50
0.8731
0.0921
61.27
0.8363
0.1379
Appendix
Table 5: DetailMaster Mini subset. Equal-weight mean designated-task accuracy (%) on the identical 50 prompts using the default evaluator. Acc. averages the eight task scores equally. SSIM and LPIPS average over images against the matching native output. Bold compares accelerated methods.
Figure 3: DetailMaster Mini subset image 032, eight-step Lightning. The prompt describes colored lights in a tree with specified positions and attributes. This example was selected to illustrate the detector-threshold case in the text.
Diffusion model caching reuses features, activations, or attention states across denoising steps to reduce inference cost while preserving output quality.
School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China · Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai 519087, China