Video generation has broad applications in content creation and entertainment. Diffusion transformers have advanced the quality of generated videos, but attention over spatiotemporal tokens becomes increasingly expensive as video resolution and duration increase. We present DraftAttention2, a training-free framework that uses the low-resolution draft attention map to jointly select attention blocks and assign their numerical precision. Specifically, spatial 2D average- and max-pooled queries and keys capture complementary regional statistics to estimate block importance, and a shared ranking assigns higher precision to important blocks, lower precision to less important retained blocks, and skips the rest under configurable budgets. Our analysis separates sparsification error from attention-weighted quantization error, establishing when recovering skipped interactions with low-bit computation tightens the output-error bound. This analysis motivates retaining more interactions at low precision while reserving higher precision for blocks with larger attention mass. To translate these fine-grained assignments into practical speedups, we further develop fused operand preparation and a single attention kernel with precision-specific phases, sharing data movement, softmax statistics, and output accumulation across precisions. Experiments demonstrate that our method achieves a superior quality-efficiency trade-off over existing efficient video generation methods. Notably, its advantage is particularly pronounced for few-step video diffusion, where jointly combining sparsity with 4- and 8-bit mixed-precision computation substantially improves generation quality while retaining significant acceleration. Code is available at https://github.com/anemoi-project/anemoi
Figures & tables
Figure 1: Attention cost and precision allocation. (a) DiT runtime breakdown. (b) Block allocation and relative L2 output error at similar latency.
Figure 2: Overview of DraftAttention2. Average- and max-pooled queries and keys produce draft attention maps, whose weighted mixture guides block selection and precision allocation.
Figure 3: Compact spatial packing and fused operand preparation. (a) Compact spatial regions are packed into contiguous blocks. (b) Q/K reordering, pooling, and quantization share a kernel; V reordering and transposition are fused with operand packing and loading. Colors denote regions; gray cells denote padding.
Table 1: Video generation quality and DiT speedup. VBench Avg is reported as a percentage. Bit allocations give percentages of 0-, 4-, 8-, and 16-bit attention blocks, where 0-bit denotes sparse and 16-bit denotes dense.
Table 2: Video generation quality and DiT speedup for MiniMax-H3 with FL2VA Turbo LoRAs ( 1344×768 , 362 frames). Bit allocations follow the 0 / 4 / 8 / 16 order; 0-bit denotes sparse and 16-bit denotes dense.
Figure 4: Visual comparison on 8-step (top) and 4-step (bottom) diffusion with MiniMax-H3 FL2VA Turbo LoRAs. Red boxes highlight structural details.
Figure 7
Appendix figures & tables6 assets
Supplementary material from the paper’s appendix.
Appendix
Method
Bit (%) 0 / 4 / 8 / 16
VBench ↑
SC
BC
TF
MS
AQ
IQ
DD
OC
AVG
HunyuanVideo
Dense
0/0/0/100
93.87
96.60
98.97
99.11
61.54
67.87
72.22
26.28
77.06
XAttn
85.6/0/0/14.4
93.76
95.57
99.05
98.76
60.10
66.38
51.39
26.16
73.90
SVG2
83.6/0/0/16.4
93.38
96.88
99.57
99.37
50.30
51.24
9.72
25.15
65.70
Sol-Attn
85.8/0/0/14.2
93.62
96.49
98.95
99.05
61.52
67.55
70.83
26.50
76.81
Appendix
Table 4: Detailed VBench scores (%) for HunyuanVideo and MiniMax-H3. Configurations correspond to Table 1 .
Method
Bit (%) 0 / 4 / 8 / 16
VBench ↑
SC
BC
TF
MS
AQ
IQ
DD
OC
AVG
4-Step Diffusion
Dense
0/0/0/100
91.65
93.35
98.77
99.06
62.56
73.80
50.00
23.92
74.14
Sol-Attn
65/0/0/35
91.68
93.35
98.75
99.03
62.76
73.97
50.00
23.99
74.19
SVG2
64/0/0/36
91.48
93.37
98.71
98.89
62.50
72.95
48.61
23.86
73.80
SVG2
85.8/0/0/14.2
91.33
93.16
98.75
98.90
62.29
72.42
44.44
23.75
73.13
Appendix
Table 5: Detailed VBench scores (%) for few-step generation. Configurations correspond to Table 2 .
Path
Q,K
QK⊤ accumulator
P,V
PV accumulator
NVFP4
E2M1
FP32
E2M1
FP32
INT8
INT8
INT32
E4M3
FP16
FP16
FP16
FP32
FP16
FP16
Appendix
Table 6: Operand and accumulator formats in the mixed-precision kernel.
Figure 6: Visual comparison of rail junctions in 8-step MiniMax-H3 generation.
Figure 7: Visual comparison of a running cat in 4-step MiniMax-H3 generation.
Figure 8: Visual comparison of a cat in a park in 8-step MiniMax-H3 generation.
Video diffusion models generate or edit temporally coherent video by iteratively denoising latent sequences conditioned on text, images, motion, or other signals.