Blurring the Block Boundaries: Overlapping Block Denoising for Efficient Diffusion Language Models
Organizations: Technion – Israel Institute of Technology · Amazon Web Services
Abstract
Diffusion Language Models (DLMs) have emerged as effective alternatives to autoregressive models for latency-critical tasks, enabling faster token generation. Recent advances employ block diffusion with self-editing capabilities, where each block refines tokens iteratively before advancing to the next one. Yet each block is only as fast as its slowest token, and the next block cannot start before it. We suggest Blurring the Block Boundaries (B3), a novel method with which two blocks are refined in parallel within a shared forward pass. B3 calibrates itself on the fly, opening the next block only once the model is ready to start generating it. It is a training-free and hyperparameter-free acceleration method which seamlessly integrates within any self-editing block diffusion model. Evaluated on state-of-the-art DLMs across 10 diverse datasets spanning varied tasks and difficulty levels, B3 results in on par generation quality and 11.5-14.5% speedup compared to the base model, pushing the Pareto frontier for latency-quality trade-offs in DLM inference.
Figures & tables
| TPS | TPF | Quality | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| Model | Benchmark | Base | B3 (ours) | Base | B3 (ours) | Base | B3 (ours) | ||||
| DiffusionGemma 26B | GSM8K | 1319 | 136.1 | 150.8 | +10.8 | 28.74 | 33.69 | +17.2 | 95.75 | 96.13 | +0.38 |
| MATH500 | 500 | 139.9 | 156.0 | +11.6 | 28.69 | 34.16 | +19.1 | 95.80 | 92.40 | -3.40 | |
| AIME26 | 30 | 101.0 | 121.6 | +20.3 | 20.61 | 25.48 | +23.6 | 73.33 | 76.67 | +3.33 | |
| Omni-MATH | 4428 | 107.6 | 118.0 | +9.6 | 21.70 | 25.10 | +15.7 | 61.50 | 60.68 | -0.81 | |
| GPQA-D | 198 | 94.4 | 107.1 | +13.4 | 19.18 | 22.88 | +19.3 | 73.74 | 71.72 | -2.02 | |
| Block Size | Method | TPS | TPF | Acc |
|---|---|---|---|---|
| 32 | Base | 111 | 4.83 | 68.8 |
| FlowBlock | 132 (+18%) | 5.77 (+20%) | 67.9 (-1.0) | |
| MBD-LMs | 131 (+18%) | 5.95 (+23%) | 67.4 (-1.4) | |
| B3 | 133 (+20%) | 5.88 (+22%) | 69.6 (+0.7) | |
| 64 | Base | 127 | 5.53 | 68.6 |
| FlowBlock | 132 (+4%) | 5.89 (+7%) | 68.3 (-0.3) |
Appendix figures & tables16 assets
Supplementary material from the paper’s appendix.
Appendix
| Entropy bound | 0.001 | 0.01 | 0.1 | 1 | 10 | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Method | Base | B3 | Base | B3 | Base | B3 | Base | B3 | Base | B3 |
| TPS | ||||||||||
| GSM8K | 113.5 | 119.2 | 131.1 | 141.0 | 136.1 | 150.8 | 142.3 | 160.6 | 145.2 | 167.7 |
| MATH500 | 125.2 | 125.1 | 137.3 | 142.9 | 139.9 | 156.0 | 144.0 | 161.2 | 147.0 | 171.4 |
| AIME26 | 93.8 | 97.7 | 99.9 | 108.2 | 101.0 | 121.6 | 114.6 | 120.0 | 119.5 | 129.6 |
| GPQA-D | 76.8 | 84.8 | 86.3 | 96.2 | 94.4 | 107.1 | 99.4 | 114.2 | 103.6 | 121.5 |
| Confidence threshold | 0.3 | 0.5 | 0.7 | 0.85 | 0.95 | |||||
|---|---|---|---|---|---|---|---|---|---|---|
| Method | Base | B3 | Base | B3 | Base | B3 | Base | B3 | Base | B3 |
| TPS | ||||||||||
| GSM8K | 128.1 | 146.1 | 133.5 | 150.1 | 114.2 | 124.8 | 84.5 | 91.9 | 58.6 | 61.5 |
| MATH500 | 160.6 | 186.5 | 171.2 | 199.5 | 160.4 | 186.1 | 126.5 | 139.3 | 95.2 | 102.9 |
| AIME26 | 109.6 | 115.8 | 131.3 | 149.9 | 113.7 | 125.9 | 92.6 | 92.9 | 70.6 | 72.1 |
| GPQA-D | 65.6 | 66.2 | 79.8 | 87.1 | 69.5 | 73.8 | 54.4 | 56.1 | 42.8 | 44.4 |
| Block | 128 | 256 | 256 | 384 | 512 |
|---|---|---|---|---|---|
| B3 | |||||
| TPS | |||||
| GSM8K | 90.9 | 136.1 | 150.8 | 171.0 | 177.8 |
| MATH500 | 96.6 | 139.9 | 156.0 | 167.8 | 171.1 |
| AIME26 | 86.7 | 101.0 | 121.6 | 118.9 | 112.6 |
| GPQA-D | 70.4 | 94.4 | 107.1 | 106.0 | 104.8 |
| Block | 32 | 32 | 64 | 64 | 96 | 128 |
|---|---|---|---|---|---|---|
| B3 | B3 | |||||
| TPS | ||||||
| GSM8K | 101.5 | 122.8 | 114.2 | 124.8 | 113.5 | 91.7 |
| MATH500 | 133.9 | 163.9 | 160.4 | 186.1 | 159.7 | 148.5 |
| AIME26 | 103.6 | 118.5 | 113.7 | 125.9 | 121.3 | 105.4 |
| GPQA-D | 65.8 | 73.4 | 69.5 | 73.8 | 70.5 | 62.9 |
| Block | 32 | 64 | ||||||
|---|---|---|---|---|---|---|---|---|
| Method | Base | FlowBlock | MBD-LMs | B3 | Base | FlowBlock | MBD-LMs | B3 |
| TPS | ||||||||
| GSM8K | 101.5 | 153.2 | 119.9 | 122.8 | 114.2 | 153.8 | 119.3 | 124.8 |
| MATH500 | 133.9 | 207.1 | 161.8 | 163.9 | 160.4 | 210.8 | 176.6 | 186.1 |
| AIME26 | 103.6 | 143.6 | 116.4 | 118.5 | 113.7 | 147.7 | 114.0 | 125.9 |
| GPQA-D | 65.8 | 91.1 | 74.2 | 73.4 | 69.5 | 83.4 | 69.7 | 73.8 |
| Accepted in | Tokens | Edited later | Share |
|---|---|---|---|
| DiffusionGemma | |||
| Vanilla | 237,496 | 633 | 0.27% |
| B3 (future block) | 42,426 | 839 | 1.98% |
| LLaDA 2.1 mini | |||
| Vanilla | 51,520 | 1,441 | 2.80% |
| B3 (future block) | 26,250 | 1,125 | 4.29% |
Diffusion Language Model Inference
Diffusion language model inference studies how to generate, guide, and serve text efficiently through iterative denoising and parallel token updates.
See all 201 papers