cs.CLNov 4, 2026

Training-Free Character-Length Control in Summarization with Diffusion Language Models

Authors: Steffen Castle, Nils Feldhus, Christopher Ebert, Leonhard Hennig, Sebastian Möller

Organizations: German Research Center for Artificial Intelligence (DFKI) · CLCG, University of Groningen · Technische Universität Berlin

Abstract

Summarization with a fixed character length is important for tasks such as headline and article preview generation, where text must fit an exact space. Autoregressive language models (LMs) struggle with precise character-length control: training-based methods require task-specific fine-tuning, while zero-shot prompting strategies achieve only approximate compliance. We propose DELTA (Diffusion Expected Length Targeting Algorithm), a training-free inference-time method for masked diffusion LMs that estimates expected character length at each denoising step and dynamically inserts or removes masked positions to steer toward a target length. DELTA requires no fine-tuning and is designed for off-the-shelf masked diffusion LMs. Across three summarization benchmarks, it reduces character-length errors by an order of magnitude compared to baselines while maintaining competitive summary quality in both automatic and human evaluation.

Figures & tables

Appendix figures & tables7 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Survival-Guided Length Control for Efficient Diffusion Language Models

    Aug 26, 2026Ivan Kobyzev, Abbas Ghaddar, Yufei CuiDiffusion Language Model DecodingDiffusion Language Models

  2. Diffusion Language Models Are Natively Length-Aware

    Mar 6, 2026Vittorio Rossi, Giacomo Cirò, Davide Beltrame +3Adaptive Computation for Diffusion ModelsDiffusion Language Models