cs.CLNov 3, 2026

Say Less, Mean Better: Training-Free Verbosity Control for Language Models

Authors: Mahmoud Alyosify, Mirna Imbabi, Eman Elkhamisi, Rahatara Ferdousi

Organizations: School of Computing, Queen’s University, Kingston, Ontario, Canada

Abstract

Large language models (LLMs) often generate responses longer than necessary, increasing inference latency and computational cost. While prompting can encourage conciseness, controlling output length without compromising response completeness remains challenging. Aggressive early stopping can reduce generation costs but risks terminating responses prematurely. We introduce MinimalLM, a training-free framework for reliable verbosity control that combines uncertainty-aware, length-dependent stop-token adjustment with structural completeness guardrails. MinimalLM separates the decision of when to stop from whether stopping is structurally appropriate, coordinating response-level instructions, decoding-time intervention, and completion checks without modifying model parameters or requiring auxiliary models. We evaluate MinimalLM across three open-source LLMs and 330 questions, producing 5,940 responses across baseline and ablation configurations. MinimalLM reduces generated tokens by 47.6%, accelerates individual responses by 19-68%, and eliminates structurally truncated outputs in the primary evaluation. Despite substantial token savings, it achieves an average quality score of 8.04/10, compared with 8.42/10 for unmodified models and 6.46/10 for length-matched truncation. Evaluations across diverse subject domains (such as healthcare, programming, law, and science) demonstrate robust efficiency gains, while ablations establish the complementary roles of decoding control and completeness constraints. Our findings highlight that efficient generation requires more than producing fewer tokens: it requires controlling when generation ends while preserving response integrity. MinimalLM offers a lightweight, training-free approach toward this goal.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. LACONIC: Length-Aware Constrained Reinforcement Learning for LLM

    Feb 16, 2026Chang Liu, Yiran Zhao, Lawrence Liu +3RL for Language ModelsRL for Language Model Reasoning

  2. Diffusion Language Models Are Natively Length-Aware

    Mar 6, 2026Vittorio Rossi, Giacomo Cirò, Davide Beltrame +3Adaptive Computation for Diffusion ModelsDiffusion Language Models

  3. LARFT: Closing the Cognition-Action Gap for Length Instruction Following in Large Language Models

    Feb 25, 2026Wei Zhang, Lintong Du, Yuanhe Zhang +4Instruction FollowingLLM Fine-Tuning