cs.CLNov 12, 2026

Parameter-Efficient Conciseness Adaptation: Differentiable Length Control for Concise Clinical Reasoning in Smaller Language Models

Authors: Tanzeel Abbas, Ahmad Kamran Malik, Nafees Qamar, Sana Liaqat

Organizations: Department of Computer Science, COMSATS University Islamabad, Islamabad, Pakistan · School of Health and Behavioral Sciences, Bryant University, Smithfield, Rhode Island 02917, United States

Abstract

Smaller language models (SLMs) make it feasible to deploy clinical natural language processing where large proprietary models are too costly, and parameter-efficient fine-tuning allows them to be specialised on commodity hardware. One obstacle persists after training: on medical tasks these models answer at far greater length than the clinical question requires. In clinical decision support and point-of-care use, where time is short, such verbosity is hard to act on even when the underlying reasoning is sound. Existing length-control methods depend on preference optimisation, reward models, or proprietary teachers that undercut the accessibility making SLMs attractive. We introduce Parameter-Efficient Conciseness Adaptation (PECA), which adds a single differentiable conciseness term to the QLoRA supervised fine-tuning objective. Because the token count is discrete and non-differentiable, PECA instead raises the end-of-sequence probability once generation exceeds a token budget, a smooth signal optimised during ordinary training, with no preference data, no auxiliary model, and a single commodity GPU. On a 1.7-billion-parameter model fine-tuned on the medical-o1-reasoning-SFT corpus, PECA reduces mean response length by 72.8% while improving multiple-choice diagnostic accuracy from 40.8% to 44.0%. A sweep over the conciseness strength traces an interpretable accuracy-to-length frontier for balancing brevity and diagnostic completeness.

Figures & tables

Explore similar work

CardsList
  1. Say Less, Mean Better: Training-Free Verbosity Control for Language Models

    Nov 3, 2026Mahmoud Alyosify, Mirna Imbabi, Eman Elkhamisi +1Efficient Language Model Inference

  2. MedPsy: State-of-the-Art Small Medical Language Models for Efficient Edge Deployment

    Nov 1, 2026Davide Vitabile, Alexandro Buffa, Akshay Nambiar +1Medical LLMsSmall Language Models

  3. LEAD: Length-Efficient Adaptive and Dynamic Reasoning for Large Language Models

    May 10, 2026Songtao Wei, Yi Li, Zhikai Li +7RL for Language Model ReasoningEfficient Language Model Reasoning