cs.AINov 19, 2026

GLiDE: A Fast, Calibrated Decision Model Distilled from Reasoning Teachers

Authors: Sahibzada Allahyar, Julia White, Dhruv Atreja, George Hurn-Maloney, Urchade Zaratiana

Organizations: Fastino Labs

Abstract

Decision models enable fast, confidence-aware decisions by scoring candidate answers in a single forward pass, without generating text or intermediate reasoning. Yet reasoning can substantially improve decision quality, raising the question of whether its benefits can be retained without the cost of generating it. We investigate this question with GLiDE, a family of decision models spanning 0.4B to 27B parameters. Building on Qwen hybrid language models, GLiDE enables bidirectional interactions between the context, question, and candidate answers by removing causal masking from full-attention layers. To transfer reasoning capabilities into single-pass inference, we combine soft-target distillation from multiple teachers, including a reasoning model, with progressive post-training on diverse decision tasks. We further explore parameter-free recurrent depth to increase inference-time computation without generating tokens. Across five model sizes, GLiDE lies on the performance--parameter Pareto frontier of the Hugging Face \DI{}, with each model outperforming evaluated alternatives of equal or smaller size. \dmtwo{} (27B) achieves a hidden-set score of 71.52, with an expected calibration error of 2.0% and a median latency of 92.9,ms on a single GPU. Further checkpoint averaging and parameter-free recurrent depth yield GLiDE~27B, which reaches 73.37 with an expected calibration error of 2.1%.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Large Decision Models: Repurposing Large Language Models as Single-Pass Decision Makers

    Oct 11, 2026Ziyi Chen, Yan Zhang, Jianhui Wei +2LLM Decision-MakingEfficient Language Model Inference

  2. StartLux-Decision: AutoThink Decision Models with Reinforcement Learning for Calibrated Deliberative Decisions

    Oct 12, 2026Xialie Zhuang, Zunhai Su, Jia Pan +3LLM Decision-MakingRL for Language Model Reasoning

  3. Towards Foundation Decision Models: Drex

    Nov 5, 2026Nischay Dhankhar, Alisher Amantay, Zhanibek Datbayev +6LLM Decision-MakingEfficient Language Model Inference