cs.CLOct 20, 2026

Beyond Model Weights: Sampling-Dependent Fairness in Diffusion Language Models

Authors: Koshiro Saito, Daisuke Oba, Danushka Bollegala, Naoaki Okazaki

Organizations: Institute of Science Tokyo · University of Liverpool · Amazon · AIST · 

Abstract

Diffusion language models (DLMs) are emerging as a practical alternative to autoregressive language models (ARLMs), yet their fairness remains largely uncharacterized. DLMs introduce sampling controls with no direct autoregressive counterpart, such as block length and remasking strategy, that directly set their speed--quality operating point. This raises a basic question: does a DLM's measured social bias remain stable across these settings? Across LLaDA, LLaDA-1.5, and Dream on Open-BBQ, we find that all three models exhibit social bias, but both the magnitude of measured bias and the relative ordering of models by bias are highly sensitive to the sampling configuration. This sampling dependence also changes what successful debiasing means. While mitigation strategies established for ARLMs transfer effectively to DLMs and reduce bias without degrading downstream performance, sampling dependence persists even after mitigation. Our results show that fairness in DLMs cannot be characterized independently of the sampling configuration, even after debiasing. Project page is available at https://pakapaka333.github.io/Beyond-Model-Weights/.

Figures & tables

Appendix figures & tables22 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Who Gets Unmasked? Sampler-Induced Bias in Diffusion Language Models

    Oct 17, 2026Xujun Che, Farsheed Haque, Depeng Xu +2Diffusion Language ModelsLanguage Model Bias Evaluation

  2. Noise Out, Bias In: Targeted Bias Injection in Diffusion Language Models via Closed-Loop Activation Steering

    Oct 5, 2026Sarim Hashmi, Mukul Ranjan, Abdelrahman Elsayed +3Adversarial Attacks on Diffusion ModelsDiffusion Language Models

  3. FairLMs: A Turnkey Library for Fairness in Language Models

    Sep 18, 2026Jiale Zhang, Michael Larionov, Zichong Wang +2Language Model Bias EvaluationSocial Bias in Language Models