Linguistic Bias in Language Models

Overview

The field examines how dialect, register, language, locale, and demographic cues affect what language models generate, understand, recommend, or judge. Researchers use controlled minimal pairs, multilingual benchmarks, human comparisons, and analyses of model representations to test differences across settings such as AAVE and standard English, low-resource languages, and high-stakes assessment. Mitigation approaches include balanced training and fine-tuning, decoding-time fairness checks, activation steering, and retrieval methods that preserve evidence across languages. A central tension is that alignment can reduce overt bias while latent associations and disparities persist or shift with prompt wording, task, language, and model architecture, making reliable measurement and generalization difficult.

Latest papers

CardsList

92 papers4 papers in the last four weeks, down 43% on the four weeks before. 0.0% of all new papers.

  1. General Phrase Debiaser: Debiasing Masked Language Models at a Multi-Token Level

    Nov 23, 2023Bingkang Shi, Xiaodan Zhang, Dehan Kong +4Gender Bias in Language ModelsDebiased ML