Demographic Bias in Language Models

Overview

This field examines whether language models treat people differently because of demographic cues such as names, dialects, race, gender, age, disability, or socioeconomic status. Researchers use counterfactual prompts, demographic benchmarks, comparisons with human judgments, and audits of high-stakes tasks such as hiring, health care, education, and recommendations; some also probe model internals to trace how identity affects behavior. Mitigation approaches include prompt design, fine-tuning, representation editing, retrieval, and changes to annotation or decision workflows. A central challenge is that aggregate accuracy or fair-looking outputs can hide intersectional disparities or biased internal signals, while interventions can trade off fairness against utility, personalization, and faithful representation of individuals.

Latest papers

CardsList

144 papers9 papers in the last four weeks, down 57% on the four weeks before. 0.1% of all new papers.

  1. A Crowd-Audited Atlas of Implicit Bias in LLM-Powered Agents

    Nov 16, 2026Jason Alexander, Yuxuan Li, Michael Licamele +2Social Bias in Language ModelsDemographic Bias in Language Models

  2. Auditing a Moving Target: Evidence Anchoring and the Expiry of Fairness Audits of Provider-Served Language Models

    Nov 16, 2026Mika FacchiniLLM AuditingLanguage Model Bias Evaluation

  3. Necessary for What? Auditing Demographic Disclosure to LLM Synthetic Respondents

    Nov 16, 2026Aspen Wang, Yen Yu Shan, Lun-Wei KuLLM AuditingDemographic Bias in Language Models

  4. Do Large Language Models Show Racial and Sex Bias in Pain Management? A Counterfactual Audit of GPT, Claude, Gemini, Llama, DeepSeek and Qwen

    Nov 11, 2026Richard J. Young, Alice M. MatthewsDemographic Bias in Language ModelsAlgorithmic Bias

  5. Whose startup does the AI back? An algorithm audit of reputation and demographic signals in LLM-assisted crowdfunding

    Nov 2, 2026Mirza Samad Ahmed Baig, Syeda Anshrah GillaniAlgorithmic BiasDemographic Bias in Language Models

  6. Swap, Replicate, Read the Mass: A Protocol for Auditing Demographic Bias in System One Decision Models

    Oct 31, 2026Alejandro Mozo Quesada, Sergio Gálvez Rojas, Francisco López ValverdeAlgorithmic BiasLanguage Model Bias Evaluation

  7. The Indian Financial Automated Advice Bias (IFAAB) Dataset : Auditing Socioeconomic and Demographic Disparities in LLM-Generated Financial Advice in India

    Oct 28, 2026Kriti MahajanDemographic Bias in Language ModelsIntersectional Bias in Language Models

  8. Disparity Laundering: Consensus Without Fairness in Clinical Multi-Agent Systems

    Oct 28, 2026Xiaoyang Wang, Tianrui Wang, Christopher C. YangDemographic Bias in Language ModelsMulti-Agent LLMs

  9. AI Alignment for Digital Democracy: Fairer Voters Representation against LLM Biases

    Oct 23, 2026Yi Qi, Srijoni Majumdar, Evangelos PournarasDemographic Bias in Language ModelsLLM Alignment

  10. Invisibilization as a Source of Probability Bias in Language Models

    Oct 22, 2026Christian Arnold, Ernesto Calvo, Guadalupe Gonzalez +2Demographic Bias in Language ModelsLanguage Model Bias Evaluation

  11. Do LLMs Reproduce the Age Gap in Loneliness? Evaluating Survey Simulation against European Survey Data

    Oct 18, 2026Yuliya Li, Achim Rettinger, Dominik BeyerLarge Language Model-Based Social SimulationDemographic Bias in Language Models

  12. Aligning Language Models Towards Counterfactual Invariance

    Oct 16, 2026Basar Demir, Emily Shen, Ksheeraj Sai Vepuri +5Demographic Bias in Language ModelsCounterfactual Fairness

  13. Name-Bias in Large Language Models

    Oct 15, 2026Kalyan Bhetwal, Ceren Mert, Ian WhitehouseSocial Bias in Language ModelsDemographic Bias in Language Models

  14. Are AI Decision Models Biased? A Case Study of Jev

    Oct 14, 2026Ilaria Imperatrice, Taisia Kameneva, Adam Eric Greenberg +1Cognitive Bias in Language ModelsLLM Decision-Making

  15. Unfair and Unsafe: Everyday Bias Triggers Emergent Misalignment

    Oct 11, 2026Alex Martí Guiu, Nicolas Zumarraga, Kevin O'Sullivan +2Emergent Misalignment in Language ModelsLanguage Model Safety Evaluation

  16. Who Receives Respect? A Counterfactual Benchmark for Honorific Allocation Bias in Bengali

    Oct 10, 2026Ajwad Abrar, Md Kamrul Hasan, Hasan MahmudLanguage Model Bias EvaluationDemographic Bias in Language Models

  17. Thin Evidence, Thick Priors: How Language Models Substitute Identity for Missing Financial Facts

    Oct 6, 2026Saanvi Khetan, Sankar BalasubramanianDemographic Bias in Language ModelsLLM Auditing

  18. Noise Out, Bias In: Targeted Bias Injection in Diffusion Language Models via Closed-Loop Activation Steering

    Oct 5, 2026Sarim Hashmi, Mukul Ranjan, Abdelrahman Elsayed +3Adversarial Attacks on Diffusion ModelsDiffusion Language Models

  19. Collective Bias Mitigation via Model Routing and Collaboration

    Oct 2, 2026Mingzhe Du, Luu Anh Tuan, Xiaobao Wu +7Social Bias in Language ModelsDemographic Bias in Language Models

  20. Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

    Oct 1, 2026Manar Aljohani, Brandon Ho, Kenneth McKinley +2Clinical Decision-MakingLanguage Model Bias Evaluation

  21. Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs

    Sep 29, 2026Ganesh Pavan Kartikeya Bharadwaj Kolluri, Michael Kampouridis, Ravi ShekharLLM PruningAlgorithmic Fairness

  22. Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV

    Sep 28, 2026Bushra Asseri, Abdulaziz AsseriMultilingual Language Model EvaluationCross-Cultural Language Model Evaluation

  23. Population Fidelity: Evaluating Population Representativeness in LLMs

    Sep 28, 2026Neemias B. da Silva, Martin Lukk, Ali Sutani +5LLM EvaluationLLM Fine-Tuning

  24. BA-DPO: Bias-Adjusted Direct Preference Optimization for Language Model Alignment

    Sep 28, 2026Antonio Ferrara, Alberto Rumi, Francesco BonchiLLM AlignmentDebiased ML