Demographic Bias in Language Models

Ask about this topic

Momentum

15 papers in the last four weeks, up 150% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 80

All topics
CardsList

  1. Noise Out, Bias In: Targeted Bias Injection in Diffusion Language Models via Closed-Loop Activation Steering

    Oct 5, 2026Sarim Hashmi, Mukul Ranjan, Abdelrahman Elsayed +3Diffusion Language ModelsDemographic Bias in Language Models

    Mohamed bin Zayed University of Artificial Intelligence

  2. Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

    Oct 1, 2026Manar Aljohani, Brandon Ho, Kenneth McKinley +2Clinical Decision-MakingLanguage Model Bias Evaluation

    Department of Computer Science Virginia Tech Blacksburg, VA, US · Division of Emergency Medicine University of Washington and Seattle Children’s Hospital Seattle, WA, USA · Children’s National Hospital Washington DC, USA

  3. Pruning for Efficiency, Paying in Fairness: Demographic Disparities in Pruned Speech-LLMs

    Sep 29, 2026Ganesh Pavan Kartikeya Bharadwaj Kolluri, Michael Kampouridis, Ravi ShekharLLM PruningAlgorithmic Fairness

    School of Computer Science and Electronic Engineering, University of Essex, UK

  4. Calibrated to Whom? Persona and Language Effects on Cultural Values in JEV

    Sep 28, 2026Bushra Asseri, Abdulaziz AsseriMultilingual Language Model EvaluationCross-Cultural Language Model Evaluation

    College of Engineering and Advanced Computing, Alfaisal University, Riyadh, Saudi Arabia · Proxa.sa, Riyadh, Saudi Arabia

  5. Population Fidelity: Evaluating Population Representativeness in LLMs

    Sep 28, 2026Neemias B. da Silva, Martin Lukk, Ali Sutani +5LLM EvaluationLLM Fine-Tuning

    University of Toronto, Canada · Federal University of Technology – Paran´a, Brazil

  6. HEAR: Real Voices, Real Bias: A Large-Scale Human-Recorded, Demographically Diverse Benchmark for Audio Language Models

    Sep 28, 2026Shen Yan, Duc Le, Irina-Elena VelicheAudio-Language Model EvaluationAudio-Language Models

    Meta Superintelligence Labs

  7. BA-DPO: Bias-Adjusted Direct Preference Optimization for Language Model Alignment

    Sep 28, 2026Antonio Ferrara, Alberto Rumi, Francesco BonchiLLM AlignmentDebiased ML

    Intesa Sanpaolo AI Research

  8. Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Models

    Sep 28, 2026Mir Tafseer Nayeem, Davood RafieiLLM InterpretabilityLanguage Model Bias Evaluation

    Department of Computing Science University of Alberta

  9. RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models

    Sep 25, 2026Pavithra P M Nair, Bhavik Talaviya, Shourya Bhushan +5Language Model Bias EvaluationDemographic Bias in Language Models

    Center for Cybersecurity Systems & Networks, Amrita Vishwa Vidyapeetham, Amritapuri, India · Unique Identification Authority of India, Delhi, India

  10. Before the Arrest: Benchmarking LLMs on Criminal Profiling from Incomplete Evidence

    Sep 17, 2026Yutong Yao, Yanjie Cao, Guanhua Chen +5Abductive ReasoningLegal Judgment Prediction

    NLP2CT Lab, Faculty of Information Science and Computing, University of Macau · Faculty of Social Sciences, University of Macau

  11. Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment

    Sep 16, 2026Kosuke Kitahara, Nobuhiro YamaguchiGender Bias in Language ModelsAI-Assisted Decision Making

    Recruit Co., Ltd. 1-9-2 Marunouchi Chiyoda-ku, Tokyo 100-6640 Japan

  12. The Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment

    Sep 15, 2026Donya Rooein, Luca Benedetto, Dirk HovyAI in EducationGenerative AI in Education

    Bocconi University, Milan, Italy · Télécom SudParis, Institut Polytechnique de Paris, Palaiseau, France

  13. Beyond the Name: Demographic Leakage in De-Identified Résumés and Evaluation Artifacts in LLM Bias Audits

    Sep 15, 2026Qiangju Chen, Yang XiaoLLM-as-a-JudgeLanguage Model Bias Evaluation

    Macquarie University · The University of Melbourne

  14. EduFair-Bench: Evaluating Pedagogical Fairness of LLM Tutors Across Student Demographics

    Sep 14, 2026Jiaxu Zhao, Bahar Radmehr, Fares Fawzi +2Generative AI in EducationLanguage Model Bias Evaluation

    Swiss Federal Institute of Technology in Lausanne (EPFL), Switzerland

  15. The Audit Decides the Verdict: Instrument Effects Rival Demographic Bias in LLM Decision Audits

    Sep 8, 2026Siddharth Vohra, Manikandan RavikiranLanguage Model Bias EvaluationDemographic Bias in Language Models

    Carnegie Mellon University Amazon Web Services AI Native Pittsburgh, PA, USA · Indian Institute of Technology Mandi, India

  16. From Simulated Citizens to Simulated Deliberation: Challenges in Representation and Interaction

    Sep 7, 2026Chaemin Jang, Junsik Min, Jaewoo Choi +9Opinion DynamicsHuman Behavior Simulation

    1Korea Advanced Institute of Science and Technology (KAIST) · 2Seoul National University

  17. Do LLMs Know Your Neighborhood? Auditing LLM Priors for Neighborhood-Level Mobility Prediction and Structural Alignment

    Aug 31, 2026Saad Mohammad Abrar, Eesha Kurella, Arnav Dadarya +3LLM AuditingHuman Behavior Prediction

    University of Maryland USA

  18. LLM-as-a-Demographic: Whom Sociodemographic Prompting Helps, and Whom It Hurts

    Aug 31, 2026Daniela Occhipinti, Andrea Piergentili, Marco GueriniLLM-as-a-JudgeLLM Prompting

    Fondazione Bruno Kessler, Via Sommarive 18, Povo, Trento, Italy · Almawave Labs, Via Di Casal Boccone, 188/190, Rome

  19. LLM-Driven Autonomous Vehicles Inherit Human Driver Biases in Pedestrian Yielding: Results and Implications From A New Benchmark

    Aug 31, 2026Irem Yoldas, Martim Brandão, Jie Zhang +1Autonomous Driving BenchmarksAutonomous Driving Safety Evaluation

    King’s College London, UK

  20. Mitigating Identity Essentialism in LLM Agents with Longitudinal Life Trajectories

    Aug 20, 2026Hexi Wang, Yujia Zhou, Bangde Du +7Human Behavior SimulationLLM Agent Memory

    Department of Computer Science and Technology, Tsinghua University · Quan Cheng Laboratory

  21. Locating and Controlling Implicit Personalization in Large Language Models

    Aug 12, 2026Yueru Yan, Siqi Wu, Thai LeLLM PersonalizationLLM Interpretability

    Indiana University Bloomington, USA

  22. Subjective Multi-Bias Detection with Large Language Models

    Aug 10, 2026Ruiyu Li, Zhiying ZhuDemographic Bias in Language Models

    Carnegie Mellon University, Pittsburgh, PA, United States.

  23. Fair on the Surface? Benchmarking Hidden-Output Fairness Gaps in LLM Recommenders

    Aug 8, 2026Chan Aristella Lu, Arya Fayyazi, Junhao Zhang +6LLM AuditingLanguage Model Bias Evaluation

    University of Georgia · University of Southern California · Carnegie Mellon University +1

  24. People Are Not Just Their Countries. Disentangling Social Determinants of LLM Value Alignment Across Europe

    Aug 7, 2026Maria-Louisa Wightman, Guillaume Bied, Tijl De BieLLM AlignmentComputational Social Science

    Electronics and Information Systems (ELIS), Ghent University

  25. Does Splitting a Triage Decision Across Agents Hide Bias or Help Catch It? A Multi-Agent Simulation Study of LLM-Based Resource Allocation Under Audit Capacity Constraints

    Aug 7, 2026Paul-Peter ArslanLLM AuditingLanguage Model Bias Evaluation

    Institute for Future Technologies

  26. Mind the Gaps: Mixture-of-Minds for Human Simulation

    Aug 6, 2026Pranav DahiyaMixture-of-Experts Language ModelsHuman Behavior Simulation

    Semilattice

  27. Who Should Be Generated? Justifying Demographic Targets in Open-Ended Generation

    Aug 3, 2026Zeshen Zheng, Yujia He, Qianmian Lin +2Language Model Bias EvaluationDemographic Bias in Language Models

    Sun Yat-sen University, China

  28. FairFund-Bench: Evaluating Distributive Bias in LLM Resource Allocation

    Jul 31, 2026Martin LukkBenchmark AuditingLLM Auditing

    University of Toronto

  29. Fairness Pruning: Locating Demographic Bias in GLU-MLP Layers via Differential Activations

    Jul 30, 2026Pere Martra, Eugenio Martínez Cámara, Alfonso Ureña LópezLLM PruningLLM Interpretability

    Universidad Internacional Men´endez Pelayo Barcelona, Spain · Departamento de Inform´atica Universidad de Ja´en Ja´en, Spain

  30. When Synthetic Users Fail: A Cross-Domain Benchmark of LLM-Simulated Human Survey Responses

    Jul 28, 2026Zihan Chen, Di Zhu, Lei Nico ZhengLLM EvaluationLarge Language Model-Based Social Simulation

    Stevens Institute of Technology Hoboken, NJ, USA · University of Massachusetts Boston Boston, MA, USA

  31. Probing Latent Colombian Identity Inferences in Qwen2.5-7B with Natural Language Autoencoders

    Jul 23, 2026Pablo Santiago Potes Velasco, María del Mar García Matabanchoy, Óscar Julián Pérez Ladino +3LLM InterpretabilityCultural Bias in Language Models

    Universidad Autónoma de Occidente Cali, Colombia · Universidad Autónoma de Occidente GobLab-UAI Cali, Colombia

  32. Sympathetic Framing: Evaluating AI Alignment across Sociodemographic Groups

    Jul 22, 2026Haran Shani-Narkiss, Michael Fire, Oren TsurLLM EvaluationLLM Alignment

    University College London, London, England. · Ben-Gurion University of the Negev, Be’er Sheba, Israel.

  33. The Paternalistic Filter: Epistemic Injustice and Differential Refusal in LLM-Mediated History Education for Marginalized Romanian Students

    Jul 13, 2026Alexis Popovici, Andrei Ionascu, Adrian-Marius DumitranLanguage Model Safety EvaluationAI in Education

    Universitatea din Bucuresti, Bucharest, Romania

  34. Moral Safety in LLMs: Exposing Performative Compliance with Puzzled Cues

    Jun 30, 2026Mohammadamin Shafiei, Shuyue Stella Li, Yulia TsvetkovLanguage Model Safety EvaluationLanguage Model Bias Evaluation

    University of Milan · University of Washington

  35. Demographic Metadata as Construct-Irrelevant Noise in DistilBERT-Based Automated Essay Scoring

    Jun 19, 2026Teik Peng Ch'ng, Hui Na ChuaAutomated Essay ScoringDemographic Bias in Language Models

    Sunway University School of Computing and Artificial Intelligence, Faculty of Engineering and Technology, Sunway University, Malaysia

  36. StylisticBias: A Few Human Visual Cues Drive Most Social Biases in MLLMs

    Jun 18, 2026Shaghayegh Kolli, Timo Cavelius, Nafiseh Nikeghbal +2Social Bias in Language ModelsMultimodal Large Language Models

    Technical University of Munich · Munich Center for Machine Learning · Princeton Center for Information and Technology Policy

  37. AgentFairBench: Do LLM Agents Discriminate When They Act?

    Jun 15, 2026Triveni Morla, Rohith Reddy Bellibaltu, Manpreet Singh +1Algorithmic FairnessLLM Agent Evaluation

    Florida International University, Miami, FL 33199 USA · Boston University, Boston, MA 02215 USA · Department of Computer Science and Engineering, Indian Institute of Technology Patna, Patna, Bihar, India

  38. A Computational Audit of Demographic Association Encoding in ClinicalBERT Language Predictions

    Jun 12, 2026Kehinde Temitayo SoetanLanguage Model Bias EvaluationDemographic Bias in Language Models

    Department of Medical Humanities and Social Sciences The Ohio State University

  39. Beyond Third-Person Audits: Situated Interaction Auditing for User-Centered LLM Bias Research

    Jun 10, 2026Andrés Abeliuk, Cinthia Sanchez Macias, Valentina Alarcón +2Gender Bias in Language ModelsSocial Bias in Language Models

    Department of Computer Science University of Chile Center for Artificial Intelligence (CENIA) Santiago, Chile · Center for Artificial Intelligence (CENIA) Santiago, Chile · Institute of Sociology Pontificia Universidad Católica de Chile Santiago, Chile

  40. Debiasing Without Protected Attributes: Latent Concept Erasure from Textual Profiles

    Jun 10, 2026Shun Shao, Zheng Zhao, Anna Korhonen +2Debiased MLAlgorithmic Fairness

    University of Cambridge · University of Edinburgh · University of Groningen +1

  41. Pareto-Guided Teacher Alignment for Fair Personalized Text Generation

    Jun 8, 2026Tunazzina IslamLanguage Model Bias EvaluationMulti-Objective Language Model Alignment

    Department of Computer Science Purdue University, West Lafayette Indiana 47907, USA

  42. The Geography of Algorithmic Judgment: LLM Intermediaries, Place Identity, and Racial Steering in Housing Search

    Jun 4, 2026Hana Samad, Trung Lam, Christoph Mügge-Durum +1LLM AuditingSocial Bias in Language Models

    Responsible AI Lab · Chief AI Officer and Head of the Responsible AI Lab, National Fair Housing Alliance, Washington DC, USA

  43. From Self to Other: Evaluating Demographic Perspective-Taking in LLM Hate Speech Annotation

    Jun 4, 2026Paloma Piot, Javier ParaparLLM-Assisted AnnotationHate Speech Detection

    Information Retrieval Lab CITIC Research Centre Universidade da Coruña

  44. Epistemic Injustice in Language Models: An Audit of Pretraining Filters and Guardrails

    Jun 4, 2026Marco Antonio Stranisci, A Pranav, Rossana Damiano +2LLM GuardrailsTraining Data Curation

    University of Turin, Italy · Trustworthy AI Lab, University of Hamburg, Germany · IT University of Copenhagen, Denmark

  45. Large Language Models in K-12 Education: Alignment with State Curriculum Standards and Student Personas

    Jun 3, 2026Lisa Korver, Tomo Lazovich, Sherief RedaLLM EvaluationAI in Education

    Department of Computer Engineering · Brown University · Providence, RI 02906 +1

  46. The Ghost Annotator: a Framework to Explore Human Label Variation in Content Moderation through Conformal Prediction

    Jun 1, 2026Mirko Lai, Alessandra Urbinati, Simona Frenda +2Annotator DisagreementConformal Prediction

    Heriot-Watt University, Edinburgh, Scotland · aequa-tech, Torino, Italy · Laboratory for the Modeling of Biological and Socio-technical Systems, Northeastern University, Boston, MA, USA +2

  47. Topics as Proxies for Sociodemographics: How Conversational Context Affects LLM Answers

    Jun 1, 2026Vera Neplenbroek, Gabriele Sarti, Arianna Bisazza +1Social Bias in Language ModelsLanguage Modeling

    Institute for Logic, Language and Computation, University of Amsterdam · Khoury College of Computer Sciences, Northeastern University · Center for Language and Cognition, University of Groningen

  48. Persona Prompting in Multimodal Urban Perception: Descriptive Convergence and Interpretive Variation

    May 27, 2026Neemias da Silva, Matt Ratto, Myriam Delgado +3Multimodal Large Language ModelsLanguage Model Bias Evaluation

    University of Toronto, Toronto, Canada · Universidade Tecnologica Federal do Parana, Curitiba, Brazil

  49. Whose Name Comes Up? III: Persona Prompting Effects in LLM-Based Scholar Recommendation

    May 27, 2026Annabella Sánchez-Guzmán, Lukas Eberhard, Denis Helic +1LLM AuditingLLM Prompting

    Escuela Superior Polit´ecnica del Litoral · Graz University of Technology · Complexity Science Hub

  50. OccuReward: LLM-Guided Occupant-Centric Reward Shaping for Demographic Equity in Grid-Interactive Buildings

    May 27, 2026Shadmehr Zaregarizi, Khashayar YavariReward ShapingAlgorithmic Fairness

    Politecnico di Torino Turin, Italy

  51. Insidious by Design: Implications of Large Language Model algorithmic bias for the Global South

    May 26, 2026Sioux McKenna, Nompilo TshumaGender Bias in Language ModelsCultural Bias in Language Models

    Rhodes University, Makhanda, South Africa · Stellenbosch University, Stellenbosch, South Africa

  52. When Symptoms Are Not Enough: Evidence-Weighting Patterns in Large Language Model Psychiatric Screening

    May 22, 2026Jianfeng Zhu, Megan Korhummel, Ruoming Jin +1Medical DiagnosisMental Health

    Departments of Computer Science1 and Psychological Science2 Kent State University Kent, OH USA

  53. When Do LLMs Generate Realistic Social Networks? A Multi-Dimensional Study of Culture, Language, Scale, and Method

    May 13, 2026Sai Hemanth Kilaru, Sriram Theerdh Manikyala, Raghav Upadhyay +3LLM PromptingSocial Bias in Language Models

    University of Arizona. Tucson, AZ 85721

  54. Fair outputs, Biased Internals: Causal Potency and Asymmetry of Latent Bias in LLMs for High-Stakes Decisions

    May 12, 2026Jagdish Tripathy, Marcus BuckmannLLM AuditingImplicit Bias

    Bank of England

  55. Causal Bias Detection in Generative Artificial Intelligence

    May 12, 2026Drago PleckoAlgorithmic FairnessLanguage Model Bias Evaluation

    Department of Statistics & Data Science UCLA

  56. Explanation Fairness in Large Language Models: An Empirical Analysis of Disparities in How LLMs Justify Decisions Across Demographic Groups

    May 9, 2026Gautam VeldandaLLM AuditingAlgorithmic Fairness

    Independent Researcher

  57. The Refusal--Compliance Tradeoff: A Large-Scale Safety Behavior Audit of Large Language Models

    May 6, 2026Alif Al Hasan, Sumon BiswasLLM Safety BenchmarksLanguage Model Safety Evaluation

    Department of Computer and Data Sciences Case Western Reserve University Cleveland, OH, USA

  58. Measuring and Mitigating Bias in Code Generated by Large Language Models

    May 5, 2026Yuxi Chen, Yutian Tang, Timothy StorerAlgorithmic BiasLanguage Model Bias Evaluation

    School of Computing Science, University of Glasgow, United Kingdom.

  59. Auditing demographic bias in AI-based emergency police dispatch: a cross-lingual evaluation of eleven large language models

    May 2, 2026William Guey, Wei Zhang, Pierrick Bougault +4Multilingual Language Model EvaluationLLM Auditing

    Department of Industrial Engineering, Tsinghua University, Beijing, China · School of Social Sciences, Tsinghua University, Beijing, China · Department of Industrial Engineering, Federal University of Rio de Janeiro, Brazil

  60. Mapping how LLMs debate societal issues when shadowing human personality traits, sociodemographics and social media behavior

    Apr 30, 2026Ali Aghazadeh Ardebili, Massimo StellaSocial Bias in Language ModelsLanguage Model Bias Evaluation

    CogNosco Lab, University of Trento, Department of Psychology and Cognitive Science, Trento, Italy