Social Bias in Language Models

Ask about this topic

Overview

This topic studies how language models reflect or produce social disparities tied to traits such as gender, race, disability, religion, class, and language variety, in both text generation and consequential tasks. Researchers use counterfactual prompts, stereotype and decision-making benchmarks, human and community judgments, and audits across languages, dialects, modalities, and multi-turn interactions. Mitigation approaches include data augmentation and fine-tuning, prompting and retrieval, decoding-time controls, and interventions on model weights or internal representations. A central challenge is that measured bias changes with the task and context, while interventions can reduce visible disparities without removing underlying associations or can shift harms and degrade useful capabilities.

Latest papers

CardsList

200 papers21 papers in the last four weeks, down 9% on the four weeks before. 0.1% of all new papers.

  1. ImplicitBBQ: Benchmarking Implicit Bias in Large Language Models through Characteristic Based Cues

    Apr 2, 2026Bhaskara Hanuma Vedula, Darshan Anghan, Ishita Goyal +2Social Bias in Language ModelsLanguage Model Bias Evaluation

    International Institute of Information Technology, Hyderabad · Indian Institute of Technology, Kharagpur

  2. Shiny Stories, Hidden Struggles: Investigating the Representation of Disability Through the Lens of LLMs

    Apr 2, 2026Marco Bombieri, Simone Paolo Ponzetto, Marco RospocherSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Department of Information Engineering and Computer Science, University of Trento, Italy · Data and Web Science Group, University of Mannheim, Germany

  3. A Japanese Benchmark for Evaluating Social Bias in Reasoning Based on Attribution Theory

    Apr 1, 2026Taihei Shiotani, Masahiro Kaneko, Naoaki OkazakiSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Institute of Science Tokyo · MBZUAI · AIST +1

  4. Sima AIunty: Caste Audit in LLM-Driven Matchmaking

    Mar 31, 2026Atharva Naik, Shounok Kar, Varnika Sharma +2Social Bias in Language ModelsCultural Bias in Language Models

    University of Illinois Urbana-Champaign, Urbana, IL, USA · University of Texas at Austin, Austin, TX, USA

  5. Versteasch du mi? Computational and Socio-Linguistic Perspectives on GenAI, LLMs, and Non-Standard Language

    Mar 30, 2026Verena Platzgummer, John McCrae, Sina AhmadiSocial Bias in Language ModelsLow-Resource Language Processing

    University of Galway · University of Zurich

  6. Limited Stereotype Control Through Routing Reweighting in MoE Language Models

    Mar 28, 2026Junhyeok Lee, Han Jang, Kyu Sung ChoiSocial Bias in Language ModelsDemographic Bias in Language Models

    Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine · Department of Radiology, Seoul National University Hospital · Department of Radiology, Seoul National University College of Medicine +1

  7. Debiasing Large Language Models toward Social Factors in Online Behavior Analytics through Prompt Knowledge Tuning

    Mar 28, 2026Hossein Salemi, Jitin Krishnan, Hemant PurohitLanguage Model DebiasingSocial Bias in Language Models

    George Mason University, Fairfax, Virginia, United States

  8. Can We Locate and Prevent Stereotypes in LLMs?

    Mar 26, 2026Alex D'SouzaSocial Bias in Language ModelsLLM Interpretability

    UC Davis

  9. Alignment Reduces Expressed but Not Encoded Gender Bias: A Unified Framework and Study

    Mar 25, 2026Nour Bouchouchi, Thibault Laugel, Xavier Renard +3Gender Bias in Language ModelsLLM Alignment

    Sorbonne Université, CNRS, LIP6, F-75005 Paris, France · AXA, Paris, France · Polish Academy of Science, IBS PAN, Warsaw, Poland

  10. Greater accessibility can amplify discrimination in generative AI

    Mar 23, 2026Carolin Holtermann, Minh Duc Bui, Kaitlyn Zhou +3Social Bias in Language ModelsGender Bias in Language Models

    Trustworthy AI Lab, University of Hamburg · NALA Group, JGU Mainz · Cornell University +3

  11. CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMs

    Mar 23, 2026Ravi Ranjan, Utkarsh Grover, Mayur Akewar +2Language Model DebiasingSocial Bias in Language Models

    Florida International University Miami, USA · University of South Florida Tampa, USA

  12. Benchmarking Bengali Dialectal Bias: A Multi-Stage Framework Integrating RAG-Based Translation and Human-Augmented RLAIF

    Mar 22, 2026K. M. Jubair Sami, Dipto Sumit, Ariyan Hossain +1Social Bias in Language ModelsDialect Bias in Language Models

    Department of Computer Science and Engineering BRAC University, Dhaka, Bangladesh

  13. The Binding Effect: Analyzing How Multi-Dimensional Cues Form Gender Bias in Instruction TTS

    Mar 21, 2026Kuan-Yu Chen, Yi-Cheng Lin, Po-Chung Hsieh +5Text-to-SpeechSocial Bias in Language Models

    Graduate Institute of Communication Engineering, National Taiwan University, Taiwan · AI Research Center, Inventec Corporation, Taiwan

  14. UGID: Unified Graph Isomorphism for Debiasing Large Language Models

    Mar 19, 2026Zikang Ding, Junchi Yao, Junhao Li +4Language Model DebiasingSocial Bias in Language Models

    University of Electronic Science and Technology of China, Chengdu, China · Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates · South China University of Technology, Guangzhou, China

  15. Analysis Of Linguistic Stereotypes in Single and Multi-Agent Generative AI Architectures

    Mar 19, 2026Martina Ullasci, Marco Rondina, Riccardo Coppola +6Dialect Bias in Language ModelsLinguistic Bias in Language Models

    Politecnico di Torino Turin, Italy

  16. When Names Change Verdicts: Intervention Consistency Reveals Systematic Bias in LLM Decision-Making

    Mar 19, 2026Abhinaba Basu, Pavan ChakrabortyOwnership Bias in Language ModelsLanguage Model Bias Evaluation

    Indian Institute of Information Technology, Allahabad (IIITA) · National Institute of Electronics and Information Technology (NIELIT)

  17. LLM Nepotism in Organizational Governance

    Mar 18, 2026Shunqi Mao, Wei Guo, Dingxin Zhang +2Algorithmic BiasSocial Bias in Language Models

    School of Computer Science, The University of Sydney

  18. A Representation-Level Assessment of Bias Mitigation in Foundation Models

    Mar 17, 2026Svetoslav Nizhnichenkov, Rahul Nair, Elizabeth Daly +1Gender Bias in Language ModelsSocial Bias in Language Models

    IBM Research, Dublin, Ireland · School of Computer Science, University College Dublin, Dublin, Ireland

  19. Invisible Influences: Investigating Implicit Intersectional Biases through Persona Engineering in Large Language Models

    Mar 16, 2026Nandini Arimanda, Achyuth Mukund, Sakthi Balan Muthiah +1Intersectional Bias in Language ModelsSocial Bias in Language Models

    Department of Computer Science and Engineering, Shiv Nadar University Chennai, Tamil Nadu, India · School of AI and CS, Plaksha University, Mohali, Punjab, India

  20. Large Language Models Reproduce Racial Stereotypes When Used for Text Annotation

    Mar 14, 2026Petter TörnbergSocial Bias in Language ModelsDemographic Bias in Language Models

    Institute for Logic, Language and Computation (ILLC), University of Amsterdam„ Science Park 107, 1098 XG Amsterdam, Netherlands

  21. Preconditioned Test-Time Adaptation for Out-of-Distribution Debiasing in Narrative Generation

    Mar 14, 2026Hanwen Shen, Ting Ying, Jiajie Lu +1Narrative GenerationLanguage Model Debiasing

    Laboratory for Artificial Intelligence in Mathematics Education, Stevens Institute of Technology · Independent Researcher · NLP2CT Lab, Department of Computer and Information Science, University of Macau

  22. Widespread Gender and Pronoun Bias in Moral Judgments Across LLMs

    Mar 13, 2026Gustavo Lúcius Fernandes, Jeiverson C. V. M. Santos, Pedro O. S. Vaz-de-MeloSocial Bias in Language ModelsGender Bias in Language Models

    Universidade Federal de Minas Gerais (UFMG), Belo Horizonte, Brazil · Instituto Kunumi, Belo Horizonte, Brazil

  23. SectEval: Evaluating the Latent Sectarian Preferences of Large Language Models

    Mar 13, 2026Aditya Maheshwari, Amit Gajkeshwar, Kaushal Sharma +1Social Bias in Language ModelsLanguage Model Bias Evaluation

    Indian Institute of Management Indore, India

  24. Investigating Gender Stereotypes in Large Language Models via Social Determinants of Health

    Mar 10, 2026Trung Hieu Ngo, Adrien Bazoge, Solen Quiniou +2Intersectional Bias in Language ModelsSocial Bias in Language Models

    Nantes Université, École Centrale Nantes, CNRS, LS2N, UMR 6004, F-44000 Nantes, France · Nantes Université, CHU Nantes, Clinique des données, INSERM, CIC 1413, Nantes, France

  25. Towards a more efficient bias detection in financial language models

    Mar 9, 2026Firas Hadj Kacem, Ahmed Khanfir, Mike PapadakisFinancial Language Model EvaluationIntersectional Bias in Language Models

    SnT, University of Luxembourg, Luxembourg · RIADI, ENSI, University of Manouba, Tunisia

  26. Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization

    Mar 9, 2026Hongli Zhou, Hui Huang, Rui Zhang +5LLM-as-a-JudgeSocial Bias in Language Models

    Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China · School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, 518055, China

  27. Dual-Metric Evaluation of Social Bias in Large Language Models: Evidence from an Underrepresented Nepali Cultural Context

    Mar 8, 2026Ashish Pandey, Tek Raj ChhetriSocial Bias in Language ModelsCultural Bias in Language Models

    Center for Artificial Intelligence Research Nepal, Sundarharaincha-09, Buddhabare, Nepal

  28. Position: LLMs Must Use Functor-Based and RAG-Driven Bias Mitigation for Fairness

    Mar 7, 2026Ravi Ranjan, Utkarsh Grover, Agorista PolyzouSocial Bias in Language ModelsDemographic Bias in Language Models

    Knight Foundation School of Computing and Information Sciences, Florida International University, Miami, FL 33199 · College of Engineering, University of South Florida, Tampa, FL 33620

  29. Mind the Gap: Pitfalls of LLM Alignment with Asian Public Opinion

    Mar 6, 2026Hari Shankar, Vedanta S P, Sriharini Margapuri +3Cultural Bias in Language ModelsCross-Cultural Language Model Evaluation

    IIIT Hyderabad · IIIT Kottayam · IIT Kharagpur

  30. Evaluating the Usage of African-American Vernacular English in Large Language Models

    Feb 25, 2026Deja Dunlap, R. Thomas McCoyDialect Bias in Language ModelsLinguistic Bias in Language Models

    Yale University, New Haven CT 06511, USA