Language Model Bias Evaluation

Ask about this topic

Overview

Language model bias evaluation studies whether models systematically treat people, viewpoints, or information differently, and whether those differences cause harm in settings such as hiring, healthcare, education, and automated judging. Researchers use controlled counterfactual prompts and minimal-pair or stereotype benchmarks such as BBQ, alongside open-ended, multilingual, multimodal, and multi-turn tests that better reflect real interactions. Analyses range from output comparisons and human-validated benchmarks to probes of internal representations; mitigation includes prompting, fine-tuning, and activation steering. A central challenge is that measured bias changes with wording, answer format, language, and task, while reducing one disparity can hide or worsen another, so reliable evaluation must test multiple contexts and preserve task performance.

Latest papers

CardsList

497 papers54 papers in the last four weeks, level with the four weeks before. 0.3% of all new papers.

  1. Large Language Models Develop Novel Social Biases Through Adaptive Exploration

    Nov 8, 2025Addison J. Wu, Ryan Liu, Xuechunzi Bai +1Social Bias in Language ModelsLanguage Model Bias Evaluation

    1Princeton University · University

  2. Adaptive Generation of Bias-Eliciting Questions for LLMs

    Oct 14, 2025Robin Staab, Jasper Dekoninck, Maximilian Baader +1Social Bias in Language ModelsLanguage Model Bias Evaluation

    1ETH Zurich, Switzerland · 2Snyk, Zurich, Switzerland

  3. ABLEIST: Intersectional Disability Bias in LLM-Generated Hiring Scenarios

    Oct 13, 2025Mahika Phutane, Hayoung Jung, Matthew Kim +2Intersectional Bias in Language ModelsSocial Bias in Language Models

    Cornell University · Princeton University · University of Washington

  4. Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages

    Oct 6, 2025Tarek Naous, Anagha Savit, Carlos Rafael Catalan +17Multilingual Language Model EvaluationCultural Bias in Language Models

    Georgia Institute of Technology · Samsung R&D Institute Philippines · Sungkyunkwan University +6

  5. When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

    Sep 30, 2025Wenda Xu, Sweta Agrawal, Vilém Zouhar +2LLM EvaluationLanguage Model Generation Evaluation

    Google · ETH Zurich

  6. Breaking the Mirror: Activation-Based Mitigation of Self-Preference in LLM Evaluators

    Sep 3, 2025Dani Roytburg, Matthew Bozoukov, Matthew Nguyen +3LLM-as-a-JudgeLanguage Model Steering

    School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 · Martian Research San Francisco, CA, 94105

  7. Political Ideology Shifts in Large Language Models

    Aug 22, 2025Pietro Bernardelle, Stefano Civelli, Leon Fröhling +3Political Bias in Language ModelsLanguage Model Bias Evaluation

    The University of Queensland, Brisbane, Australia · GESIS, Cologne, Germany · University of Udine, Udine, Italy

  8. BiasGym: A Simple and Generalizable Framework for Analyzing and Removing Biases through Injection

    Aug 12, 2025Sekh Mainul Islam, Nadav Borenstein, Siddhesh Milind Pawar +3Social Bias in Language ModelsLLM Interpretability

    University of Copenhagen

  9. Unequal Voices: How LLMs Construct Constrained Queer Narratives

    Jul 21, 2025Atreya Ghosal, Ashim Gupta, Vivek SrikumarSocial Bias in Language ModelsDemographic Bias in Language Models

    University of Utah

  10. From Individuals to Interactions: Benchmarking Gender Bias in Multimodal Large Language Models from the Lens of Social Relationship

    Jun 29, 2025Yue Xu, Wenjie WangNarrative GenerationSocial Bias in Language Models

    School of Information Science and Technology, ShanghaiTech University

  11. Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Bias

    Feb 14, 2025Enzo Doyen, Amalia TodirascuGender Bias in Language ModelsLanguage Model Bias Evaluation

    University of Strasbourg

  12. FairCoder: Probing LLM Bias in High-Stakes Decision Making via Coding Tasks

    Jan 9, 2025Yongkang Du, Jen-tse Huang, Jieyu Zhao +1Social Bias in Language ModelsAlgorithmic Fairness

    Pennsylvania State University · University of Southern California

  13. Homogeneity Bias in Open-Weight LLMs Is Robust to Decoding Hyperparameters

    Jan 4, 2025Messi H. J. LeeSocial Bias in Language ModelsOpen-Weight Language Models

    Independent Researcher · Seoul, Republic of Korea

  14. BTBR: A Bayesian-Theory-Driven Probabilistic-Fuzzy Framework for Implicit Bias Removal in Large Language Models

    Aug 20, 2024Yongxin Deng, Xiaoyu Tan, Jing Pan +3Social Bias in Language ModelsLanguage Model Bias Evaluation

    University of Technology Sydney · School of Computer Science, University of Technology Sydney, Sydney, NSW 2007, Australia · National University of Singapore +3

  15. Fairness Definitions in Language Models Explained

    Jul 26, 2024Zhipeng Yin, Zichong Wang, Avash Palikhe +1Social Bias in Language ModelsDemographic Bias in Language Models

    Florida International University, Miami, USA

  16. MBBQ: A Dataset for Cross-Lingual Comparison of Stereotypes in Generative LLMs

    Jun 11, 2024Vera Neplenbroek, Arianna Bisazza, Raquel FernándezSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Institute for Logic, Language and Computation, University of Amsterdam · Center for Language and Cognition, University of Groningen

  17. GPTBIAS: A Comprehensive Framework for Evaluating Bias in Large Language Models

    Dec 11, 2023Jiaxu Zhao, Meng Fang, Shirui Pan +2Language Model Bias EvaluationAutomated Evaluation

    Mathematics and Computer Science · Eindhoven University of Technology · Eindhoven, Netherlands +9