Language Model Bias Evaluation

Ask about this topic

Overview

Language model bias evaluation studies whether models systematically treat people, viewpoints, or information differently, and whether those differences cause harm in settings such as hiring, healthcare, education, and automated judging. Researchers use controlled counterfactual prompts and minimal-pair or stereotype benchmarks such as BBQ, alongside open-ended, multilingual, multimodal, and multi-turn tests that better reflect real interactions. Analyses range from output comparisons and human-validated benchmarks to probes of internal representations; mitigation includes prompting, fine-tuning, and activation steering. A central challenge is that measured bias changes with wording, answer format, language, and task, while reducing one disparity can hide or worsen another, so reliable evaluation must test multiple contexts and preserve task performance.

Latest papers

CardsList

497 papers54 papers in the last four weeks, level with the four weeks before. 0.3% of all new papers.

  1. An Independent Safety Evaluation of Kimi K2.5

    Apr 3, 2026Zheng-Xin Yong, Parv Mahajan, Andy Wang +12Language Model Safety EvaluationLLM Security

    Constellation · Brown University · Georgia Institute of Technology +7

  2. Sociodemographic Biases in Educational Counselling by Large Language Models

    Apr 3, 2026Tomasz Adamczyk, Wiktoria Mieleszczenko-Kowszewicz, Beata Bajcar +6Demographic Bias in Language ModelsLanguage Model Bias Evaluation

    Wrocław University of Science and Technology, Wrocław, Poland · University of Silesia in Katowice, Katowice, Poland

  3. Redirected, Not Removed: Task-Dependent Stereotyping Reveals the Limits of LLM Alignments

    Apr 3, 2026Divyanshu Kumar, Ishita Gupta, Nitin Aravind Birur +3Social Bias in Language ModelsLanguage Model Bias Evaluation

    Enkrypt AI

  4. SocioEval: A Template-Based Framework for Evaluating Socioeconomic Status Bias in Foundation Models

    Apr 3, 2026Divyanshu Kumar, Ishita Gupta, Nitin Aravind Birur +3Social Bias in Language ModelsLanguage Model Bias Evaluation

    Enkrypt AI

  5. Mitigating LLM biases toward spurious social contexts using direct preference optimization

    Apr 2, 2026Hyunji Nam, Dorottya DemszkyLanguage Model RobustnessLanguage Model Bias Evaluation

    Stanford University

  6. Failing to Falsify: Evaluating and Mitigating Confirmation Bias in Language Models

    Apr 2, 2026Ayush Rajesh Jhaveri, Anthony GX-Chen, Ilia Sucholutsky +1Language Model Bias Evaluation

    New York University

  7. ImplicitBBQ: Benchmarking Implicit Bias in Large Language Models through Characteristic Based Cues

    Apr 2, 2026Bhaskara Hanuma Vedula, Darshan Anghan, Ishita Goyal +2Social Bias in Language ModelsLanguage Model Bias Evaluation

    International Institute of Information Technology, Hyderabad · Indian Institute of Technology, Kharagpur

  8. Shiny Stories, Hidden Struggles: Investigating the Representation of Disability Through the Lens of LLMs

    Apr 2, 2026Marco Bombieri, Simone Paolo Ponzetto, Marco RospocherSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Department of Information Engineering and Computer Science, University of Trento, Italy · Data and Web Science Group, University of Mannheim, Germany

  9. CogBias: Measuring and Mitigating Cognitive Bias in Large Language Models

    Apr 1, 2026Fan Huang, Songheng Zhang, Haewoon Kwak +1Cognitive Bias in Language ModelsLanguage Model Bias Evaluation

    Indiana University Bloomington · Singapore Management University

  10. A Japanese Benchmark for Evaluating Social Bias in Reasoning Based on Attribution Theory

    Apr 1, 2026Taihei Shiotani, Masahiro Kaneko, Naoaki OkazakiSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Institute of Science Tokyo · MBZUAI · AIST +1

  11. LLM Essay Scoring Under Holistic and Analytic Rubrics: Prompt Effects and Bias

    Mar 31, 2026Filip J. Kucia, Anirban Chakraborty, Anna WróblewskaAutomated Essay ScoringLanguage Model Bias Evaluation

    Faculty of Mathematics and Information Science, Warsaw University of Technology, 00-662 Warsaw, Poland · University of Wolverhampton, UK

  12. Sima AIunty: Caste Audit in LLM-Driven Matchmaking

    Mar 31, 2026Atharva Naik, Shounok Kar, Varnika Sharma +2Social Bias in Language ModelsCultural Bias in Language Models

    University of Illinois Urbana-Champaign, Urbana, IL, USA · University of Texas at Austin, Austin, TX, USA

  13. Exploring LLM biases to manipulate AI search overview

    Mar 30, 2026Roman SmirnovAdversarial Attacks on LLMsLanguage Model Bias Evaluation

  14. ProText: A benchmark dataset for measuring (mis)gendering in long-form texts

    Mar 29, 2026Hadas Kotek, Margit Bowler, Patrick Sonnenberg +1Gender Bias in Language ModelsLanguage Model Bias Evaluation

    Apple, USA

  15. TailNLG: A Multilingual Benchmark Addressing Verbalization of Long-Tail Entities

    Mar 29, 2026Lia Draetta, Michael Oliverio, Virginia Ramón-Ferrer +6Text GenerationLanguage Model Bias Evaluation

    University of Turin, Italy · Universidad Politécnica de Madrid, Spain

  16. Limited Stereotype Control Through Routing Reweighting in MoE Language Models

    Mar 28, 2026Junhyeok Lee, Han Jang, Kyu Sung ChoiSocial Bias in Language ModelsDemographic Bias in Language Models

    Interdisciplinary Program in Cancer Biology, Seoul National University College of Medicine · Department of Radiology, Seoul National University Hospital · Department of Radiology, Seoul National University College of Medicine +1

  17. AMALIA Technical Report: A Fully Open Source Large Language Model for European Portuguese

    Mar 27, 2026Afonso Simplício, Gonçalo Vinagre, Miguel Moura Ramos +19Portuguese Language ModelsLLM Training

    NOVA School of Science and Technology · NOVA LINCS · Instituto de Telecomunicações +2

  18. Emergent Collaborative Deliberation in Multi-Model AI Systems: A BFT-Derived Protocol for Epistemic Synthesis

    Mar 26, 2026VD DoskeMulti-Agent DebateMulti-Agent Consensus

    Independent Researcher / Consilia

  19. Comparing Developer and LLM Biases in Code Evaluation

    Mar 25, 2026Aditya Mittal, Ryan Shar, Zichu Wu +6Bias in LLM-as-a-JudgeLanguage Model Bias Evaluation

    Carnegie Mellon University

  20. Who Benefits from RAG? The Role of Exposure, Utility and Attribution Bias

    Mar 25, 2026Mahdi Dehghan, Graham McDonaldGroup FairnessAlgorithmic Fairness

    University of Glasgow, Glasgow, UK

  21. Alignment Reduces Expressed but Not Encoded Gender Bias: A Unified Framework and Study

    Mar 25, 2026Nour Bouchouchi, Thibault Laugel, Xavier Renard +3Gender Bias in Language ModelsLLM Alignment

    Sorbonne Université, CNRS, LIP6, F-75005 Paris, France · AXA, Paris, France · Polish Academy of Science, IBS PAN, Warsaw, Poland

  22. PoliticsBench: Benchmarking Political Values in Large Language Models with Multi-Turn Roleplay

    Mar 25, 2026Rohan Khetan, Ashna KhetanPolitical Bias in Language ModelsLanguage Model Bias Evaluation

    Northville High School, Northville, USA · Department of Computer Science, Stanford University, Stanford, USA

  23. LLMs Do Not Grade Essays Like Humans

    Mar 24, 2026Jerin George Mathew, Sumayya Taher, Anindita Kundu +1Automated Essay ScoringLLM-as-a-Judge

    University of Alberta, 116 St & 85 Ave, Edmonton, AB, T6G 2R3, Canada

  24. Failure of contextual invariance in large language models

    Mar 24, 2026Sagar Kumar, Ariel Flint, Luca Maria Aiello +1Language Model Bias EvaluationGender Bias in Language Models

    Network Science Institute, Northeastern University, USA · Center for Health Informatics Program, Boston Children’s Hospital, USA · Dept. of Mathematics, City St George’s, University of London, UK +1

  25. Analysing LLM Persona Generation and Fairness Interpretation in Polarised Geopolitical Contexts

    Mar 24, 2026Maida Aizaz, Quang Minh NguyenPolitical Bias in Language ModelsDemographic Bias in Language Models

    Graduate School of Data Science KAIST

  26. CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMs

    Mar 23, 2026Ravi Ranjan, Utkarsh Grover, Mayur Akewar +2Language Model DebiasingSocial Bias in Language Models

    Florida International University Miami, USA · University of South Florida Tampa, USA

  27. Benchmarking Bengali Dialectal Bias: A Multi-Stage Framework Integrating RAG-Based Translation and Human-Augmented RLAIF

    Mar 22, 2026K. M. Jubair Sami, Dipto Sumit, Ariyan Hossain +1Social Bias in Language ModelsDialect Bias in Language Models

    Department of Computer Science and Engineering BRAC University, Dhaka, Bangladesh

  28. Mitigating Selection Bias in Large Language Models via Permutation-Aware GRPO

    Mar 22, 2026Jinquan Zheng, Jia Yuan, Jiacheng Yao +3Group Relative Policy OptimizationPermutation-Invariant Learning

    School of Economics and Management, East China Normal University

  29. JUBAKU: An Adversarial Benchmark for Exposing Culturally Grounded Stereotypes in Japanese LLMs

    Mar 21, 2026Taihei Shiotani, Masahiro Kaneko, Ayana Niwa +4Cultural Bias in Language ModelsLanguage Model Bias Evaluation

    Institute of Science Tokyo · MBZUAI · AIST +1

  30. From Seeing it to Experiencing it: Interactive Evaluation of Intersectional Voice Bias in Human-AI Speech Interaction

    Mar 19, 2026Shree Harsha Bokkahalli Satish, Maria Teleki, Christoph Minixhofer +3Intersectional Bias in Language ModelsLanguage Model Bias Evaluation

    KTH Royal Institute of Technology Stockholm, Sweden · Texas A&M University College Station, USA · University of Edinburgh Edinburgh, UK