Language Model Bias Evaluation

Ask about this topic

Momentum

40 papers in the last four weeks, up 122% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 321

All topics
CardsList

  1. The Long Road to the Same Answer: Cognitive Bias Under Escalating Reasoning Budgets in Large Language Models

    Oct 7, 2026Obada KraishanLarge Reasoning ModelsLanguage Model Bias Evaluation

    College of Media and Communication Texas Tech University Lubbock, TX, USA

  2. The Missing Minimal Pair: Stereotype Evaluation in LLMs

    Oct 6, 2026Nataliya Stepanova, Ivan Titov, Emily Allaway +1Multilingual Language Model EvaluationSocial Bias in Language Models

    University of Edinburgh · University of Amsterdam

  3. Wiki-Talkie: Multilingual Benchmarking of Persona-Based Agents on Real-World Discussions

    Oct 6, 2026Dennis Fucci, Andrea Bacciu, Dong Liu +2Multilingual Language Model EvaluationLarge Language Model-Based Role-Play Simulation

    Amazon

  4. OMIT the Action: Measuring Framing-Invariant Omission Bias under Philosophical Disagreement

    Oct 6, 2026Sihyeon Lee, Jihun Song, Chanwoo Kim +2Moral Reasoning in Language ModelsFraming Effects in Language Models

    Soongsil University

  5. Counterfactual Auditing of Bias in Open-Source Large Language Models for Clinical Triage

    Oct 1, 2026Manar Aljohani, Brandon Ho, Kenneth McKinley +2Clinical Decision-MakingLanguage Model Bias Evaluation

    Department of Computer Science Virginia Tech Blacksburg, VA, US · Division of Emergency Medicine University of Washington and Seattle Children’s Hospital Seattle, WA, USA · Children’s National Hospital Washington DC, USA

  6. A Shared Taste for Model-Written Text: The Generator-by-Selector Matrices of "AI-AI Bias" Show No Detectable Own-Model Premium

    Sep 30, 2026Dmitrij ŻatuchinLLM EvaluationLanguage Model Bias Evaluation

    Department of Information Technologies, Estonian Entrepreneurship University of Applied Sciences (EUAS), Tallinn, Estonia. · Rankfor.AI, Wroc law, Poland; Tallinn, Estonia.

  7. MASCRDM: Multi-Agent System for Compliance Risk Detection and Mitigation in Training Process of Large Language Models

    Sep 30, 2026Yan Zhang, Chuming Wei, Ruien Li +3LLM SafetyLanguage Model Bias Evaluation

    Department of Computer Science and Technology, Tsinghua University · Academy of Artificial Intelligence and Advanced Technology, Xi’an Jiaotong-Liverpool University · Department of Computer Sciences, University of Wisconsin–Madison +1

  8. More Choices, Fewer Decisions: Ordinal-Scale Bias in JEV-like Direct-Decision Models

    Sep 30, 2026Tianxiang Gao, Jinzhe Li, Zhiyuan Li +2LLM EvaluationOrdinal Regression

    School of Artificial Intelligence, Jilin University · College of Software, Jilin University · International Center of Future Science, Jilin University +1

  9. Whose Voice Survives the Summary? A Voice-Retention Audit of LLM Employee Listening

    Sep 30, 2026Thilo Tamme, Anton Hantel, Bijan Khosrawi-RadText SummarizationSummarization Evaluation

    Technical University of Munich · Massachusetts Institute of Technology · Leuphana University Lüneburg

  10. Sense and Sensitivity: Benchmarking LLM Clinical Triage Recommendations with Physician Experts

    Sep 29, 2026Abinitha Gourabathina, Haoran Zhang, Yuexing Hao +2Clinical TriageClinical Decision-Making

    Massachusetts Institute of Technology, Department of Electrical Engineering and Computer Science · Worcester Polytechnic Institute, Department of Computer Science

  11. Gender bias across LLMs is common and highly heterogeneous

    Sep 29, 2026Edoardo Bolzoni, Valerio CapraroGender Bias in Language ModelsLLM Auditing

    University of Milan-Bicocca, Milan, Italy

  12. The Argument and the Letterhead: Source-Position Coherence in AI Evaluation

    Sep 28, 2026Michele LoiLLM-as-a-JudgePolitical Bias in Language Models

  13. Over-Personalization Is a Decision Failure: Generation-Induced Apply Bias in LLMs

    Sep 28, 2026Haeun Jang, Yonghyun Jun, Hwanhee LeePersonalized Language ModelsLLM Decision-Making

    Department of Artificial Intelligence, Chung-Ang University

  14. Who Gets a Token, and What Does It Carry? Unequal Name Support and Concept Access in Large Language Models

    Sep 28, 2026Mir Tafseer Nayeem, Davood RafieiLLM InterpretabilityLanguage Model Bias Evaluation

    Department of Computing Science University of Alberta

  15. RupeeBias: Auditing Demographic Bias in Indian Economic Guidance from Large Language Models

    Sep 25, 2026Pavithra P M Nair, Bhavik Talaviya, Shourya Bhushan +5Language Model Bias EvaluationDemographic Bias in Language Models

    Center for Cybersecurity Systems & Networks, Amrita Vishwa Vidyapeetham, Amritapuri, India · Unique Identification Authority of India, Delhi, India

  16. Cultural Divergence Preservation: Diagnosing Flattening and Caricature in LLM-Simulated Survey Populations

    Sep 24, 2026Yeeun Chae, Yewon Choi, Seunghyun Lee +1Cultural Bias in Language ModelsLanguage Model Bias Evaluation

    Yonsei University · NAVER · Seoul National University Hospital

  17. When Residualization Helps an Audit: Format Effects, Slice Gains, and Their Limits

    Sep 21, 2026Daein Weon, Dong Ho KangLanguage Model Bias EvaluationLanguage Model Auditing

    Kookmin University · UStechlab

  18. Some Dialects Are More Equal Than Others: Non-Prestigious Arabic Dialectal Bias in LLMs

    Sep 21, 2026Mai Mohamed Eida, Ryan Dolan, Paul de Nijs +1Arabic NLPSocial Bias in Language Models

    University of Illinois Urbana Champaign

  19. Harm Laundering in GPT Models: Evidence That Gender Discrimination Is Transformed Rather Than Reduced Across Safety-Trained Generations

    Sep 17, 2026Sarah Wyer, Sue Black, Noura Al MoubayedGender Bias in Language ModelsLanguage Model Safety Evaluation

    Durham University

  20. Summarization Bias: The Directional Collapse of Objective Projection into Told-Mode Labels in Large Language Models --- A Conceptual Framework and Registered Test Protocol

    Sep 17, 2026Levent BulutLanguage Model Bias EvaluationLinguistic Bias in Language Models

    Independent Researcher

  21. Geopolitical Divisions Across Languages in Large Language Models

    Sep 17, 2026Maxim ChupilkinMultilingual Language Model EvaluationPolitical Bias in Language Models

    Department of Politics and International Relations, University of Oxford, Oxford, UK

  22. "If I Had to Buy Just ONE: Galaxy S26 Ultra": Auditing AI-Generated Product Recommendations

    Sep 16, 2026Lucas G. Uberti-Bona Marin, Thales Bertaglia, Giovanni Astante +5Language Model Bias EvaluationLarge Language Model-Based Recommendation

    Law & Tech Lab, Maastricht University · Utrecht University · Social Computing Group, Department of Informatics, University of Zurich

  23. DyMT-ESB: Dynamic Multi-Turn Evaluation of Social Bias in User-LLM Interactions

    Sep 16, 2026Rem Hida, Masahiro Kaneko, Daisuke Oba +2Social Bias in Language ModelsMulti-Turn Dialogue Evaluation

    Institute of Science Tokyo · MBZUAI · Third Intelligence +1

  24. Linguistic Triggers of Gender and Racial Bias in Open-Weight LLMs Applied to Recruitment

    Sep 16, 2026Kosuke Kitahara, Nobuhiro YamaguchiGender Bias in Language ModelsAI-Assisted Decision Making

    Recruit Co., Ltd. 1-9-2 Marunouchi Chiyoda-ku, Tokyo 100-6640 Japan

  25. From a River in Gilead to the Inference Distributions of Large Language Models: Covert Dialect Bias and Linguistic Profiling at Scale

    Sep 16, 2026Chowdhury Mohammad Abdullah, Rita OrjiSocial Bias in Language ModelsLanguage Model Bias Evaluation

    Faculty of Computer Science, Dalhousie University Halifax, NS, Canada

  26. Whom Do AI Agents Work For? Role Assignment Induces Sponsorship Bias in LLM Recommenders

    Sep 16, 2026Davood Wadi, Yu MaLanguage Model Bias EvaluationLarge Language Model-Based Recommendation

    Desautels Faculty of Management McGill University Montreal, Quebec, Canada

  27. Who Judges Matters: Measuring Family-Conditioned Preference in LLM-as-Judge Panels

    Sep 15, 2026David Ababio Awuni, Luke E. K. Achenie, Benjamin Tei Partey +2LLM-as-a-JudgePairwise Preference Evaluation

  28. The Role of Implicit and Explicit Demographic Signals in Large Language Model-based Student Assessment

    Sep 15, 2026Donya Rooein, Luca Benedetto, Dirk HovyAI in EducationGenerative AI in Education

    Bocconi University, Milan, Italy · Télécom SudParis, Institut Polytechnique de Paris, Palaiseau, France

  29. Beyond the Name: Demographic Leakage in De-Identified Résumés and Evaluation Artifacts in LLM Bias Audits

    Sep 15, 2026Qiangju Chen, Yang XiaoLLM-as-a-JudgeLanguage Model Bias Evaluation

    Macquarie University · The University of Melbourne

  30. How Humans and LLMs Read Gender into "Gender-Neutral" Physical Descriptions

    Sep 14, 2026Yingjia Wan, Lin Lin, Elisa KreissGender Bias in Language ModelsLanguage Model Bias Evaluation

    Department of Communication University of California, Los Angeles (UCLA) · Department of Computer Science University of California, Los Angeles (UCLA)