Language Model Bias Evaluation

Ask about this topic

Momentum

40 papers in the last four weeks, up 122% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 321

All topics
CardsList

  1. Weight Pruning Amplifies Bias: A Multi-Method Study of Compressed LLMs for Edge AI

    May 2, 2026Plawan Kumar Rath, Rahul MaliakkalLLM PruningOn-Device Language Model Inference

    Meta

  2. Multimodal Large Language Models as Synthetic Participants in Video-Based Studies: An Evaluation

    May 1, 2026Prabal Shrestha, Bohan Jiang, Haoning Xue +2Multimodal Large Language ModelsLanguage Model Bias Evaluation

    Department of Computer Science, Boise State University, Boise, ID, USA · School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA · Department of Communication, University of Utah, Salt Lake City, UT, USA

  3. Political Bias Audits of LLMs Capture Sycophancy to the Inferred Auditor

    Apr 30, 2026Petter Törnberg, Michelle SchimmelLLM SycophancyPolitical Bias in Language Models

    Institute of Logic, Language and Computation (ILLC), University of Amsterdam, Amsterdam, Netherlands

  4. Mapping how LLMs debate societal issues when shadowing human personality traits, sociodemographics and social media behavior

    Apr 30, 2026Ali Aghazadeh Ardebili, Massimo StellaSocial Bias in Language ModelsLanguage Model Bias Evaluation

    CogNosco Lab, University of Trento, Department of Psychology and Cognitive Science, Trento, Italy

  5. The Digital Afterlife of Empires: Four Language Models Converge on the Same Imperial Cartography of Writing

    Apr 30, 2026Hiroki FukuiMultilingual Language ModelsCultural Bias in Language Models

    Research Institute of Criminal Psychiatry / Sex Offender Medical Center · Department of Neuropsychiatry, Kyoto University

  6. Debiasing Reward Models via Causally Motivated Inference-Time Intervention

    Apr 30, 2026Kazutoshi Shinoda, Kosuke Nishida, Kyosuke NishidaReward ModelingLLM Alignment

    Human Informatics Labs., NTT, Inc.

  7. Option-Order Randomisation Reveals a Distributional Position Attractor in Prompted Sandbagging

    Apr 29, 2026Jon-Paul CacioliLanguage Model Bias EvaluationPosition Bias

    Independent Researcher, Melbourne, Australia

  8. Progressing beyond Art Masterpieces or Touristic Clichés: how to assess your LLMs for cultural alignment?

    Apr 28, 2026António Branco, João Silva, Nuno Marques +10Cultural AlignmentCultural Bias in Language Models

    †University of Lisbon · ‡University of Beira Interior

  9. Geographic Bias and Diversity in AI Evaluation

    Apr 28, 2026Zilong Liu, Krzysztof Janowicz, Gengchen Mai +2Algorithmic BiasLanguage Model Bias Evaluation

    University of Vienna, Austria · University of Texas at Austin, USA · University of Wisconsin-Madison, USA +1

  10. An Investigation of Linguistic Biases in LLM-Based Recommendations

    Apr 28, 2026Nitin Venkateswaran, Jason Ang, Deep Adhikari +1Language Model Bias EvaluationLinguistic Bias in Language Models

    University of Florida

  11. Below-Chance Blindness: Prompted Underperformance in Small LLMs Produces Positional Bias Rather than Answer Avoidance

    Apr 28, 2026Jon-Paul CacioliLanguage Model Safety EvaluationLLM Safety

    Independent Researcher, Melbourne, Australia

  12. Assessing Y-Axis Influence: Bias in Multimodal Language Models on Chart-to-Table Translation

    Apr 27, 2026Seok Hwan Song, Azher Ahmed Efat, Wallapak TavanapongData VisualizationMultimodal Large Language Models

    Department of Computer Science, Iowa State University, Ames, Iowa, USA

  13. A Multi-Dimensional Audit of Politically Aligned Large Language Models

    Apr 27, 2026Lisa Korver, Mohamed Mostagir, Sherief RedaLLM AuditingPolitical Bias in Language Models

    Department of Computer Engineering Brown University Providence, RI 02906 · Ross School of Business University of Michigan Ann Arbor, MI 48109

  14. Multi-Dimensional Evaluation of Sustainable City Trips with LLM-as-a-Judge and Human-in-the-Loop

    Apr 27, 2026Ashmi Banerjee, Adithi Satish, Wolfgang Wörndl +1LLM EvaluationLLM-as-a-Judge

    Technical University of Munich Munich, Germany · Polytechnic University of Bari Bari, Italy

  15. Personality Shapes Gender Bias in Persona-Conditioned LLM Narratives Across English and Hindi: An Empirical Investigation

    Apr 26, 2026Tanay Kumar, Shreya Gautam, Aman Chadha +2Gender Bias in Language ModelsLanguage Model Bias Evaluation

    PolitecnicodiMilano · Apple · Meta

  16. Judging the Judges: A Systematic Evaluation of Bias Mitigation Strategies in LLM-as-a-Judge Pipelines

    Apr 25, 2026Sadman Kabir SoumikDebiased MLLLM-as-a-Judge

    Independent Researcher

  17. Peer Identity Bias in Multi-Agent LLM Evaluation: An Empirical Study Using the TRUST Democratic Discourse Analysis Pipeline

    Apr 24, 2026Juergen DietrichLLM SycophancyLanguage Model Bias Evaluation

    TRUST Project — democracy-intelligence.de

  18. Representational Harms in LLM-Generated Narratives Against Global Majority Nationalities

    Apr 24, 2026Ilana Nguyen, Harini Suresh, Thema Monroe-White +1Cultural Bias in Language ModelsLanguage Model Bias Evaluation

    Brown University, USA · Brown University, Providence, Rhode Island, USA · George Mason University, Fairfax, Virginia, USA +1

  19. Exposing the Unsaid: Visualizing Hidden LLM Bias through Stochastic Path Aggregation

    Apr 24, 2026Matteo Pelossi, Rita Sevastjanova, Thilo Spinner +1LLM AuditingSocial Bias in Language Models

    ETH Zurich

  20. Quantifying and Mitigating Self-Preference Bias of LLM Judges

    Apr 24, 2026Jinming Yang, Zheng Hu, Chuxian Qiu +3LLM-as-a-JudgeLanguage Model Bias Evaluation

    CompleX Lab, School of Computer Science and Engineering, University of Electronic Science and Technology of China, Chengdu, China

  21. When AI Speaks, Whose Values Does It Express? A Cross-Cultural Audit of Individualism-Collectivism Bias in Large Language Models

    Apr 24, 2026Pruthvinath Jeripity VenkataLLM EvaluationCross-Cultural Language Model Evaluation

    Independent Researcher

  22. When Cow Urine Cures Constipation on YouTube: Limits of LLMs in Detecting Culture-specific Health Misinformation

    Apr 23, 2026Anamta Khan, Ratna Kandala, Deepti +2LLM PromptingAutomated Fact-Checking

    University of Michigan · University of Kansas · IIT Jodhpur

  23. Why are all LLMs Obsessed with Japanese Culture? On the Hidden Cultural and Regional Biases of LLMs

    Apr 23, 2026Joseba Fernandez de Landa, Carla Perez-Almendros, Jose Camacho-ColladosMultilingual Language Model EvaluationCultural Bias in Language Models

    HiTZ Center - Ixa, University of the Basque Country EHU · Cardiff University

  24. Measuring Opinion Bias and Sycophancy via LLM-based Persuasion

    Apr 23, 2026Rodrigo Nogueira, Giovana Kerche Bonás, Thales Sales Almeida +7LLM SycophancyLLM Auditing

    Maritaca AI · JusBrasil

  25. Ideological Bias in LLMs' Economic Causal Reasoning

    Apr 23, 2026Donggyu Lee, Hyeok Yun, Jungwon Kim +4Political Bias in Language ModelsLanguage Model Bias Evaluation

    Graduate School of Data Science, KAIST, Daejeon, South Korea · College of Business, KAIST, Daejeon, South Korea · School of Computing, KAIST, Daejeon, South Korea +1

  26. When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation

    Apr 23, 2026Nannan Huang, Iffat Maab, Junichi YamagishiSocial Bias in Language ModelsPolitical Bias in Language Models

    RMIT University, Australia · National Institute of Informatics, Tokyo, Japan

  27. Dialect vs Demographics: Quantifying LLM Bias from Implicit Linguistic Signals vs. Explicit User Profiles

    Apr 22, 2026Irti Haq, Belén SaldíasLanguage Model Safety EvaluationSocial Bias in Language Models

    University of Washington, USA

  28. Intersectional Fairness in Large Language Models

    Apr 22, 2026Chaima Boufaied, Ronnie De Souza Santos, Ann BarcombAlgorithmic FairnessLanguage Model Bias Evaluation

    University of Calgary, Calgary, Canada

  29. Bias in the Tails: How Name-conditioned Evaluative Framing in Resume Summaries Destabilizes LLM-based Hiring

    Apr 21, 2026Huy Nghiem, Phuong-Anh Nguyen-Le, Sy-Tuyen Ho +1Algorithmic BiasLanguage Model Bias Evaluation

    University of Maryland

  30. In-Situ Behavioral Evaluation for LLM Fairness, Not Standardized-Test Scores

    Apr 21, 2026Zeyu Tang, Sang T. Truong, Deonna Owens +4LLM EvaluationSocial Bias in Language Models

    Stanford University