Language Model Bias Evaluation

Ask about this topic

Momentum

40 papers in the last four weeks, up 122% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 321

All topics
CardsList

  1. Not Your Typical Sycophant: The Elusive Nature of Sycophancy in Large Language Models

    Jan 21, 2026Shahar Ben-Natan, Oren TsurLLM EvaluationLLM Sycophancy

    Computer and Information Science Ben Gurion University

  2. A Scalable Entity-Based Framework for Auditing Bias in Large Language Models

    Jan 18, 2026Akram Elbouanani, Aboubacar Tuo, Adrian PopescuLLM AuditingPolitical Bias in Language Models

    Université Paris-Saclay, CEA, List, F-91120, Palaiseau, France

  3. The Language You Ask In: Language-Conditioned Ideological Divergence in LLM Analysis of Contested Political Documents

    Jan 17, 2026Oleg SmirnovMultilingual Language Model EvaluationPolitical Bias in Language Models

    Microsoft / Stockholm, Sweden

  4. Preserving Fairness and Safety in Quantized LLMs Through Critical Weight Protection

    Jan 17, 2026Muhammad Alif Al Hakim, Alfan Farizki Wicaksono, Fajri KotoLLM QuantizationMultilingual Language Model Evaluation

    Faculty of Computer Science, Universitas Indonesia · Mohamed bin Zayed University of Artificial Intelligence

  5. Epistemic Constitutionalism Or: how to avoid coherence bias

    Jan 16, 2026Michele LoiAI GovernanceLanguage Model Bias Evaluation

    University of Milan

  6. Behavioral Coherence: A Method for Sensitive-Domain LLM Evaluation

    Dec 15, 2025Anika Sharma, Malavika Mampally, Chidaksh Ravuru +2Language Model Bias EvaluationDemographic Bias in Language Models

    Society-Centered AI Lab UNC Chapel Hill, USA · School of Nursing UNC Chapel Hill, USA

  7. Evaluating Implicit Biases in LLM Reasoning through Logic Grid Puzzles

    Nov 8, 2025Fatima Jahara, Mark Dredze, Sharon LevyGender Bias in Language ModelsLanguage Model Bias Evaluation

    Rutgers University · Johns Hopkins University

  8. Large Language Models Develop Novel Social Biases Through Adaptive Exploration

    Nov 8, 2025Addison J. Wu, Ryan Liu, Xuechunzi Bai +1Social Bias in Language ModelsLanguage Model Bias Evaluation

    1Princeton University · University

  9. Adaptive Generation of Bias-Eliciting Questions for LLMs

    Oct 14, 2025Robin Staab, Jasper Dekoninck, Maximilian Baader +1Social Bias in Language ModelsLanguage Model Bias Evaluation

    1ETH Zurich, Switzerland · 2Snyk, Zurich, Switzerland

  10. Camellia: Benchmarking Cultural Biases in LLMs for Asian Languages

    Oct 6, 2025Tarek Naous, Anagha Savit, Carlos Rafael Catalan +17Multilingual Language Model EvaluationCultural Bias in Language Models

    Georgia Institute of Technology · Samsung R&D Institute Philippines · Sungkyunkwan University +6

  11. When LLMs Benchmark Themselves: Deconstructing Self-Bias in Automated Evaluation

    Sep 30, 2025Wenda Xu, Sweta Agrawal, Vilém Zouhar +2LLM EvaluationLanguage Model Generation Evaluation

    Google · ETH Zurich

  12. Breaking the Mirror: Activation-Based Mitigation of Self-Preference in LLM Evaluators

    Sep 3, 2025Dani Roytburg, Matthew Bozoukov, Matthew Nguyen +3LLM-as-a-JudgeLanguage Model Steering

    School of Computer Science Carnegie Mellon University Pittsburgh, PA 15213 · Martian Research San Francisco, CA, 94105

  13. Political Ideology Shifts in Large Language Models

    Aug 22, 2025Pietro Bernardelle, Stefano Civelli, Leon Fröhling +3Political Bias in Language ModelsLanguage Model Bias Evaluation

    The University of Queensland, Brisbane, Australia · GESIS, Cologne, Germany · University of Udine, Udine, Italy

  14. BiasGym: A Simple and Generalizable Framework for Analyzing and Removing Biases through Injection

    Aug 12, 2025Sekh Mainul Islam, Nadav Borenstein, Siddhesh Milind Pawar +3Social Bias in Language ModelsLLM Interpretability

    University of Copenhagen

  15. Man Made Language Models? Evaluating LLMs' Perpetuation of Masculine Generics Bias

    Feb 14, 2025Enzo Doyen, Amalia TodirascuGender Bias in Language ModelsLanguage Model Bias Evaluation

    University of Strasbourg

  16. FairCoder: Probing LLM Bias in High-Stakes Decision Making via Coding Tasks

    Jan 9, 2025Yongkang Du, Jen-tse Huang, Jieyu Zhao +1Social Bias in Language ModelsAlgorithmic Fairness

    Pennsylvania State University · University of Southern California

  17. Homogeneity Bias in Open-Weight LLMs Is Robust to Decoding Hyperparameters

    Jan 4, 2025Messi H. J. LeeSocial Bias in Language ModelsOpen-Weight Language Models

    Independent Researcher · Seoul, Republic of Korea

  18. BTBR: A Bayesian-Theory-Driven Probabilistic-Fuzzy Framework for Implicit Bias Removal in Large Language Models

    Aug 20, 2024Yongxin Deng, Xiaoyu Tan, Jing Pan +3Social Bias in Language ModelsLanguage Model Bias Evaluation

    University of Technology Sydney · School of Computer Science, University of Technology Sydney, Sydney, NSW 2007, Australia · National University of Singapore +3

  19. GPTBIAS: A Comprehensive Framework for Evaluating Bias in Large Language Models

    Dec 11, 2023Jiaxu Zhao, Meng Fang, Shirui Pan +2Language Model Bias EvaluationAutomated Evaluation

    Mathematics and Computer Science · Eindhoven University of Technology · Eindhoven, Netherlands +9

  20. Alignment Reduces Expressed but Not Encoded Gender Bias: A Unified Framework and Study

    Date pendingNour Bouchouchi, Thibault Laugel, Xavier Renard +3Gender Bias in Language ModelsLLM Alignment

    Sorbonne Université, CNRS, LIP6, F-75005 Paris, France · AXA, Paris, France · Polish Academy of Science, IBS PAN, Warsaw, Poland

  21. Left-Branching Transformers Excel at Right-Branching Languages: Data Shapes Word Order Preferences in Language Models

    Date pendingVarvara Arzt, Allan Hanbury, Terra BlevinsMultilingual Language ModelsDecoder-Only Language Models

    Faculty of Informatics, TU Wien · Khoury College of Computer Sciences, Northeastern University