Language Model Debiasing

Latest papers

26 papers5 papers in the last four weeks, up 25% on the four weeks before. 0.0% of all new papers.

The Judge Can Debias Itself: Awareness and Self-Debiasing for Reliable LLM-as-a-Judge
Oct 16, 2026Youbing Yin, Jingyu Wu, Anoop Kumar +3Bias in LLM-as-a-Judge LLM-as-a-Judge
Capital One
Bias Mitigation in Audio-Enabled LLMs through Adversarial Training and Distillation Methods
Oct 15, 2026Adnan Al Ali, Jindřich Libovický, Anne LauscherAdversarial Debiasing Language Model Debiasing
Charles University, Faculty of Mathematics and Physics, Czech Republic · Trustworthy AI Lab, University of Hamburg, Germany
Latent space bias directions in LLMs capture confidence, not fairness
Oct 6, 2026Stephanie Buttigieg, Maeve Madigan, Parameswaran Kamalaruban +1Debiased ML Language Model Steering
Institute of Astronomy & Kavli Institute for Cosmology, University of Cambridge, UK · Risk and Security AI Lab, Visa Inc., Cambridge, UK
Acmite: Mitigating Gender Bias in LLMs through Concept-Guided Mutual Information
Oct 1, 2026Tian Lan, Xiaoqing Cheng, Han Zhang +1Gender Bias in Language Models Debiased ML
Kyoto University · Zhejiang University · Shanghai Jiao Tong University +1
Debias It Yourself: Teaching LLMs Cognitive Bias Mitigation Interventions
Sep 30, 2026Chahat Raj, Sina Mansouri, Aylin Caliskan +2Cognitive Bias in Language Models Language Model Debiasing
George Mason University · University of Washington
FairLMs: A Turnkey Library for Fairness in Language Models
Sep 18, 2026Jiale Zhang, Michael Larionov, Zichong Wang +2Language Model Bias Evaluation Social Bias in Language Models
Department of Biostatistics and Health Data Science Indiana University Indianapolis, IN, United States · Department of Statistics and Data Science Carnegie Mellon University Pittsburgh, PA, United States · Knight Foundation School of Computing and Information Sciences Florida International University Miami, FL, United States
The Illusion of Debiasing: Persona Steering Redistributes Rather Than Reduces Bias in LLMs
Sep 7, 2026Ziyue Feng, Hongbo Fang, James A. EvansLanguage Model Steering Language Model Debiasing
University of Chicago Chicago, IL, USA
CoCoA: Context-Conditional Cultural Alignment for Large Language Models
Aug 30, 2026Kyungdon Lee, Wei Xu, Alan Ritter +2Cultural Bias in Language Models Language Model Debiasing
Sungkyunkwan University, Suwon, South Korea · Georgia Institute of Technology, GA, USA · University of Southern California, CA, USA
Adaptive Triggering for Bias Correction in LLM Reasoning
Aug 26, 2026Nayoung Kim, Mickey Mancenido, Huan LiuLanguage Model Debiasing Demographic Bias in Language Models
School of Computing and Augmented Intelligence, Arizona State University, Tempe, AZ, USA · School of Mathematical and Natural Sciences, Arizona State University, Phoenix, AZ, USA
A Heuristic Perspective on Debiasing Language Models
Aug 1, 2026Tian Lan, Yemin Wang, Chuancheng Shi +6Social Bias in Language Models Language Model Debiasing
Inner Mongolia University · Xiamen University · University of Sydney +3
Wait, am I Being Fair? Characterizing Deductive Stereotyping and Mitigating It with Fair-GCG
Jun 30, 2026Naihao Deng, Yilun Zhu, Joan Nwatu +2Language Model Steering Social Bias in Language Models
University of Michigan
Debiasing Without Protected Attributes: Latent Concept Erasure from Textual Profiles
Jun 10, 2026Shun Shao, Zheng Zhao, Anna Korhonen +2Debiased ML Algorithmic Fairness
University of Cambridge · University of Edinburgh · University of Groningen +1
COFT: Counterfactual-Conformal Decoding for Fair Chain-of-Thought Reasoning in Large Language Models
May 28, 2026Arya Fayyazi, Mehdi Kamal, Massoud PedramSocial Bias in Language Models Counterfactual Fairness
Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, California, USA.
Side-by-side Comparison Amplifies Dialect Bias in Language Models
May 23, 2026Kritee Kondapally, Claire J. Smerdon, Pooja C. Patel +5Social Bias in Language Models Algorithmic Fairness
University of Southern California, USA
DebiasRAG: A Tuning-Free Path to Fair Generation in Large Language Models through Retrieval-Augmented Generation
May 15, 2026Rui Chu, Bingyin Zhao, Thanh Quoc Hung Le +6Retrieval-Augmented Generation Debiased ML
Decoding-Time Debiasing via Process Reward Models: From Controlled Fill-in to Open-Ended Generation
May 4, 2026Muneeb Ur Raheem KhanSocial Bias in Language Models Language Model Decoding
Lahore University of Management Sciences (LUMS)
Judging the Judges: A Systematic Evaluation of Bias Mitigation Strategies in LLM-as-a-Judge Pipelines
Apr 25, 2026Sadman Kabir SoumikDebiased ML LLM-as-a-Judge
Independent Researcher
When Bigger Isn't Better: A Comprehensive Fairness Evaluation of Political Bias in Multi-News Summarisation
Apr 23, 2026Nannan Huang, Iffat Maab, Junichi YamagishiSocial Bias in Language Models Language Model Debiasing
RMIT University, Australia · National Institute of Informatics, Tokyo, Japan
Debiasing Large Language Models toward Social Factors in Online Behavior Analytics through Prompt Knowledge Tuning
Mar 28, 2026Hossein Salemi, Jitin Krishnan, Hemant PurohitLanguage Model Debiasing Social Bias in Language Models
George Mason University, Fairfax, Virginia, United States
CatRAG: Functor-Guided Structural Debiasing with Retrieval Augmentation for Fair LLMs
Mar 23, 2026Ravi Ranjan, Utkarsh Grover, Mayur Akewar +2Language Model Debiasing Social Bias in Language Models
Florida International University Miami, USA · University of South Florida Tampa, USA
UGID: Unified Graph Isomorphism for Debiasing Large Language Models
Mar 19, 2026Zikang Ding, Junchi Yao, Junhao Li +4Language Model Debiasing Social Bias in Language Models
University of Electronic Science and Technology of China, Chengdu, China · Mohamed bin Zayed University of Artificial Intelligence, Abu Dhabi, United Arab Emirates · South China University of Technology, Guangzhou, China
Preconditioned Test-Time Adaptation for Out-of-Distribution Debiasing in Narrative Generation
Mar 14, 2026Hanwen Shen, Ting Ying, Jiajie Lu +1Narrative Generation Language Model Debiasing
Laboratory for Artificial Intelligence in Mathematics Education, Stevens Institute of Technology · Independent Researcher · NLP2CT Lab, Department of Computer and Information Science, University of Macau
Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization
Mar 9, 2026Hongli Zhou, Hui Huang, Rui Zhang +5LLM-as-a-Judge Social Bias in Language Models
Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China · School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, 518055, China
Knowing Bias, Doing Better: Mitigating Social Bias in LLMs via Know-Bias Neuron Enhancement
Jan 29, 2026Jinhao Pan, Chahat Raj, Anjishnu Mukherjee +4Debiased ML Social Bias in Language Models
Department of Computer Science, George Mason University, Fairfax, VA, USA · Lightridge High School, Aldie, VA, USA
BiasGym: A Simple and Generalizable Framework for Analyzing and Removing Biases through Injection
Aug 12, 2025Sekh Mainul Islam, Nadav Borenstein, Siddhesh Milind Pawar +3Social Bias in Language Models LLM Interpretability
University of Copenhagen
General Phrase Debiaser: Debiasing Masked Language Models at a Multi-Token Level
Nov 23, 2023Bingkang Shi, Xiaodan Zhang, Dehan Kong +4Gender Bias in Language Models Debiased ML
Chinese Academy of Sciences, Institute of Information Engineering, Beijing 100093, China · Alibaba Group, Alibaba Artificial Intelligence Governance Laboratory, Beijing, China · University of Bristol, Department of Electrical and Electronic Engineering, Bristol, BS8 1UB, UK

Oct 16, 2026J/K move · Enter open · S save

The Judge Can Debias Itself: Awareness and Self-Debiasing for Reliable LLM-as-a-Judge

Youbing Yin, Jingyu Wu, Anoop Kumar, Scott Novotney+2

Capital One

Bias in LLM-as-a-Judge LLM-as-a-Judge Evaluation Awareness in Language Models Language Model Bias Evaluation Language Model Debiasing

Open paper AskPDF arXiv

LLM-as-a-Judge systems are increasingly employed for automated evaluation, yet remain susceptible to systematic biases that undermine their reliability. We demonstrate that the judge can effectively debias itself without additional training. We propose two lightweight strategies: bias-aware prompting, which explicitly alerts the judge to potential target biases prior to evaluation, and self-debiasing, in which the judge critiques the initial judgment for bias influence. To broaden the evaluation scope, we introduce three novel benchmarks--authority bias (fabricated citations), confidence bias (assertive phrasing), and formatting bias (structured presentation)--and evaluate across seven bias types in total. Across three frontier models, self-debiasing improves performance in 20 out of 21 model-bias combinations with gains up to 15 percentage points, while bias-aware prompting also yields consistent improvements. The recent fine-tuned external critic, however, does not generalize as reliably to the newly-introduced bias types (degradation observed in 5 out of 9 cases). Our findings demonstrate that prompting a judge to reason about bias, either preemptively or retrospectively, is a robust and generalizable approach for enhancing evaluation integrity.