cs.AIMar 5, 2026

Towards Provably Unbiased LLM Judges via Bias-Bounded Evaluation

Authors: Benjamin Feuer, Lucas Rosenblatt, Oussama Elachqar

Organizations: 1Stanford University · 3New York University

Read PDF
Ask AI
Cite

Copy citation

DOINot available for this paper

Abstract

As AI models progress beyond simple chatbots into more complex workflows, we draw ever closer to the event horizon beyond which AI systems will be utilized in autonomous, self-maintaining feedback loops. Any autonomous AI system will depend on automated, verifiable rewards and feedback; in settings where ground truth is sparse or non-deterministic, one practical source of such rewards is an LLM-as-a-Judge. Although LLM judges continue to improve, the literature has yet to introduce systems capable of enforcing standards with strong guarantees, particularly when bias vectors are unknown or adversarially discovered. To remedy this issue, we propose average bias-boundedness (A-BB), an algorithmic framework which formally guarantees reductions of harm/impact as a result of any measurable bias in an LLM judge. Evaluating on Arena-Hard-Auto with four LLM judges, we achieve (tau=0.5, delta=0.01) bias-bounded guarantees while retaining 61-99% correlation with original rankings across formatting and schematic bias settings, with most judge-bias combinations exceeding 80%. The code to reproduce our findings is available at https://github.com/penfever/bias-bounded-evaluation.

Figures & tables

Figure 1: Bias-bounded evaluation constrains the impact of harms in judge scoring. This before-and-after visualization of the score distributions from an LLM judge (Likert-scale) on the popular Arena-Hard-Auto benchmark shows how true uncertainty can be captured via a compacted score distribution. After the average bias-boundedness (A-BB) algorithm is applied, the original integer-valued score are transformed into a debiased, continuous trajectory which accurately represents the measured uncertainty of the evaluation. The plot shows a KDE density map of the score distribution before and after transformation, with a conservative τ=0.5,δ=0.03,dim=500\tau=0.5,\delta=0.03,\texttt{dim}=500 , averaged across a panel of four judges.
Figure 2: Bias-bounded transformation for formatting sensitivity. The blue line in this figure corresponds to the debiased ranking generated by a QwQ-32B judge after using BBE with τ=0.5\tau=0.5 to control formatting sensitivity. Even with low τ\tau tolerance, we are able to retain 88% correlation with the original judgments in this realistic perturbation setting.
Figure 3: Bias-bounded evaluation in schematic sensitivity. Even when measured bias is large, we are able to eliminate much potentially biased variance while retaining near-perfect correlation with the original judgments.( τ=0.5\tau=0.5 )
Figure 4: Correlative strength varies by judge and by dataset. Although conservative aggregation strategies are always more difficult to debias, and simpler biases such as formatting are consistently easier to debias, other factors, such as the underlying dataset, can also have large effects.
PropertyToEA-BB
Guarantees on all evaluations✗✓
Handles unknown biases †✗∼\bm{\sim}
No human labels required✗✓
General scoring (beyond pairwise)✗✓
Bounds bias impact directly✗✓
Human agreement guarantee ‡✓∼\bm{\sim}
Table 1: Comparison of our Average Bias-Boundedness (A-BB) with the best known existing framework for guaranteeing LLM judgments, Trust or Escalate (ToE).

Explore similar work

CardsList

  1. Accounting for Bias Enables Sustainable LLM Evaluation

    Sep 25, 2026Harshita Katoch, David Antony Selby, Gerrit Großmann +1LLM EvaluationBias in LLM-as-a-Judge

    Department of Computer Science, University of Kaiserslautern–Landau (RPTU), Germany · Data Science and its Applications, German Research Centre for Artificial Intelligence (DFKI), Germany

  2. FairJudge: An Adaptive, Debiased, and Consistent LLM-as-a-Judge

    Feb 6, 2026Bo Yang, Lanfei Feng, Yunkui Chen +3LLM EvaluationLLM-as-a-Judge

    College of Computer Science, Zhejiang University, Hangzhou, China · School of Software Technology, Zhejiang University, Hangzhou, China

  3. Toward Robust LLM-Based Judges: Taxonomic Bias Evaluation and Debiasing Optimization

    Mar 9, 2026Hongli Zhou, Hui Huang, Rui Zhang +5LLM-as-a-JudgeSocial Bias in Language Models

    Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China · School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, 518055, China