LLM Judge Calibration

LLM: Large Language Model

Latest papers

CardsList

9 papers2 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. AutoRefine: Auto-Calibrating Code Judges from Workflow Outcomes

    Nov 6, 2026Shervin Shahidi, James Poon, Hang Xie +5LLM Judge CalibrationLLM-as-a-Judge

  2. How to post-train on a surrogate: Envelope sampling mitigates reward hacking

    Oct 8, 2026Sanjit Dandapanthula, Shuvom Sadhuka, Samir Khan +3LLM Judge CalibrationRL Post-Training

  3. Debiasing as a Measurement Intervention: Calibrated Ties and Resolution Loss in LLM-as-a-Judge Evaluation

    Sep 11, 2026Liang Zhao, Yong Wang, Jiangzhe ChenLLM-as-a-JudgeLLM Agent Evaluation

  4. DA-RAC: Distance-Aware Calibration of LLM Judges for Trustworthy AI Auditing

    Aug 15, 2026Cheng Wu, Vishal Anand, Jaya Krishna Mandivarapu +2LLM Judge CalibrationGenerative AI Evaluation

  5. A Finite-Calibration Regime Map for LLM Judge Panels

    May 31, 2026Bin Zhu, Yanghui RaoLLM-as-a-JudgeLLM Judge Calibration

  6. Noise-Response Calibration: A Causal Intervention Protocol for LLM-Judges

    Mar 17, 2026Maxim Khomiakov, Jes FrellsenLLM Judge CalibrationLanguage Model Calibration

  7. Benchmarking Code LLM-as-a-Judge via Constrained Perturbation and Calibration

    Dec 23, 2025Ruiqi Wang, Xinchen Wang, Cuiyun Gao +3LLM Judge CalibrationLLM-as-a-Judge