cs.LGFeb 21, 2026

CaliCausalRank: Calibrated Multi-Objective Ad Ranking with Robust Counterfactual Utility Optimization

Authors: Xikai Yang, Sebastian Sun, Yilin Li, Yue Xing, Ming Wang, Yang Wang

Organizations: Columbia University, New York, USA · University of Wisconsin-Madison, Madison, USA · Carnegie Mellon University, Pittsburgh, USA · University of Pennsylvania, Philadelphia, USA · 

Abstract

Ad ranking systems must simultaneously optimize multiple objectives including click-through rate (CTR), conversion rate (CVR), revenue, and user experience metrics. However, production systems face critical challenges: score scale inconsistency across traffic segments undermines threshold transferability, and position bias in click logs causes offline-online metric discrepancies. We propose CaliCausalRank, a unified framework that integrates training-time scale calibration, constraint-based multi-objective optimization, and robust counterfactual utility estimation. Our approach treats score calibration as a first-class training objective rather than post-hoc processing, employs Lagrangian relaxation for constraint satisfaction, and utilizes variance-reduced counterfactual estimators for reliable offline evaluation. Experiments on the Criteo and Avazu datasets demonstrate that CaliCausalRank achieves 1.1% relative AUC improvement, 31.6% calibration error reduction, and 3.2% utility gain compared to the best baseline (PairRank) while maintaining consistent performance across different traffic segments.

Explore similar work

CardsList
  1. MARCO: Click-Intent Decomposition for Calibrated Ads Conversion Prediction

    Aug 11, 2026Shiwen Shen, Xiru Huang, Liang Luo +32Probability CalibrationOnline Advertising

  2. Calibrated Preference Learning: The Case of Label Ranking

    May 28, 2026Santo M. A. R. Thies, Viktor Bengs, Timo Kaufmann +2Probability CalibrationLearning to Rank

  3. CAIRO: Decoupling Order from Scale in Regression

    Feb 16, 2026Harri Vanhems, Yue Zhao, Peng Shi +1Robust RegressionTabular Regression