cs.LGFeb 16, 2026

Additive Control Variates Dominate Self-Normalisation in Off-Policy Evaluation

Authors: Olivier Jeunen, Shashank Gupta

Organizations: aampe Antwerp, Belgium · Microsoft AI Bangalore, India

Abstract

Off-policy evaluation (OPE) is essential for assessing ranking and recommendation systems without costly online interventions. Self-Normalised Inverse Propensity Scoring (SNIPS) is a standard tool for variance reduction in OPE, leveraging a multiplicative control variate. Recent advances in off-policy learning suggest that additive control variates (baseline corrections) may offer superior performance, yet theoretical guarantees for evaluation are lacking. This paper provides a definitive answer: we prove that β⋆β^\star-IPS, an estimator with an optimal additive baseline, asymptotically dominates SNIPS in Mean Squared Error. By analytically decomposing the variance gap, we show that SNIPS is asymptotically equivalent to using a specific -- but generally sub-optimal -- additive baseline. Our results theoretically justify shifting from self-normalisation to optimal baseline corrections for both ranking and recommendation.

Explore similar work

CardsList
  1. Off-Policy Evaluation for Ranking Policies under Deterministic Logging Policies

    Mar 23, 2026Koichi Tanaka, Kazuki Kawamura, Takanori Muroi +6Off-Policy EvaluationInverse Probability Weighting

  2. Recommendation Ranking Off-Policy Evaluation under Ranking-Dependent Examination via Examination-Relevance Decomposition

    Sep 28, 2026Riki Okamura, Toshiharu SugawaraOff-Policy EvaluationDoubly Robust Estimation