stat.MLMay 19, 2026

Density-Ratio Losses for Post-Hoc Learning to Defer

Authors: Alexander SoenRagnar ThobabenJoakim JaldénRichard Nock

Organizations: KTH⋄ · Google Research†

Abstract

We study post-hoc Learning to Defer (L2D) through the lens of ideal distributions: divergence-regularized reweightings of the data distribution under which a model attains low loss. We define deferral via the density-ratio between a model's and an expert's ideals. Using the reduction from density-ratio estimation to class-probability estimation, we derive the DR CPE losses for post-hoc L2D scorers. Deferral decisions are then made by thresholding the scorer, allowing deferral rates to be adjusted without retraining. For KL-based ideal distributions, our deferral rules recovers Chow's rule under the original distribution and a connection to an expert-tilted Bayes posterior -- which incorporates the expert's performance -- depending on if the ideal distributions are joint or marginal distributions. Experimentally, our approach is competitive compared to common baselines and more robust across dataset settings. More broadly, our results cast post-hoc L2D as density-ratio learning between ideal distributions, bridging Chow-style rules, expert comparison, and elucidating connections to related learning settings including anomaly detection.

Explore similar work

CardsList
  1. Online Learning-to-Defer with Varying Experts

    May 12, 2026Dang Hoang Duy, Yannis Montreuil, Maxime Meyer +3Learning-Augmented AlgorithmsExperts

  2. Optimized Deferral for Imbalanced Settings

    Apr 30, 2026Corinna Cortes, Anqi Mao, Mehryar Mohri +1Extreme Class Imbalance