Distributionally-Robust Policy Learning with Observational Data
Organizations: Dept. of Computer Science University of Warwick, UK
Abstract
Policy learning from observational data is fundamental to applications ranging from personalized medicine to welfare-program targeting, but standard approaches optimize empirical performance and may fail when the deployment distribution differs from the training distribution. We study distributionally-robust policy learning: given observational data, we seek a policy that maximizes the worst-case policy value over an -divergence ball of radius around the data-generating distribution. We propose an estimator built on cross-fitted doubly-robust scores for the conditional treatment effect, paired with a DRO solver that handles KL, , and CVaR ambiguity sets. We establish two convergence guarantees. First, the estimated policy attains the standard rate on its DRO regret, and inherits the doubly-robust property -- the rate continues to hold whenever either the outcome model or the propensity model is consistently estimated, even at slow nonparametric rates. We then propose a sample-splitting bias-correction algorithm derived from the Lagrangian dual, and show that under a Tsybakov-style margin condition on the treatment-effect, the estimator attains a fast rate of , interpolating between and as the margin parameter ranges over . To our knowledge, this is the first work to incorporate a margin condition into the analysis of distributionally-robust policy learning, and the first to obtain fast rates in this setting. Empirically, on synthetic and semi-synthetic experiments calibrated to a welfare-to-work program, distributional robustness yields meaningful improvements over empirical welfare maximization when training and test distributions differ.
Figures & tables
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| County | Role | |||||
|---|---|---|---|---|---|---|
| Riverside | train | 400 | 0.50 | 32 | 12.0 | 2.0 |
| San Diego | train | 400 | 0.52 | 34 | 12.5 | 2.4 |
| Tulare | train | 400 | 0.48 | 36 | 11.0 | 1.6 |
| Alameda | test | 1500 | 0.50 | 33 | 12.2 | 2.5 |
| Butte | test | 1500 | 0.55 | 35 | 11.5 | 1.8 |
| Los Angeles | test | 1500 | 0.45 | 34 | 10.6 | 2.1 |
| County | Role | ||||
|---|---|---|---|---|---|
| Riverside | train | ||||
| San Diego | train | ||||
| Tulare | train | ||||
| Alameda | test | ||||
| Butte | test | ||||
| Los Angeles | test |
Policy Learning
Policy learning develops decision rules that choose actions or interventions to maximize outcomes from data, feedback, or interaction.
See all 484 papers