Estimating Continuous Treatment Effects with Two-Stage Kernel Ridge Regression
Organizations: Department of IEOR, Columbia University · Department of IEOR and Data Science Institute, Columbia University
Abstract
We study the problem of estimating the effect function for a continuous treatment, which maps each treatment value to a population-averaged outcome. A central challenge in this setting is confounding: treatment assignment often depends on covariates, creating selection bias that makes direct regression of the response on treatment unreliable. To address this issue, we propose a two-stage kernel ridge regression method. In the first stage, we learn a model for the response as a function of both treatment and covariates; in the second stage, we use this model to construct pseudo-outcomes that correct for distribution shift, and then fit a second model to estimate the treatment effect. Although the response varies with both treatment and covariates, the induced effect function obtained by averaging over covariates is typically much simpler, and our estimator adapts to this structure. Our optimal learning bounds are achieved without estimating the conditional treatment density, thereby bypassing a major bottleneck in existing methods. Furthermore, we introduce a fully data-driven model selection procedure that achieves provable adaptivity to both the unknown degree of overlap and the spectral decay of the underlying kernel.
Figures & tables
| Method | ||
| Ours | 6.22 (0.32) | 8.40 (0.35) |
| Plug-in | 9.87 (0.31) | 11.81 (0.28) |
| Direct Regression | 14.52 (0.31) | 14.84 (0.36) |
| Method | Mean MISE (SE) |
| Ours | 1.2466 (0.1209) |
| Plug-in LOOCV | 1.6197 (0.1146) |
| Direct Regression | 1.6970 (0.1264) |
| DML (GRF) | 2.4230 (0.1837) |
| DML (NN) | 2.1065 (0.1454) |
| DML (LASSO) | 2.8732 (0.2391) |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Notation | Description |
| Design operator of | |
| Design operator of | |
| Feature mean, defined as | |
| Empirical feature mean, defined as | |
| Design operator of | |
| Vector of responses ( ) |
| Notation | Definition / Description |
| Design operator of in | |
| Design operator of in | |
| Sampled treatments from for estimating | |
| Sampled treatments from for estimating |
Causal Effect Estimation
Causal effect estimation measures how outcomes would change under interventions, using experiments or observational data and explicit assumptions.
See all 263 papers