Outstrumental Variable Regression
Organizations: Seminar for Statistics, ETH Zurich · ETH AI Center, ETH Zurich
Abstract
Estimating the causal effect of a treatment on an outcome from observational data in the presence of unobserved confounding requires additional structure or assumptions. Existing identification strategies such as instrumental variable regression exploit exogenous variation in only the treatment. We show that the causal effect can also be identified if the outcome mechanism varies across a finite set of environments, even if the treatment distribution is unchanged. Concretely, we introduce Outstrumental Variable Regression (OVR), which proceeds in three steps: (i) compute the conditional expectation of given in each environment; (ii) form the vector of differences in these conditional expectations between all environments and a reference environment (we call this vector contrast); and (iii) regress on while adjusting for the contrast and environment. We prove that this yields the true causal effect if the following two conditions hold: inclusion restriction, i.e., the contrast determines the conditional confounding bias; and positivity, i.e., the treatment varies sufficiently strongly after adjustment. We prove that a finite-sample version of OVR is consistent under regularity conditions and demonstrate the procedure's effectiveness on synthetic and real-world data.
Figures & tables
| Smoothed OVR | OLS | FE | Anchor ( ) | LNN |
|---|---|---|---|---|
Appendix figures & tables5 assets
Supplementary material from the paper’s appendix.
Appendix
| Added component | Lower error | |||
|---|---|---|---|---|
| Contrast-head regularization | ||||
| Validation and early stopping | ||||
| Disjoint split ensemble ( ) | ||||
| Uncertainty smoothing ( ) |
| Method | Reference distance | Mean | Minimum |
|---|---|---|---|
| DOVR | |||
| SOVR | |||
| OLS | — | — | |
| FE | — | — | |
| Anchor ( ) | — | — | |
| LNN | — | — |
Causal Effect Estimation
Causal effect estimation measures how outcomes would change under interventions, using experiments or observational data and explicit assumptions.
See all 277 papers