Symmetries of Counterfactuals: Identification and Testability of Counterfactual Maps from Covariate Heterogeneity
Authors: Marc Braun, Adel Daoud, Jose M. Peña
Organizations: Department of Computer and Information Science, Linköping University · Institute for Analytical Sociology, Linköping University · Chalmers University of Technology
In general, counterfactuals are not identified from data alone, because many causal models produce the same observed distributions but different counterfactuals. A common approach to circumvent this problem is to restrict the mechanism to a class in which it becomes unique, such as triangular monotone maps or optimal transport maps. However, whether the assumed class is correct is usually not examined. In this work, we study what the data can tell us when covariates are available that influence the outcome only through its latent cause. First, we characterise all counterfactual maps that are consistent with the data. They differ from the true map by a group of symmetries that preserve the conditional outcome distributions given the covariates. The more these distributions vary across covariate values, the smaller the group. Second, we show that for the classes above, consistency with the data is equivalent to a single conditional independence, which yields a test of the assumed class. We illustrate both results on synthetic data and on the ACTG 175 HIV trial.
Figures & tables
Figure 1: Causal graph of our setup. The latent variable U is drawn as a dashed node. The dashed edge between U and V denotes that they may be dependent.
Figure 2: The transport map T0→1f=f1∘f0−1 pushes Y∣\doop(A=0) forward to Y∣\doop(A=1) (a). Conditioning on V does not change the map, but it must now also push each conditional distribution Y∣\doop(A=0),V=v to Y∣\doop(A=1),V=v for every v (b, shaded regions). The more these conditional distributions vary with v , the fewer maps satisfy the constraint.
Figure 3: Intuition for (ii) of Theorem 11 . (a) Since U⊥⊥A∣V , both conditionals Y∣A=a,V=v are images of the same latent distribution. (b) Pulled back with h , they must therefore coincide. Requiring this for every v is the independence of Theorem 11 (ii). In the example in (b) they do not coincide, so an eventual hypothesis test will likely be rejected.
Figure 4: Observed distributions for the three different settings when K=4 coloured by v . (a) shows ν0,v which is equal in all settings. (b–d) show ν1,v for the three settings. Larger points denote the means of νa,v .
Figure 5: Identified sets in the synthetic example (Setting 2) for an increasing number of sectors K . The background shows the conditional distributions ν0,v , coloured by v . Three factual points y , and the identified set of the counterfactual of each y : the whole plane for K=1 , two points for K=2 , and the single point S2y for K=4 .
Figure 6: (a) Rejection rate of the ci test against ρ for three combinations of true outcome function and hypothesised model class and three sample sizes. (b) The conditional distributions ν0,v for two values of ρ .
Figure 7: Pulled-back conditional means of the observed ZDV outcome (circles) and the observed ZDV+ddI outcome (crosses), coloured by V , for the three hypothesised classes (a–c) and the reflected Brenier map TR (d). A data-consistent map must pull back each treated mean onto its untreated counterpart (compare Figure 3 (b)). The reflection does not achieve that.
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
Figure 8: ACTG 175 outcomes. (a) Standardised log CD4 and CD8 counts at week 20 by arm. (b) The ZDV arm coloured by V . Circles mark the conditional means E[Y∣A=0,V=v] . (c) Shift of the conditional means from ZDV ( A=0 ) to ZDV+ddI ( A=1 ).
Figure 9: Estimated counterfactual maps T0→1hC from ZDV to ZDV+ddI for the three hypothesised model classes, drawn as arrows on a grid over the ZDV sample.
Figure 10: p -value of the ci test for the hypotheses hθ , which transport η to ν1 for every θ but rotate the treated latents by θ . Outside the shown window p<10−8 for all three classes.