The Digital Twin Counterfactual Framework: A Validation Architecture for Simulated Potential Outcomes
Abstract
The fundamental problem of causal inference - that the counterfactual outcome for any individual is never observed - has shaped the entire methodology of the field. Every existing approach substitutes assumptions for missing data: ignorability, parallel trends, exclusion restrictions. None produces the counterfactual itself. This paper proposes the Digital Twin Counterfactual Framework (DTCF): rather than estimating the counterfactual statistically, we simulate it using a digital twin and subject the simulation to a hierarchical validation regime. We formalize the digital twin simulator as a stochastic mapping within the potential outcomes framework and introduce a hierarchy of twin fidelity assumptions - from marginal fidelity through joint fidelity to structural fidelity - each unlocking a progressively richer class of estimands. The central contribution is threefold. First, a five-level validation architecture converts the unfalsifiable claim that the simulator produces correct counterfactuals into falsifiable tests against observable data. Second, a formal decomposition separates causal quantities into those that are marginally validated (ATE, CATE, QTE - testable through observable-arm comparison) and those that are copula-dependent (the ITE distribution, probability of benefit/harm, variance of treatment effects - permanently reliant on the unobservable within-individual dependence structure). Third, bounding, sensitivity, and uncertainty quantification tools make the copula dependence explicit. The DTCF does not resolve the fundamental problem of causal inference. What it provides is a framework in which marginal causal claims become increasingly testable, joint causal claims become explicitly assumption-indexed, and the gap between the two is formally characterized.
Figures & tables
| Treatment arm ( ) | Control arm ( ) | |
|---|---|---|
| Simulated | ||
| Real-world |
| Assumption | Formal Condition | Estimands Identified | Testability |
|---|---|---|---|
| SUTVA | No interference, no hidden treatment variants | All (baseline) | Untestable |
| -Fidelity (Def. 3) | ATE, ATT, ATU, CATE, QTE | Testable (Levels 0–3) | |
| Joint Twin Fidelity (Asm. 2) | ITE distribution, , , Var( ), PC | Marginals testable; copula not | |
| Structural Fidelity (Asm. 3) | Correct conditionals along causal paths | NDE, NIE, path-specific effects | Partially testable per component |
| Sequential Twin Fidelity (Asm. 4) | Correct one-step-ahead conditionals over time | DTR values, optimal regime identification | Testable per step; composition untestable |
| Estimand | Fidelity Required | Validation Level | Copula-Dependent? | Classically Identified? |
|---|---|---|---|---|
| ATE | -Fidelity | L1, L3 | No | Yes |
| ATT | -Fidelity | L1 | No | Yes |
| ATU | -Fidelity | L1 | No | Yes |
| CATE | -Fidelity | L1 | No | Yes |
| QTE | -Fidelity | L1 | No | Partially |
| GATES | Joint (for ranking) | L1, L4 | Ranking: yes | Yes (not ranking) |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Symbol | Definition |
|---|---|
| Finite population of individuals | |
| Covariate vector for individual | |
| Treatment indicator | |
| Potential outcomes under treatment and control | |
| Observed outcome: | |
| Individual treatment effect |
| Level | Test | Statistic | Value | Threshold | Pass/Fail |
|---|---|---|---|---|---|
| 0 | Marginal KS (treated) | — | — | ||
| 0 | Marginal KS (control) | — | — | ||
| 1 | Conditional KS (max) | — | — | ||
| 2 | RMSPE | — | — | domain-specific | — |
| 2 | Calibration slope | — | — | ||
| 3 | ATE discrepancy | — | -test | — |
Counterfactual Evaluation
Counterfactual evaluation tests how models, explanations, and policies behave under hypothetical changes to inputs, evidence, actions, or environments.
See all 96 papers