Orthogonal machine learning for conditional odds and risk ratios
Organizations: Division of Biostatistics, Department of Population Health, New York University Grossman School of Medicine, New York, NY, USA
Abstract
Conditional effects are commonly used measures for understanding how treatment effects vary across different groups, and are often used to target treatments/interventions to groups who benefit most. In this work we review existing methods and propose novel ones, focusing on the odds ratio (OR) and the risk ratio (RR). While estimation of the conditional average treatment effect (ATE) has been widely studied, estimators for the OR and RR lag behind, and cutting edge estimators such as those based on doubly robust transformations or orthogonal risk functions have not been generalized to these parameters. We propose such a generalization here, focusing on the DR-learner and the R-learner. We derive orthogonal risk functions for the OR and RR and show that the associated pseudo-outcomes satisfy second-order conditional-mean remainder properties analogous to the ATE case. We also evaluate estimators for the conditional ATE, OR, and RR in a comprehensive nonparametric Monte Carlo simulation study to compare them with common alternatives under hundreds of different data-generating distributions. Our numerical studies provide empirical guidance for choosing an estimator. For instance, they show that while parametric models are useful in very simple settings, the proposed nonparametric estimators significantly reduce bias and mean squared error in the more complex settings expected in the real world. We illustrate the methods in the analysis of physical activity and sleep trouble in U.S. adults using data from the National Health and Nutrition Examination Survey (NHANES). The results demonstrate that our estimators uncover substantial treatment effect heterogeneity that is obscured by traditional regression approaches and lead to improved treatment decision rules, highlighting the importance of data-adaptive methods for advancing precision health research.
Figures & tables
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 10 (6–21) | 6 (2–15) | 4 (3–5) |
| LR-T | 29 (22–37) | 1 (1–5) | 27 (22–32) |
| SL | 9 (5–17) | 4 (2–12) | 4 (3–5) |
| SL-T | 26 (21–29) | 3 (2–5) | 21 (19–24) |
| R-CATE | 67 (57–77) | 3 (2–5) | 63 (54–73) |
| DR-P | 45 (32–56) | 1 (1–3) | 43 (30–52) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 4 (3–5) | 0 (0–0) | 4 (3–5) |
| LR-T | 25 (18–33) | 0 (0–1) | 25 (18–31) |
| SL | 3 (2–4) | 0 (0–0) | 3 (2–3) |
| SL-T | 22 (18–26) | 1 (1–2) | 21 (17–24) |
| R-CATE | 59 (45–73) | 1 (1–2) | 58 (42–71) |
| DR-P | 36 (23–50) | 0 (0–1) | 35 (22–50) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 8 (3–17) | 6 (2–15) | 2 (1–2) |
| LR-T | 12 (9–17) | 1 (0–4) | 11 (8–13) |
| SL | 6 (3–12) | 4 (1–8) | 2 (1–3) |
| SL-T | 12 (9–16) | 1 (1–3) | 11 (8–13) |
| R-CATE | 34 (28–48) | 2 (1–3) | 32 (27–44) |
| DR-P | 19 (13–24) | 1 (0–2) | 18 (12–22) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 2 (1–2) | 0 (0–0) | 1 (1–2) |
| LR-T | 10 (6–14) | 0 (0–0) | 10 (6–12) |
| SL | 1 (1–2) | 0 (0–0) | 1 (1–2) |
| SL-T | 10 (7–13) | 0 (0–1) | 10 (7–13) |
| R-CATE | 27 (22–40) | 0 (0–1) | 26 (21–39) |
| DR-P | 15 (9–21) | 0 (0–0) | 15 (8–21) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 7 (3–16) | 6 (2–15) | 1 (1–1) |
| LR-T | 6 (4–10) | 1 (0–4) | 5 (4–6) |
| SL | 5 (2–8) | 3 (1–7) | 1 (1–2) |
| SL-T | 7 (5–10) | 1 (0–2) | 6 (4–8) |
| R-CATE | 19 (15–27) | 1 (1–2) | 18 (14–25) |
| DR-P | 10 (7–13) | 1 (0–2) | 9 (6–12) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 1 (1–1) | 0 (0–0) | 1 (1–1) |
| LR-T | 5 (3–7) | 0 (0–0) | 5 (3–6) |
| SL | 1 (1–1) | 0 (0–0) | 1 (1–1) |
| SL-T | 6 (4–8) | 0 (0–0) | 6 (3–8) |
| R-CATE | 15 (11–23) | 0 (0–1) | 14 (10–22) |
| DR-P | 8 (5–11) | 0 (0–0) | 8 (4–11) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 6 (2–16) | 6 (2–15) | 0 (0–1) |
| LR-T | 4 (2–7) | 1 (0–4) | 3 (2–3) |
| SL | 3 (2–7) | 2 (1–5) | 1 (1–1) |
| SL-T | 4 (3–6) | 1 (0–2) | 3 (2–5) |
| R-CATE | 11 (8–16) | 1 (0–2) | 10 (7–14) |
| DR-P | 5 (3–8) | 0 (0–1) | 5 (3–6) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 0 (0–1) | 0 (0–0) | 0 (0–0) |
| LR-T | 2 (2–4) | 0 (0–0) | 2 (2–3) |
| SL | 1 (0–1) | 0 (0–0) | 0 (0–1) |
| SL-T | 3 (2–5) | 0 (0–0) | 3 (2–4) |
| R-CATE | 8 (5–13) | 0 (0–0) | 8 (5–13) |
| DR-P | 4 (2–6) | 0 (0–0) | 4 (2–6) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 29 (19–42) | 24 (14–37) | 5 (5–6) |
| LR-T | 51 (45–63) | 17 (10–29) | 34 (32–36) |
| SL | 21 (13–33) | 15 (9–28) | 5 (4–6) |
| SL-T | 41 (34–50) | 15 (9–22) | 25 (22–28) |
| R-CATE | 74 (65–81) | 8 (4–12) | 63 (56–70) |
| DR-P | 64 (56–69) | 8 (5–13) | 53 (49–58) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 7 (6–13) | 2 (0–8) | 5 (4–6) |
| LR-T | 39 (35–46) | 5 (2–12) | 34 (32–36) |
| SL | 5 (4–6) | 1 (0–2) | 4 (3–5) |
| SL-T | 29 (25–40) | 5 (2–10) | 26 (23–29) |
| R-CATE | 59 (53–65) | 1 (1–2) | 57 (51–62) |
| DR-P | 54 (50–59) | 1 (1–3) | 53 (49–57) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 27 (16–40) | 25 (14–38) | 2 (2–2) |
| LR-T | 30 (24–43) | 16 (10–29) | 14 (13–15) |
| SL | 16 (10–27) | 13 (8–22) | 3 (2–4) |
| SL-T | 25 (21–32) | 9 (6–13) | 15 (14–17) |
| R-CATE | 39 (32–46) | 5 (3–9) | 32 (27–38) |
| DR-P | 31 (25–35) | 5 (3–8) | 24 (21–28) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 4 (2–10) | 2 (0–8) | 2 (2–2) |
| LR-T | 18 (15–26) | 5 (2–12) | 13 (13–14) |
| SL | 2 (2–4) | 0 (0–1) | 2 (2–2) |
| SL-T | 18 (15–22) | 2 (1–5) | 15 (13–17) |
| R-CATE | 26 (22–30) | 0 (0–1) | 25 (22–29) |
| DR-P | 24 (20–28) | 1 (0–1) | 23 (20–27) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 26 (15–39) | 25 (14–38) | 1 (1–1) |
| LR-T | 23 (17–35) | 16 (10–28) | 7 (6–7) |
| SL | 13 (8–22) | 11 (6–19) | 2 (2–3) |
| SL-T | 16 (12–20) | 6 (4–9) | 10 (8–11) |
| R-CATE | 23 (18–28) | 4 (2–6) | 17 (15–21) |
| DR-P | 18 (15–20) | 4 (2–6) | 14 (12–16) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 3 (1–10) | 3 (0–9) | 1 (1–1) |
| LR-T | 11 (8–19) | 5 (1–13) | 7 (6–7) |
| SL | 1 (1–2) | 0 (0–1) | 1 (1–1) |
| SL-T | 11 (9–14) | 1 (1–3) | 9 (8–11) |
| R-CATE | 13 (11–17) | 0 (0–0) | 13 (10–16) |
| DR-P | 13 (11–16) | 0 (0–1) | 13 (10–15) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 25 (14–38) | 24 (14–38) | 1 (0–1) |
| LR-T | 19 (13–32) | 16 (9–29) | 3 (3–4) |
| SL | 11 (6–17) | 9 (5–15) | 1 (1–2) |
| SL-T | 10 (8–13) | 4 (3–6) | 6 (5–7) |
| R-CATE | 15 (11–17) | 3 (2–5) | 11 (9–13) |
| DR-P | 11 (9–13) | 2 (1–4) | 8 (7–9) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 3 (1–9) | 2 (0–9) | 0 (0–1) |
| LR-T | 8 (5–16) | 5 (1–12) | 3 (3–3) |
| SL | 1 (1–1) | 0 (0–0) | 1 (0–1) |
| SL-T | 7 (5–8) | 1 (0–2) | 6 (4–6) |
| R-CATE | 7 (5–10) | 0 (0–0) | 7 (5–10) |
| DR-P | 8 (6–10) | 0 (0–0) | 8 (6–9) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 35 (20–50) | 31 (15–44) | 5 (4–5) |
| LR-T | 54 (44–70) | 20 (10–37) | 34 (32–36) |
| SL | 26 (16–41) | 19 (11–36) | 5 (4–7) |
| SL-T | 44 (34–60) | 19 (10–33) | 25 (22–29) |
| R-CATE | 77 (69–91) | 13 (7–21) | 64 (58–71) |
| DR-P | 67 (59–77) | 14 (7–22) | 53 (49–57) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 8 (6–18) | 3 (0–13) | 5 (4–5) |
| LR-T | 40 (36–51) | 6 (2–16) | 34 (32–36) |
| SL | 6 (4–10) | 2 (0–5) | 4 (4–6) |
| SL-T | 33 (25–41) | 7 (2–14) | 25 (22–29) |
| R-CATE | 62 (57–71) | 2 (1–6) | 57 (53–65) |
| DR-P | 58 (52–65) | 4 (1–8) | 53 (50–56) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 31 (16–46) | 29 (15–44) | 2 (2–2) |
| LR-T | 34 (24–50) | 20 (10–37) | 13 (13–14) |
| SL | 21 (13–35) | 15 (9–32) | 4 (3–5) |
| SL-T | 32 (24–41) | 15 (8–24) | 16 (14–19) |
| R-CATE | 42 (35–51) | 9 (5–15) | 32 (29–37) |
| DR-P | 36 (30–43) | 9 (5–15) | 26 (23–28) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 5 (2–15) | 3 (0–13) | 2 (2–2) |
| LR-T | 19 (15–30) | 6 (2–17) | 13 (12–14) |
| SL | 4 (2–7) | 1 (0–3) | 2 (2–3) |
| SL-T | 20 (15–30) | 4 (1–11) | 15 (14–19) |
| R-CATE | 28 (26–33) | 1 (1–3) | 26 (24–30) |
| DR-P | 28 (23–33) | 2 (1–5) | 25 (22–29) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 30 (15–45) | 29 (14–44) | 1 (1–1) |
| LR-T | 27 (17–43) | 20 (10–37) | 7 (6–7) |
| SL | 16 (10–31) | 14 (8–28) | 2 (2–3) |
| SL-T | 22 (17–31) | 11 (7–18) | 11 (9–13) |
| R-CATE | 26 (21–32) | 7 (4–11) | 19 (16–23) |
| DR-P | 23 (19–27) | 6 (4–11) | 15 (13–17) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 4 (1–14) | 3 (0–13) | 1 (1–1) |
| LR-T | 12 (8–24) | 6 (2–17) | 6 (6–7) |
| SL | 2 (1–5) | 1 (0–2) | 2 (1–2) |
| SL-T | 14 (10–22) | 3 (1–8) | 10 (9–13) |
| R-CATE | 15 (13–18) | 1 (0–1) | 13 (12–16) |
| DR-P | 16 (13–20) | 1 (0–3) | 15 (12–17) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 30 (15–46) | 29 (14–45) | 1 (0–1) |
| LR-T | 24 (13–40) | 21 (10–37) | 3 (3–3) |
| SL | 13 (8–23) | 11 (6–21) | 2 (1–2) |
| SL-T | 15 (11–21) | 8 (5–13) | 7 (5–8) |
| R-CATE | 17 (13–22) | 5 (3–8) | 11 (10–14) |
| DR-P | 14 (11–16) | 4 (3–6) | 9 (8–10) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 4 (1–14) | 3 (0–13) | 0 (0–1) |
| LR-T | 9 (5–20) | 6 (2–16) | 3 (3–3) |
| SL | 1 (1–2) | 0 (0–1) | 1 (1–1) |
| SL-T | 9 (7–14) | 2 (1–5) | 6 (6–8) |
| R-CATE | 8 (6–11) | 0 (0–1) | 7 (6–10) |
| DR-P | 10 (8–12) | 1 (0–1) | 9 (7–10) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 387 (301–554) | 223 (106–395) | 157 (123–197) |
| LR-T | 1108 (1003–1194) | 59 (34–123) | 1007 (906–1084) |
| SL | 318 (246–464) | 196 (119–337) | 123 (99–152) |
| SL-T | 867 (669–1017) | 123 (80–184) | 727 (516–872) |
| R-LOR | 3017 (2465–3761) | 114 (72–178) | 2878 (2405–3624) |
| DR-P | 1644 (1475–1858) | 63 (44–98) | 1585 (1408–1775) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 176 (142–212) | 4 (2–13) | 173 (134–202) |
| LR-T | 1028 (927–1140) | 17 (12–31) | 1000 (905–1111) |
| SL | 134 (101–165) | 12 (4–27) | 113 (88–137) |
| SL-T | 832 (655–969) | 42 (21–79) | 791 (593–890) |
| R-LOR | 3123 (2348–3899) | 63 (35–148) | 3045 (2312–3724) |
| DR-P | 1505 (1293–1739) | 20 (15–30) | 1476 (1281–1715) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 284 (201–463) | 218 (105–388) | 58 (46–87) |
| LR-T | 499 (419–563) | 41 (23–108) | 415 (331–494) |
| SL | 245 (172–353) | 163 (94–277) | 77 (62–99) |
| SL-T | 477 (402–520) | 64 (37–98) | 387 (309–454) |
| R-LOR | 1809 (1249–2356) | 71 (44–108) | 1736 (1161–2280) |
| DR-P | 732 (654–825) | 38 (23–80) | 688 (624–755) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 79 (61–98) | 3 (1–10) | 73 (53–93) |
| LR-T | 438 (371–519) | 11 (6–18) | 407 (355–501) |
| SL | 73 (57–93) | 6 (2–13) | 64 (52–79) |
| SL-T | 428 (360–497) | 16 (10–27) | 402 (352–474) |
| R-LOR | 1853 (1187–2492) | 28 (15–72) | 1833 (1172–2405) |
| DR-P | 685 (582–774) | 10 (7–14) | 674 (577–758) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 251 (153–419) | 220 (104–391) | 30 (22–42) |
| LR-T | 284 (236–329) | 37 (18–107) | 197 (163–267) |
| SL | 202 (135–279) | 145 (80–224) | 55 (43–66) |
| SL-T | 298 (256–332) | 41 (24–81) | 238 (196–281) |
| R-LOR | 1025 (670–1434) | 52 (29–75) | 960 (605–1386) |
| DR-P | 415 (367–477) | 28 (18–69) | 371 (342–424) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 41 (31–55) | 3 (1–10) | 34 (24–50) |
| LR-T | 237 (184–281) | 7 (4–14) | 222 (171–262) |
| SL | 45 (35–55) | 4 (1–8) | 39 (31–47) |
| SL-T | 262 (219–297) | 9 (5–16) | 246 (212–285) |
| R-LOR | 1012 (592–1489) | 17 (9–35) | 997 (584–1470) |
| DR-P | 374 (313–440) | 7 (4–10) | 370 (309–436) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 236 (132–408) | 215 (105–396) | 15 (11–21) |
| LR-T | 174 (140–205) | 39 (18–105) | 98 (79–136) |
| SL | 152 (103–215) | 109 (72–179) | 37 (29–47) |
| SL-T | 187 (162–208) | 32 (15–64) | 147 (124–165) |
| R-LOR | 587 (379–844) | 39 (24–60) | 564 (335–772) |
| DR-P | 238 (204–284) | 25 (12–57) | 206 (176–236) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 24 (17–34) | 3 (1–7) | 18 (13–27) |
| LR-T | 128 (98–163) | 6 (3–13) | 111 (83–153) |
| SL | 27 (20–34) | 3 (1–6) | 24 (18–28) |
| SL-T | 157 (128–184) | 5 (3–11) | 149 (124–174) |
| R-LOR | 611 (303–883) | 11 (5–18) | 599 (297–871) |
| DR-P | 213 (171–250) | 4 (3–6) | 207 (165–243) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 736 (505–927) | 621 (363–839) | 115 (100–127) |
| LR-T | 1306 (1142–1656) | 442 (256–714) | 896 (812–962) |
| SL | 501 (379–773) | 392 (278–677) | 110 (87–141) |
| SL-T | 943 (780–1302) | 388 (252–550) | 565 (467–700) |
| R-LOR | 2405 (2060–2872) | 211 (133–324) | 2181 (1771–2627) |
| DR-P | 1886 (1719–2095) | 222 (146–335) | 1678 (1500–1808) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 180 (135–298) | 51 (10–172) | 118 (104–136) |
| LR-T | 1033 (918–1213) | 129 (43–284) | 893 (821–951) |
| SL | 121 (95–169) | 22 (8–54) | 92 (77–124) |
| SL-T | 722 (564–1004) | 104 (48–225) | 575 (501–813) |
| R-LOR | 2136 (1724–2681) | 37 (26–58) | 2078 (1682–2622) |
| DR-P | 1702 (1533–1886) | 41 (27–81) | 1647 (1508–1792) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 650 (431–861) | 606 (379–821) | 43 (39–50) |
| LR-T | 752 (573–1005) | 421 (247–703) | 326 (301–349) |
| SL | 433 (308–689) | 356 (236–634) | 68 (56–87) |
| SL-T | 656 (506–806) | 249 (169–367) | 366 (304–465) |
| R-LOR | 1140 (955–1551) | 163 (107–254) | 984 (759–1277) |
| DR-P | 895 (800–1031) | 155 (107–234) | 738 (638–844) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 98 (57–224) | 51 (11–184) | 43 (38–50) |
| LR-T | 438 (357–602) | 111 (37–282) | 318 (291–352) |
| SL | 68 (54–95) | 15 (5–31) | 52 (44–61) |
| SL-T | 443 (368–602) | 56 (27–110) | 366 (316–493) |
| R-LOR | 884 (692–1307) | 18 (12–24) | 858 (668–1278) |
| DR-P | 732 (638–887) | 21 (12–37) | 717 (614–841) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 628 (401–845) | 606 (379–826) | 21 (19–24) |
| LR-T | 562 (407–826) | 406 (256–684) | 155 (142–170) |
| SL | 358 (258–620) | 308 (218–563) | 47 (39–59) |
| SL-T | 437 (364–502) | 182 (124–253) | 237 (197–293) |
| R-LOR | 689 (578–968) | 143 (102–216) | 538 (423–734) |
| DR-P | 543 (476–619) | 111 (78–157) | 421 (354–496) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 74 (35–216) | 52 (12–194) | 21 (18–23) |
| LR-T | 264 (198–425) | 104 (34–275) | 152 (140–173) |
| SL | 41 (33–57) | 9 (3–21) | 30 (27–36) |
| SL-T | 292 (234–369) | 35 (19–78) | 250 (200–308) |
| R-LOR | 474 (355–713) | 11 (7–15) | 466 (344–700) |
| DR-P | 415 (347–524) | 14 (8–22) | 401 (341–499) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 618 (396–852) | 608 (384–843) | 11 (10–12) |
| LR-T | 485 (321–725) | 411 (247–658) | 75 (69–84) |
| SL | 309 (222–495) | 272 (192–438) | 36 (29–46) |
| SL-T | 285 (249–331) | 131 (97–177) | 151 (129–171) |
| R-LOR | 463 (383–584) | 123 (81–161) | 325 (243–503) |
| DR-P | 339 (302–382) | 78 (59–122) | 254 (208–300) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 60 (23–188) | 49 (9–179) | 11 (10–12) |
| LR-T | 184 (119–341) | 96 (29–257) | 74 (68–85) |
| SL | 27 (22–37) | 4 (2–12) | 21 (17–25) |
| SL-T | 189 (148–223) | 25 (13–49) | 155 (129–186) |
| R-LOR | 283 (201–450) | 8 (5–12) | 277 (192–438) |
| DR-P | 261 (212–312) | 8 (5–12) | 254 (206–294) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 884 (499–1216) | 773 (401–1094) | 111 (94–126) |
| LR-T | 1446 (1186–1892) | 518 (285–989) | 881 (822–978) |
| SL | 691 (442–959) | 550 (328–844) | 107 (90–148) |
| SL-T | 1060 (831–1446) | 485 (277–805) | 555 (487–689) |
| R-LOR | 2395 (2097–2970) | 333 (173–525) | 2044 (1804–2378) |
| DR-P | 2011 (1766–2373) | 356 (194–647) | 1666 (1514–1799) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 202 (140–379) | 82 (11–255) | 116 (98–132) |
| LR-T | 1118 (945–1324) | 175 (54–378) | 903 (819–976) |
| SL | 147 (100–223) | 38 (7–104) | 98 (78–125) |
| SL-T | 724 (561–976) | 164 (39–285) | 557 (480–689) |
| R-LOR | 2130 (1733–2601) | 69 (33–129) | 2021 (1639–2432) |
| DR-P | 1743 (1597–1951) | 87 (34–192) | 1623 (1536–1718) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 784 (434–1119) | 742 (395–1072) | 44 (40–50) |
| LR-T | 821 (599–1260) | 498 (268–938) | 321 (300–357) |
| SL | 622 (376–852) | 490 (299–789) | 79 (65–119) |
| SL-T | 750 (576–1102) | 407 (220–646) | 365 (309–509) |
| R-LOR | 1256 (1056–1646) | 260 (148–432) | 964 (769–1282) |
| DR-P | 1035 (868–1342) | 275 (147–420) | 783 (661–913) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 133 (58–296) | 79 (9–255) | 42 (38–50) |
| LR-T | 500 (366–664) | 149 (39–338) | 321 (289–352) |
| SL | 100 (61–164) | 32 (6–85) | 63 (48–90) |
| SL-T | 504 (353–701) | 102 (30–230) | 366 (304–474) |
| R-LOR | 978 (733–1336) | 35 (15–82) | 894 (671–1242) |
| DR-P | 830 (695–1002) | 52 (17–120) | 741 (661–903) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 743 (410–1074) | 726 (389–1054) | 21 (18–23) |
| LR-T | 647 (417–1075) | 490 (265–921) | 154 (143–170) |
| SL | 511 (323–778) | 428 (261–710) | 60 (47–94) |
| SL-T | 576 (423–835) | 329 (182–512) | 253 (206–357) |
| R-LOR | 807 (642–1125) | 218 (127–363) | 563 (428–824) |
| DR-P | 677 (526–905) | 201 (124–303) | 467 (364–580) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 96 (33–272) | 72 (10–252) | 21 (18–23) |
| LR-T | 315 (201–486) | 145 (40–335) | 154 (139–170) |
| SL | 66 (40–123) | 20 (5–59) | 43 (34–60) |
| SL-T | 345 (243–519) | 81 (26–206) | 251 (203–329) |
| R-LOR | 531 (379–763) | 20 (12–47) | 494 (345–710) |
| DR-P | 482 (403–687) | 34 (13–93) | 453 (381–584) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 744 (403–1091) | 735 (393–1081) | 11 (10–12) |
| LR-T | 567 (329–1004) | 485 (260–928) | 74 (69–84) |
| SL | 383 (260–675) | 329 (228–630) | 44 (33–58) |
| SL-T | 430 (301–610) | 250 (139–400) | 166 (135–222) |
| R-LOR | 558 (456–830) | 182 (117–287) | 371 (270–587) |
| DR-P | 451 (342–577) | 140 (87–206) | 307 (226–390) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 85 (23–246) | 75 (11–238) | 10 (9–12) |
| LR-T | 230 (120–414) | 150 (38–340) | 74 (69–81) |
| SL | 46 (30–81) | 13 (5–40) | 30 (24–40) |
| SL-T | 232 (169–351) | 61 (23–141) | 171 (140–217) |
| R-LOR | 302 (227–498) | 12 (8–25) | 288 (218–479) |
| DR-P | 314 (253–443) | 25 (10–51) | 298 (238–383) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 148 (118–218) | 82 (45–152) | 64 (50–76) |
| LR-T | 409 (374–458) | 23 (15–47) | 386 (344–419) |
| SL | 118 (87–185) | 81 (45–131) | 45 (36–57) |
| SL-T | 312 (255–358) | 41 (28–66) | 255 (209–309) |
| R-LRR | 1026 (819–1163) | 60 (35–113) | 961 (755–1095) |
| DR-P | 603 (519–698) | 28 (17–41) | 564 (489–662) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 74 (56–87) | 2 (1–6) | 70 (52–81) |
| LR-T | 381 (327–427) | 8 (5–13) | 371 (319–408) |
| SL | 51 (38–65) | 5 (2–13) | 45 (32–53) |
| SL-T | 297 (229–344) | 13 (7–25) | 280 (206–324) |
| R-LRR | 1056 (797–1253) | 25 (12–90) | 1010 (773–1129) |
| DR-P | 517 (416–628) | 9 (7–13) | 504 (409–617) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 107 (77–172) | 85 (43–150) | 26 (18–34) |
| LR-T | 197 (170–223) | 16 (10–41) | 167 (135–194) |
| SL | 92 (67–142) | 58 (36–107) | 29 (25–40) |
| SL-T | 179 (148–205) | 24 (15–39) | 145 (118–171) |
| R-LRR | 660 (448–836) | 34 (24–62) | 622 (410–770) |
| DR-P | 294 (247–341) | 16 (10–27) | 271 (237–312) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 33 (23–43) | 2 (0–5) | 30 (20–39) |
| LR-T | 183 (141–209) | 5 (2–8) | 175 (133–199) |
| SL | 30 (22–39) | 3 (1–7) | 26 (20–34) |
| SL-T | 165 (127–192) | 6 (3–11) | 157 (123–184) |
| R-LRR | 694 (451–912) | 12 (6–50) | 676 (440–826) |
| DR-P | 258 (215–310) | 4 (3–7) | 250 (212–302) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 99 (62–161) | 84 (42–151) | 13 (9–17) |
| LR-T | 111 (92–133) | 16 (8–40) | 85 (66–102) |
| SL | 73 (52–112) | 51 (31–82) | 21 (16–27) |
| SL-T | 115 (96–135) | 16 (10–26) | 92 (78–110) |
| R-LRR | 387 (263–534) | 27 (17–43) | 373 (240–504) |
| DR-P | 167 (144–195) | 13 (8–23) | 150 (134–181) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 17 (11–24) | 1 (0–4) | 14 (9–21) |
| LR-T | 100 (71–117) | 4 (2–6) | 90 (66–109) |
| SL | 18 (13–24) | 2 (0–4) | 16 (11–19) |
| SL-T | 104 (76–121) | 3 (2–6) | 98 (75–117) |
| R-LRR | 411 (237–574) | 8 (4–22) | 405 (233–558) |
| DR-P | 146 (118–184) | 3 (2–5) | 144 (116–177) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 92 (55–159) | 85 (43–152) | 6 (4–9) |
| LR-T | 67 (54–85) | 15 (7–41) | 42 (31–55) |
| SL | 56 (42–80) | 42 (29–65) | 15 (12–19) |
| SL-T | 73 (62–84) | 12 (6–22) | 57 (49–68) |
| R-LRR | 236 (154–341) | 24 (12–33) | 210 (133–312) |
| DR-P | 95 (82–115) | 10 (6–19) | 85 (72–101) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 10 (7–15) | 1 (0–4) | 7 (5–12) |
| LR-T | 53 (38–69) | 3 (1–6) | 45 (31–62) |
| SL | 11 (8–15) | 1 (0–4) | 10 (7–12) |
| SL-T | 64 (46–74) | 2 (1–4) | 61 (44–71) |
| R-LRR | 228 (128–363) | 5 (2–10) | 220 (127–352) |
| DR-P | 81 (65–103) | 2 (1–3) | 78 (63–100) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 227 (171–321) | 186 (123–280) | 40 (32–51) |
| LR-T | 462 (400–565) | 151 (91–238) | 302 (253–377) |
| SL | 177 (113–260) | 139 (80–219) | 37 (26–50) |
| SL-T | 316 (259–412) | 115 (83–183) | 193 (136–257) |
| R-LRR | 789 (622–958) | 74 (50–117) | 714 (535–871) |
| DR-P | 664 (591–761) | 73 (52–120) | 587 (506–661) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 70 (50–102) | 20 (5–59) | 42 (36–52) |
| LR-T | 378 (311–435) | 39 (17–87) | 314 (266–363) |
| SL | 45 (31–60) | 9 (3–20) | 33 (25–42) |
| SL-T | 234 (182–327) | 28 (14–71) | 193 (154–266) |
| R-LRR | 689 (581–857) | 13 (9–21) | 655 (564–844) |
| DR-P | 592 (515–687) | 15 (10–23) | 567 (500–636) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 207 (145–290) | 187 (123–278) | 15 (12–20) |
| LR-T | 268 (208–341) | 142 (88–233) | 108 (88–140) |
| SL | 154 (96–214) | 125 (75–191) | 24 (18–31) |
| SL-T | 222 (175–273) | 80 (58–120) | 127 (97–175) |
| R-LRR | 432 (321–572) | 59 (40–93) | 363 (242–470) |
| DR-P | 322 (275–389) | 57 (36–74) | 270 (223–322) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 36 (25–71) | 18 (5–58) | 15 (12–20) |
| LR-T | 157 (130–204) | 33 (11–83) | 112 (92–133) |
| SL | 27 (20–35) | 5 (2–12) | 19 (15–24) |
| SL-T | 159 (118–203) | 16 (9–41) | 131 (98–177) |
| R-LRR | 346 (253–500) | 7 (5–11) | 339 (246–489) |
| DR-P | 279 (214–327) | 8 (5–13) | 269 (208–312) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 196 (135–284) | 188 (123–278) | 7 (6–9) |
| LR-T | 201 (144–274) | 142 (89–226) | 53 (42–70) |
| SL | 133 (84–193) | 115 (69–171) | 16 (13–23) |
| SL-T | 153 (126–181) | 62 (44–90) | 80 (63–118) |
| R-LRR | 261 (204–355) | 55 (39–84) | 207 (141–290) |
| DR-P | 197 (164–239) | 39 (27–59) | 154 (125–194) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 27 (14–70) | 17 (5–63) | 7 (6–9) |
| LR-T | 93 (70–134) | 32 (11–83) | 53 (44–64) |
| SL | 16 (12–22) | 3 (1–9) | 12 (9–14) |
| SL-T | 108 (81–135) | 13 (7–25) | 91 (68–111) |
| R-LRR | 200 (146–280) | 5 (3–8) | 196 (137–272) |
| DR-P | 163 (126–195) | 5 (3–8) | 160 (122–187) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 192 (129–279) | 188 (126–274) | 4 (3–5) |
| LR-T | 168 (112–244) | 139 (89–223) | 25 (20–35) |
| SL | 111 (71–157) | 99 (57–142) | 13 (9–19) |
| SL-T | 100 (88–122) | 47 (32–66) | 52 (41–70) |
| R-LRR | 176 (132–239) | 49 (34–71) | 129 (86–185) |
| DR-P | 123 (106–154) | 29 (19–43) | 91 (75–121) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 24 (10–64) | 20 (5–61) | 4 (3–5) |
| LR-T | 60 (42–99) | 30 (10–81) | 27 (21–32) |
| SL | 11 (8–15) | 2 (1–6) | 8 (6–10) |
| SL-T | 68 (52–83) | 9 (4–15) | 56 (43–70) |
| R-LRR | 120 (83–183) | 3 (2–7) | 116 (79–176) |
| DR-P | 99 (78–118) | 3 (2–5) | 96 (75–115) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 252 (173–401) | 221 (133–360) | 41 (32–52) |
| LR-T | 526 (445–661) | 195 (104–302) | 316 (254–384) |
| SL | 214 (146–339) | 176 (111–285) | 40 (29–54) |
| SL-T | 360 (286–486) | 163 (99–264) | 189 (152–239) |
| R-LRR | 792 (658–969) | 117 (70–178) | 667 (530–835) |
| DR-P | 725 (621–829) | 137 (68–193) | 572 (526–654) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 81 (53–120) | 30 (5–72) | 42 (34–50) |
| LR-T | 404 (341–496) | 52 (20–110) | 323 (261–380) |
| SL | 52 (38–75) | 15 (4–33) | 36 (28–51) |
| SL-T | 242 (191–331) | 42 (16–98) | 182 (152–253) |
| R-LRR | 693 (551–891) | 23 (13–48) | 664 (531–848) |
| DR-P | 619 (577–718) | 27 (14–52) | 579 (508–663) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 229 (147–370) | 217 (130–356) | 16 (13–19) |
| LR-T | 289 (238–415) | 179 (102–277) | 117 (90–143) |
| SL | 192 (125–290) | 158 (99–261) | 29 (22–44) |
| SL-T | 263 (210–372) | 130 (79–199) | 131 (103–176) |
| R-LRR | 469 (356–599) | 98 (62–134) | 375 (248–470) |
| DR-P | 393 (308–481) | 93 (54–142) | 302 (236–344) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 44 (24–92) | 26 (5–76) | 15 (12–18) |
| LR-T | 174 (137–245) | 45 (15–108) | 111 (90–137) |
| SL | 37 (25–56) | 11 (3–28) | 24 (19–35) |
| SL-T | 171 (126–250) | 36 (12–71) | 127 (98–186) |
| R-LRR | 366 (264–529) | 12 (8–28) | 345 (249–502) |
| DR-P | 317 (260–387) | 18 (8–38) | 290 (232–349) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 219 (138–362) | 214 (130–354) | 7 (6–9) |
| LR-T | 226 (163–337) | 174 (103–272) | 54 (42–68) |
| SL | 165 (111–251) | 145 (90–228) | 22 (16–34) |
| SL-T | 204 (156–294) | 112 (65–161) | 91 (69–130) |
| R-LRR | 321 (232–430) | 88 (58–125) | 222 (143–319) |
| DR-P | 258 (195–328) | 70 (46–109) | 182 (136–230) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 33 (16–81) | 24 (4–77) | 7 (6–9) |
| LR-T | 109 (77–161) | 43 (16–108) | 52 (41–66) |
| SL | 24 (19–43) | 8 (2–23) | 17 (12–24) |
| SL-T | 129 (89–185) | 25 (10–57) | 93 (69–134) |
| R-LRR | 215 (149–322) | 8 (6–15) | 206 (137–297) |
| DR-P | 203 (150–265) | 12 (6–31) | 181 (136–229) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 213 (134–358) | 210 (129–355) | 4 (3–5) |
| LR-T | 197 (134–310) | 170 (101–274) | 26 (20–34) |
| SL | 144 (93–219) | 127 (79–193) | 18 (13–25) |
| SL-T | 148 (114–218) | 89 (54–133) | 66 (44–83) |
| R-LRR | 215 (165–345) | 74 (51–110) | 132 (93–242) |
| DR-P | 174 (124–220) | 47 (33–71) | 115 (83–157) |
| Estimator | iMSE (IQR) | iBias 2 (IQR) | iVar (IQR) |
|---|---|---|---|
| LR | 27 (11–78) | 24 (5–74) | 4 (3–5) |
| LR-T | 71 (50–125) | 42 (16–101) | 26 (21–31) |
| SL | 18 (12–29) | 5 (2–14) | 12 (9–16) |
| SL-T | 89 (61–123) | 19 (8–38) | 64 (47–87) |
| R-LRR | 133 (82–203) | 6 (3–10) | 131 (80–195) |
| DR-P | 126 (97–172) | 8 (4–16) | 117 (93–156) |
Causal Effect Estimation
Causal effect estimation measures how outcomes would change under interventions, using experiments or observational data and explicit assumptions.
See all 264 papers