Efficient Learning of Survival Analysis Models Under Outcome-Dependent Truncation and Censoring
Organizations: Department of Computer Science, Carnegie Mellon University, Pittsburgh, PA · Department of Surgery, Division of Cardiothoracic Surgery, Medical University of South Carolina, Charleston, SC · Additional affiliations: Strategy Robot, Inc., Strategic Machine, Inc., Optimized Markets, Inc.
Abstract
Modern machine learning models are typically trained on data assumed to be representative of the predictive tasks the model will face in the future, but practical datasets violate this assumption. We focus on outcome-dependent truncation in which an observation appears in the training data depending on its label. Our work connects two largely distinct literatures: efficient learning under truncation and survival analysis. Existing methods for truncated survival analysis do not characterize the optimization landscape and instead rely on iterative procedures such as expectation maximization. We address this gap and prove that Cox regression can be efficiently learned under truncated and right-censored data using first-order optimization when the baseline hazard is known (despite nonconvexity). In contrast, when the baseline hazard is learned jointly, we construct identifiable and correctly specified models whose negative log-likelihood contains strict suboptimal local minima. On experiments with four survival datasets, we show that accounting for truncation reduces the prediction bias induced by naive Cox regression and extends to neural networks. We also show orders of magnitude speedups compared to standard expectation maximization.
Figures & tables
| METABRIC | SUPPORT | FLCHAIN | HEARTS | |||||
|---|---|---|---|---|---|---|---|---|
| Method | Time (s) | MSE | Time (s) | MSE | Time (s) | MSE | Time (s) | MSE |
| Adam (Ours) | ||||||||
| Projected SGD (Ours) | ||||||||
| EM | ||||||||
| Method | Time (s) | MSE |
|---|---|---|
| Adam (Ours) | ||
| Projected SGD (Ours) | ||
| EM |
Appendix figures & tables3 assets
Supplementary material from the paper’s appendix.
Appendix
| Dataset | Covariates | Censoring rate | Median event time | |
|---|---|---|---|---|
| HEARTS | years | |||
| SUPPORT | days | |||
| METABRIC | months | |||
| FLCHAIN | days |
| Adam (Ours) | Projected SGD (Ours) | EM | ||||
|---|---|---|---|---|---|---|
| Time (s) | MSE | Time (s) | MSE | Time (s) | MSE | |
Survival Analysis
Survival analysis models when events such as disease progression, failure, or death occur, accounting for incomplete follow-up and censoring.
See all 106 papers