stat.MLMar 25, 2026

Beyond Consistency: Inference for the Relative risk functional in Deep Nonparametric Cox Models

Authors: Sattwik Ghosal, Xuran Meng, Yi Li

Organizations: Department of Biostatistics, University of Michigan

Abstract

There remain theoretical gaps in deep neural network estimators for the nonparametric Cox proportional hazards model. In particular, it is unclear how gradient-based optimization error propagates to population risk under partial likelihood, how pointwise bias can be controlled to permit valid inference, and how ensemble-based uncertainty quantification behaves under realistic variance decay regimes. We develop an asymptotic distribution theory for deep Cox estimators that addresses these issues. First, we establish nonasymptotic oracle inequalities for general trained networks that link in-sample optimization error to population risk without requiring the exact empirical risk optimizer. We then construct a structured neural parameterization that achieves infinity-norm approximation rates compatible with the oracle bound, yielding control of the pointwise bias. Under these conditions and using the Hajek--Hoeffding projection, we prove pointwise and multivariate asymptotic normality for subsampled ensemble estimators. We derive a range of subsample sizes that balances bias correction with the requirement that the Hajek--Hoeffding projection remain dominant. This range accommodates decay conditions on the single-overlap covariance, which measures how strongly a single shared observation influences the estimator, and is weaker than those imposed in the subsampling literature. An infinitesimal jackknife representation provides analytic covariance estimation and valid Wald-type inference for relative risk contrasts such as log-hazard ratios. Finally, we illustrate the finite-sample implications of the theory through simulations and a real data application.

Figures & tables

Explore similar work

Dec 11, 2025

FLEXI-Haz: Semiparametric Deep Survival Inference Beyond Proportional Hazards

Flexible survival prediction does not by itself ensure valid inference for covariate effects or subject-specific survival probabilities. We develop FLEXI-Haz, a semiparametric deep neural network model for right-censored data that combines an interpretable linear component in the log-hazard with a flexible function of time and adjustment covariates. This formulation permits nonproportional nuisance effects while retaining interpretable regression parameters. Under regularity conditions, we establish nuisance convergence rates that are minimax optimal up to logarithmic factors over composite Holder classes, together with root-n-consistent, asymptotically normal, and semiparametrically efficient estimation of the regression parameter. For adjustment covariates with finite support, we derive the explicit influence function for cumulative hazard and construct a cross-fitted one-step estimator yielding asymptotically valid pointwise confidence intervals for subject-specific survival. Simulations demonstrate reduced bias and improved coverage relative to a proportional hazards comparator under time-varying nuisance effects. An analysis of the Rotterdam breast cancer data illustrates the consequences of flexible adjustment for inference on treatment associations.
Oct 14, 2024

Statistical Properties of Deep Neural Networks with Dependent Data

This paper develops theory for deep neural network (DNN) estimators under dependent data. To provide theory applicable to a variety of DNN-based estimators, I first establish nonasymptotic probability bounds on the theoretical and empirical L2\mathcal{L}^{2}-errors of nonparametric sieve estimators for a general class of estimation problems under possibly nonstationary ββ-mixing data taking values in unbounded sets. I then apply the theory to fully connected and convolutional DNN estimators without bounds or sparsity restrictions on the DNN weights. For both DNN classes, I derive general results when the function to be estimated is Hölder smooth and the data are nonstationary, subgaussian, and ββ-mixing with either exponential or polynomial decay. I then specialize these to nonparametric regression, logistic regression, and quantile regression settings. Under exponential ββ-mixing, the resulting estimators attain the nonparametric minimax rate of Stone (1982) up to logarithmic factors.
May 15, 2026

Isotonic Survival Regression: Calibrated Survival Distributions from Deep Cox Models

Time-to-event data is widespread across the life sciences and engineering, but it is typically encountered together with censoring, which complicates the application of standard machine learning methods. Deep Cox models have emerged as a popular method for analyzing time-to-event data because they gracefully handle censoring and can be used with unstructured data such as clinical text reports, genomic sequences, and pathology images. However, their predicted survival probabilities are often poorly calibrated, thus limiting their practical utility. In this paper, we propose a novel post hoc calibration method for Deep Cox models that uses isotonic regression to refine predicted survival probabilities without affecting discriminative power. We establish favorable theoretical guarantees, including a double-robustness property and asymptotic calibration. Experiments on synthetic and real-world clinical data demonstrate the empirical effectiveness of our method.