stat.MLFeb 11, 2026

Deep Bootstrap

Authors: Jinyuan Chang, Yuling Jiao, Lican Kang, Junjie Shi

Organizations: Joint Laboratory of Data Science and Business Intelligence, Southwestern University of Finance and Economics, Chengdu, Sichuan 611130, China. · State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences, Beijing 100190, China. · School of Artificial Intelligence, Hubei Key Laboratory of Computational Science, Wuhan University, Wuhan 430072, China. · Institute for Math and AI, Hubei Key Laboratory of Computational Science, School of Artificial Intelligence, Wuhan University, Wuhan 430072, China. · 

Abstract

In this work, we propose a novel deep bootstrap framework for nonparametric regression based on conditional diffusion models. Specifically, we construct a conditional diffusion model to learn the distribution of the response variable given the covariates. This model is then used to generate bootstrap samples by pairing the original covariates with newly synthesized responses. We reformulate nonparametric regression as conditional sample mean estimation, which is implemented directly via the learned conditional diffusion model. Unlike traditional bootstrap methods that decouple the estimation of the conditional distribution, sampling, and nonparametric regression, our approach integrates these components into a unified generative framework. With the expressive capacity of diffusion models, our method facilitates both efficient sampling from high-dimensional or multimodal distributions and accurate nonparametric estimation. We establish rigorous theoretical guarantees for the proposed method. In particular, we derive optimal end-to-end convergence rates in the Wasserstein distance between the learned and target conditional distributions. Building on this foundation, we further establish the convergence guarantees of the resulting bootstrap procedure. Numerical studies demonstrate the effectiveness and scalability of our approach for complex regression tasks.

Figures & tables

Explore similar work

CardsList
  1. Transfer Learning in Nonparametric Regression with Deep ReLU Networks

    Aug 20, 2026Junpeng Ren, Carlos Misael Madrid Padilla, Yanzhen Chen +1Transfer LearningNonparametric Regression

  2. Conditional Diffusion for Nonparametric Instrumental Variable Quantile Regression

    Aug 8, 2026Xingdong Feng, Xinhong Jiang, Yuling Jiao +2Quantile RegressionNonparametric Regression

  3. Adaptive deep nonparametric regression from dependent data under covariate shift

    Jul 22, 2026William Kengne, Ehud Mossa OckegnaQuantile RegressionCovariate Shift