stat.MLOct 11, 2026

Screening Collapse under Recursive Synthetic Data

Authors: Jia Zhang, Xin Chen

Organizations: Joint Laboratory of Data Science and Business Intelligence, Southwestern University of Finance and Economics, Chengdu 611130, China · Department of Statistics and Data Science, Southern University of Science and Technology, Shenzhen 518055, China

Abstract

Recursive synthetic-data training can degrade a fitted model, but its effects on the variable-screening stage that precedes model fitting are less understood. When each generation labels data for the next, a marginal screener ranks variables against the current pseudo-label target rather than the original response. Across generations, this target drift can erode or reverse the active--inactive score margin and cause screening to discard variables that clean-label screening would retain. We call this process screening collapse. In a Gaussian linear model with minimum-norm recursive generators, we establish finite-sample screening bounds, characterize a late-generation information-loss limit, and derive a minimax impossibility result. Screening collapse can precede and compound ordinary model collapse: omitted variables incur a covariance-weighted loss that no refit restricted to the selected variables can eliminate, while recursive labels further degrade estimation on the retained variables. We also examine two approaches to mitigating screening collapse. Fixed-fraction real-label retention preserves a clean-label component but leaves resolution fixed, whereas data accumulation can avoid screening collapse if the pooled target preserves a positive margin and the growing sample resolves it. Numerical experiments on gene-expression data support the theoretical findings.

Figures & tables

Explore similar work

CardsList
  1. When Sample Selection Bias Precipitates Model Collapse

    Jun 11, 2026Xinbao Qiao, Xianglong Du, Wei Liu +4Synthetic Data PretrainingModel Collapse

  2. Escaping Model Collapse via Synthetic Data Verification: Near-term Improvements and Long-term Convergence

    Oct 18, 2025Bingji Yi, Qiyuan Liu, Yuwei Cheng +1Synthetic Data PretrainingModel Collapse

  3. Recursive Learning Without Collapse: A Weighting-Based Stabilization Framework

    Feb 25, 2025Hengzhi He, Shirong Xu, Guang ChengModel CollapseGenerative Modeling