stat.MEApr 5, 2026

Fused Multinomial Logistic Regression Utilizing Summary-Level External Machine-learning Information

Authors: Chi-Shian Dai, Jun Shao

Organizations: Department of Statistics, National Cheng Kung University, Tainan, 701, Taiwan · Department of Statistics, University of Wisconsin-Madison, Madison, 53706, USA

Abstract

In many modern applications, a carefully designed primary study provides individual-level data for interpretable modeling, while summary-level external information is available through black-box, efficient, and nonparametric machine-learning predictions. Although summary-level external information has been studied in the data integration literature, there is limited methodology for leveraging external nonparametric machine-learning predictions to improve statistical inference in the primary study. We propose a general empirical-likelihood framework that incorporates external predictions through moment constraints. An advantage of nonparametric machine-learning prediction is that it induces a rich class of valid moment restrictions that remain robust to covariate shift under a mild overlap condition without requiring explicit density-ratio modeling. We focus on multinomial logistic regression as the primary model and address common data-quality issues in external sources, including coarsened outcomes, partially observed covariates, covariate shift, and heterogeneity in generating mechanisms known as concept shift. We establish large-sample properties of the resulting fused estimator, including consistency and asymptotic normality under regularity conditions. Moreover, we provide mild sufficient conditions under which incorporating external predictions delivers a strict efficiency gain relative to the primary-only estimator. Simulation studies and an application to the National Health and Nutrition Examination Survey on multiclass blood-pressure classification.

Figures & tables

Explore similar work

CardsList
  1. Prediction-Powered Conditional Inference

    Mar 5, 2026Yang Sui, Jin Zhou, Hua Zhou +1Prediction-Powered InferenceConfidence Region Estimation

  2. Multiple-Prediction-Powered Inference

    Mar 28, 2026Charlie Cowen-Breen, Alekh Agarwal, Stephen Bates +4Prediction-Powered Inference

  3. Conformalized Super Learner

    Apr 24, 2026Zhanli Wu, Fabrizio Leisen, Miguel-Angel Luque-Fernandez +1Ensemble LearningConformal Prediction