stat.MLJun 19, 2026

Subsampling for supervised learning in reproducing kernel Hilbert spaces

Authors: Eyal VaynessMaxime Sangnier

Organizations: Sorbonne Universit´e, LPSM, Paris, France

Abstract

In the era of big data, subsampling became a common practice in statistical learning. By selecting a subgroup of individuals based on which the learner is trained, subsampling aims at reducing the computational cost and time of the estimation step, and ideally leads to a decrease of its energy consumption and carbon footprint. This work focuses on a nonparametric setting, in which the hypotheses set lies in a reproducing kernel Hilbert space, and the estimator is a minimizer of an empirical risk reweighted à la Horvitz-Thompson. By studying the asymptotic properties of this estimator, we reveal an optimal subsampling scheme (regarding the trace of the covariance operator) and show that it can be used via plug-in. A numerical study on synthetic and real-world datasets shows the practicability and the benefit of the proposed approach.

Explore similar work

CardsList
  1. Analysis of Nystrom method with sequential ridge leverage scores

    Apr 22, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoKernel Ridge RegressionEstimators