Overview

Kernel ridge regression (KRR) fits nonlinear functions in a reproducing-kernel Hilbert space by balancing data fit against a norm penalty, making predictions from similarities between examples. Work studies how kernel spectra, target smoothness, input dimension, and alignment shape learning curves, interpolation, benign overfitting, and generalization. To scale Gram-matrix methods, approaches use Nyström sampling with ridge leverage scores, random features, sketching, and preconditioned iterative solvers; other variants learn or reweight kernels or add unpenalized features. KRR is also used for dynamical systems, treatment-effect estimation, and covariate shift, while a central tension is preserving statistical guarantees and useful inductive bias as kernels and datasets become more complex.

Latest papers

CardsList

33 papers2 papers in the last four weeks, down 33% on the four weeks before. 0.0% of all new papers.

  1. Training-point consistency of kernel ridge regression with varying correlation scales

    Nov 13, 2026Weiyan Mu, Shifeng Xiong, Yuming ShenKernel Ridge RegressionKernel Methods

  2. On the Optimality of Random Features under General Conditions: Misspecified Cases and Robust Learning

    Oct 13, 2026Caixing WangRandom Feature MethodsKernel Ridge Regression

  3. BLOKS: Scaling Kernel Solvers with Sketched Block Preconditioning

    Oct 9, 2026Giordano Vitale, Giacomo Meanti, Marco Rando +2Nyström MethodKernel Ridge Regression

  4. Learning Closure of Dynamical Systems with Kernel Ridge Regression

    Oct 1, 2026Evan Habbershaw, John Harlim, Senwei LiangPDE Surrogate ModelingNonlinear System Identification

  5. Learning between the peaks: sharp asymptotics for kernel ridge regression under power-law anisotropy

    Aug 28, 2026Lorenzo Rizzi, Arie Wortsman Zurich, Bruno LoureiroKernel Ridge RegressionKernel Methods

  6. Adaptive Regularization for Random Features: A Neighboring Early-Stopping Rule with Oracle-Rate Guarantees

    Aug 26, 2026Caixing Wang, Zhibo Chen, Yue WangRandom Feature MethodsKernel Ridge Regression

  7. Functional linear regression from sparse to dense designs: a pooling-ridge method and minimax optimality

    Aug 26, 2026Shunxing Yan, Fang YaoLinear RegressionMinimax Estimation

  8. Nonparametric Goodness-of-fit Testing under Covariate Shift

    Aug 5, 2026Zhen Hou, Dong XiaKernel Ridge RegressionCovariate Shift

  9. Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression

    Jun 30, 2026Max Kreider, John Harlim, Daning HuangKernel Ridge RegressionKernel Regression

  10. Semi-Supervised Learning with Noisy Proxy Covariates: Generalization Bounds and Distribution Regression

    May 30, 2026Kwangho Kim, Jisu KimKernel Ridge RegressionDistributional Regression

  11. Perturbative methods for non-parametric instrumental variable

    May 29, 2026Wei Bu, Arthur GrettonKernel Ridge RegressionInstrumental Variable Estimation

  12. Conditional KRR: Injecting Unpenalized Features into Kernel Methods with Applications to Kernel Thresholding

    May 25, 2026Rustem Takhanov, Zhenisbek AssylbekovKernel Ridge RegressionKernel Regression

  13. Canonical Regularisation of Wide Feature-Learning Neural Networks

    May 18, 2026George Whittle, Pranav Vaidhyanathan, Juliusz Ziomek +2Kernel Ridge RegressionRepresentation Learning

  14. Average Gradient Outer Product in kernel regression provably recovers the central subspace for multi-index models

    May 14, 2026Libin Zhu, Damek Davis, Dmitriy Drusvyatskiy +1Kernel Ridge RegressionRepresentation Learning

  15. Large Dimensional Kernel Ridge Regression: Extending to Product Kernels

    May 14, 2026Yang Zhou, Yicheng Li, Yuqian Cheng +1Generalization BoundsKernel Ridge Regression

  16. On Kernel Eigen-alignments of KRR: Reconstruction and Generalization

    May 14, 2026Yang Liu, Ernest Fokoue, Richard Lange +1Kernel Ridge RegressionGeneralization Bounds

  17. Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression

    May 8, 2026Mingsong Yan, Dongyang Li, Charles Kulick +1Softmax AttentionTransformer Interpretability

  18. Differentiable Kernel Ridge Regression for Deep Learning Pipelines

    May 4, 2026Jean-Marc Mercier, Gabriele SantinKernel Ridge RegressionKernel Regression

  19. Learning Curves and Benign Overfitting of Spectral Algorithms in Large Dimensions

    Apr 25, 2026Weihao Lu, Qian Lin, Yingcun Xia +1Kernel Ridge RegressionBenign Overfitting

  20. Pack only the essentials: Adaptive dictionary learning for kernel ridge regression

    Apr 24, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoKernel Ridge RegressionKernel Regression

  21. Analysis of Nystrom method with sequential ridge leverage scores

    Apr 22, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoKernel Ridge RegressionKernel Regression

  22. Estimating Continuous Treatment Effects with Two-Stage Kernel Ridge Regression

    Apr 15, 2026Seok-Jin Kim, Kaizheng WangCausal Effect EstimationKernel Ridge Regression

  23. Loop Corrections in Random Feature Models: Training Error and Generalization Gap

    Apr 14, 2026Taeyoung KimRandom Feature MethodsKernel Ridge Regression