Overview

Kernel regression predicts outputs by comparing inputs with a kernel, often fitting a smooth function in a reproducing kernel Hilbert space through kernel ridge regression or gradient-based methods. Researchers study how kernel spectra, regularization, noise, and data structure affect prediction and inference, while methods such as Nyström approximation and random features reduce computational costs. Learned and compositional kernels extend these methods to structured, high-dimensional data and settings including dynamical systems, physics-informed learning, and distribution shift. A central tension is that fixed kernels offer tractable guarantees but can be computationally expensive or poorly matched to complex targets, motivating adaptive kernels and comparisons with feature-learning neural networks.

Latest papers

CardsList

36 papers2 papers in the last four weeks, against 1 the four weeks before. 0.0% of all new papers.

  1. Calibrated Functional Prediction from Overlapping Nonlinear Observations

    Nov 16, 2026Peida LiKernel RegressionAlgorithmic Auditing

  2. Tight Sequential Confidence Intervals for Online Kernel Regression

    Nov 15, 2026Haichen Hu, David Simchi-LeviKernel RegressionConfidence Estimation

  3. pESTO: Iterative p-greedy kernel regression with risk-driven Early STOpping

    Nov 5, 2026L. Bruni Bruno, P. Massa, E. Perracchione +1Kernel RegressionKernel Methods

  4. Sparse Calibration-Based Personalization of Kernel-Based Gait Phase and Speed Estimation Using Wearable IMUs

    Oct 2, 2026Myeongju Cha, Pilwon HurGait AnalysisWearable Sensing

  5. Fast Learning Rates for Physics-Informed Kernel Methods

    Sep 16, 2026Luc Brogat-Motte, Joachim Bona-Pellissier, Giacomo Meanti +1Kernel RegressionPhysics-Informed ML

  6. Information Geometric Self-Organization at the Edge of Stability in High-Capacity Kernel Associative Memories

    Sep 15, 2026Akira TamamoriInformation GeometryEdge of Stability

  7. A Weighted Kernel Method for Approximation that Adapts to Learned Multivariable Structure

    Sep 15, 2026John E. Darges, Laura WeidensagerKernel RegressionKernel Methods

  8. Learning under Target Shift: Optimal Density Ratio Estimation and Importance-Weighted Regression

    Sep 14, 2026Ren-Rui Liu, Zheng-Chu GuoKernel RegressionDistribution Shift

  9. Generalization Analysis of Distributed Kernel-based Robust Gradient Descent Algorithms

    Sep 10, 2026Jun-Yi Meng, Zheng-Chu Guo, Yuan MaoKernel RegressionCommunication-Efficient Distributed Training

  10. The Noise Premium in Adversarial Training for Kernel Regression

    Jul 30, 2026Yiling Xie, Xiaoming HuoAdversarial TrainingKernel Regression

  11. Kernel Regression with Tensor Trains and Hadamard Overparameterization

    Jul 19, 2026Duc Thien Nguyen, Konstantinos Slavakis, Eleftherios Kofidis +1Incomplete Data ImputationKernel Regression

  12. A Function-Space Dichotomy for Compositional Learning: Exponential Sub-Optimality of the Neural Tangent Kernel

    Jul 7, 2026Arkaprabha Ganguli, Emil ConstantinescuNeural Network GeneralizationKernel Regression

  13. Learning-based Physics-Constrained Neural Kernel for Sound Field Estimation With Source-Position-Dependent Directional Weighting

    Jul 7, 2026Mattia Marella, Shoichi KoyamaKernel RegressionImplicit Neural Representations

  14. Learning dynamical systems from noisy data with Weak-form Kernel Ridge Regression

    Jun 30, 2026Max Kreider, John Harlim, Daning HuangKernel Ridge RegressionKernel Regression

  15. TorchKM: A GPU-Oriented Library for Kernel Learning and Model Selection

    Jun 4, 2026Yikai Zhang, Gaoxiang Jia, Jie Ding +1Model SelectionKernel Regression

  16. Conditional KRR: Injecting Unpenalized Features into Kernel Methods with Applications to Kernel Thresholding

    May 25, 2026Rustem Takhanov, Zhenisbek AssylbekovKernel Ridge RegressionKernel Regression

  17. Average Gradient Outer Product in kernel regression provably recovers the central subspace for multi-index models

    May 14, 2026Libin Zhu, Damek Davis, Dmitriy Drusvyatskiy +1Kernel Ridge RegressionRepresentation Learning

  18. AQKA: Active Quantum Kernel Acquisition Under a Shot Budget

    May 14, 2026Jian Xu, Chao Li, Delu Zeng +2Kernel RegressionActive Learning

  19. Large Dimensional Kernel Ridge Regression: Extending to Product Kernels

    May 14, 2026Yang Zhou, Yicheng Li, Yuqian Cheng +1Generalization BoundsKernel Ridge Regression

  20. On Uniform Error Bounds for Kernel Regression under Non-Gaussian Noise

    May 10, 2026Johannes Teutsch, Oleksii Molodchyk, Marion Leibold +2Kernel RegressionUncertainty Quantification

  21. Transformers Can Implement Preconditioned Richardson Iteration for In-Context Gaussian Kernel Regression

    May 8, 2026Mingsong Yan, Dongyang Li, Charles Kulick +1Softmax AttentionTransformer Interpretability

  22. Characterizing and Correcting Effective Target Shift in Online Learning

    May 8, 2026Ziyan Li, Naoki HirataniLabel ShiftKernel Regression

  23. Optimal Confidence Band for Kernel Gradient Flow Estimator

    May 7, 2026Yuqian Cheng, Zhuo Chen, Qian LinKernel RegressionKernel Methods

  24. Differentiable Kernel Ridge Regression for Deep Learning Pipelines

    May 4, 2026Jean-Marc Mercier, Gabriele SantinKernel Ridge RegressionKernel Regression

  25. Pack only the essentials: Adaptive dictionary learning for kernel ridge regression

    Apr 24, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoKernel Ridge RegressionKernel Regression

  26. Analysis of Nystrom method with sequential ridge leverage scores

    Apr 22, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoKernel Ridge RegressionKernel Regression

  27. Kinetic-based regularization: Learning spatial derivatives and PDE applications

    Mar 6, 2026Abhisek Ganguly, Santosh Ansumali, Sauro SucciKernel RegressionPartial Differential Equations

  28. Optimal Learning Rate Schedules under Functional Scaling Laws: Power Decay and Warmup-Stable-Decay

    Feb 6, 2026Binghui Li, Zilin Wang, Fengling Chen +3Learning Rate SchedulingKernel Regression