Overview

Nonparametric regression studies how to estimate an unknown relationship between inputs and outcomes while allowing its shape to be determined by data and assumptions such as smoothness or additivity. Common approaches include kernel and spline smoothing, Gaussian processes and reproducing-kernel methods, tree ensembles, and neural networks; researchers also develop online, functional, and distributional variants for specialized data. A central theoretical goal is to match minimax rates, which quantify the best possible prediction accuracy under a given smoothness class, while adapting to unknown structure and handling dependence, missingness, or distribution shift. The main tension is that flexible models can achieve strong guarantees under suitable conditions, but high dimension, computational cost, and reliable uncertainty estimates remain difficult.

Latest papers

CardsList

56 papers7 papers in the last four weeks, down 22% on the four weeks before. 0.1% of all new papers.

  1. The Manifold-Index Model: provably and efficiently avoiding the statistical and computational curse of dimensionality

    Nov 15, 2026Yantao Wu, Mauro MaggioniNonparametric RegressionCurse of Dimensionality

  2. Statistical and Privacy Guarantees for Deep M-Regression via Stochastic Gradient Langevin Dynamics

    Nov 5, 2026Yeheng Ge, Jian Huang, Shuyuan WuStochastic Gradient Langevin DynamicsNonparametric Regression

  3. Convex Regression at Scale: Geometry-Preserving Constraint Sparsification

    Nov 1, 2026Anish Senapati, Jose BlanchetNonparametric RegressionConvex Relaxation

  4. Sharp Generalization for Nonparametric Regression in Interpolation Space by Shallow Over-Parameterized Neural Networks with Channel Attention

    Nov 1, 2026Yingzhen Yang, Ping LiNeural Network GeneralizationNonparametric Regression

  5. On k-nearest-neighbor regression in metric spaces

    Oct 30, 2026László Györfi, Vladimir G. Pestov, Harro Walk +1k-Nearest NeighborsNonparametric Regression

  6. Deep Learning for Random Objects in Metric Spaces: Beyond Manifold Assumptions

    Oct 22, 2026Marcos Matabuena, Xiaokai Luo, Oscar Hernan Madrid PadillaNonparametric RegressionDistributional Regression

  7. Making Tensor Decoupling More Robust and Less Parametric

    Oct 12, 2026Maxime Rochkoulets, Joppe De Jonghe, Mariya IshtevaTensor DecompositionNonparametric Regression

  8. Distributional Regression for Arbitrary Response Variables Using ReLU Neural Networks

    Oct 12, 2026Junpeng Ren, Carlos Misael Madrid Padilla, Oscar Hernan Madrid PadillaDistributional RegressionConditional Distribution Estimation

  9. Energy-Guided Learning for Heat Equation with Noisy Source: Optimal Estimation and Generalization Bounds

    Oct 10, 2026Zixiang Zhou, Xiaohui Chen, Shanghua TengPhysics-Informed MLPDE Solving

  10. Minimax Additive Regression under Unknown Dependent Designs

    Sep 30, 2026Baptiste Ferrere, Fabrice Gamboa, Jean-Michel LoubesNonparametric RegressionMinimax Estimation

  11. Domain Adaptation with Target Information via Doubly-Anchored Distributionally Robust Optimization

    Sep 26, 2026David Kepplinger, Anand N. VidyashankarDomain AdaptationDistributionally Robust Optimization

  12. Optimal Tradeoffs Between Network Size and Parameter Magnitude in Neural Approximation and Minimax Regression

    Sep 22, 2026Baicheng Li, Zuowei Shen, Haizhao Yang +1Neural Network OptimizationNonparametric Regression

  13. Riemannian Simultaneous Inference for Tangent Vector Field Regression

    Sep 18, 2026Xiaotian Chang, Yangdi Jiang, Qirui HuNonparametric Regression

  14. MiNCE: Nonparametric, Strongly Consistent Confidence Envelopes for Band-Limited Functions and their Smoothed Spectra

    Sep 8, 2026Balázs Csanád Csáji, Bálint HorváthConfidence Region EstimationNonparametric Regression

  15. Optimal estimation for Functional Linear Regression with Noisy Discretized Data

    Sep 8, 2026Sixtine SphabmixayNonparametric RegressionMinimax Estimation

  16. Distributed Lag Neural Additive Models

    Sep 7, 2026Calle Helmersson, Shivang Pandey, Leonardo Olivetti +1Nonparametric RegressionNeural Network Interpretability

  17. Functional Attentive Interpretable Regression

    Sep 5, 2026Haixu Wang, Tianyu Guan, Jiguo CaoNonparametric Regression

  18. Efficient Regression Models for Scan Statistics

    Aug 23, 2026Gazi Abdur Rakib, Tristan Ashton, Ryan A. Loomis +4Time-Series Anomaly DetectionNonparametric Regression

  19. Transfer Learning in Nonparametric Regression with Deep ReLU Networks

    Aug 20, 2026Junpeng Ren, Carlos Misael Madrid Padilla, Yanzhen Chen +1Transfer LearningNonparametric Regression

  20. A Deep Learning Model for Spatially Clustered Data via Differentiable Cluster Assignment

    Aug 15, 2026Kexuan Li, Weidong MaNonparametric RegressionClustering

  21. Conditional Diffusion for Nonparametric Instrumental Variable Quantile Regression

    Aug 8, 2026Xingdong Feng, Xinhong Jiang, Yuling Jiao +2Quantile RegressionNonparametric Regression

  22. Verifiable Regularity Criterion for Conditional Expectation Operators and Conditional Mean Embeddings with Applications to Nonparametric Regression, Bayesian Inverse Problems, and Koopman Operators

    Aug 6, 2026Maximiliano Hertel, Ilja Klebanov, Manuel Schaller +1Nonparametric Regression

  23. The Noise Premium in Adversarial Training for Kernel Regression

    Jul 30, 2026Yiling Xie, Xiaoming HuoAdversarial TrainingKernel Regression

  24. Automatic knot selection in smooth additive models

    Jul 23, 2026Nicolás Carrizosa, Vanesa Guerrero, María DurbánNonparametric Regression

  25. Adaptive deep nonparametric regression from dependent data under covariate shift

    Jul 22, 2026William Kengne, Ehud Mossa OckegnaQuantile RegressionCovariate Shift