cs.LGNov 11, 2026

Sensitivity-Aware Surrogate Modeling with Random Feature Expansions

Authors: John E. Darges

Organizations: Dept. of Mathematics, Emory University, Atlanta, GA 30322, USA

Abstract

Random feature expansions (RFEs) provide a flexible approach to surrogate modeling, but their accuracy depends on the distribution used to sample features. We propose spike-and-slab random feature expansions (SAS-RFE) to learn the feature sampling distribution from sensitivity analysis. The method employs a spike-and-slab distribution that assigns probabilities to the inclusion of individual inputs in randomly sampled Fourier features. These inclusion probabilities are determined by estimates of total Sobol' sensitivity indices, rather than by explicitly selecting important inputs or interaction terms. An information theoretic criterion shows that the total Sobol' indices yield a distribution that approximates the input interaction structure of the model. An iterative algorithm updates the sampling probabilities using sensitivity estimates from successive RFE surrogates. Analytical formulas for the Sobol' indices of random Fourier feature expansions enable these updates without additional evaluations of the target function. Numerical experiments on six benchmark problems, with up to 100 input dimensions, demonstrate improvements in surrogate approximation and sensitivity estimation.

Figures & tables

Explore similar work

CardsList
  1. Structured Neural Chaos: An Adaptive Surrogate Modeling Framework for Functional Uncertainty Quantification and Global Sensitivity Analysis

    Jul 31, 2026Isabel Corona Guevara, Yeping HuNeural Surrogate ModelingUncertainty Quantification

  2. Signed random Fourier features for fast density estimation with indefinite kernels

    Aug 29, 2026Xie Wang, Nicolas Langrené, Wen ChenKernel Density EstimationRandom Feature Methods