Adaptive Sampling
Adaptive sampling optimizes data collection by strategically selecting subsets of a larger dataset, aiming to maximize information gain or model performance while minimizing computational cost. Current research focuses on developing algorithms that dynamically adjust sampling strategies based on factors like data characteristics, model performance, and uncertainty, often employing techniques like importance sampling, active learning, and reinforcement learning within various model architectures, including neural networks and Gaussian processes. This approach is proving valuable across diverse fields, improving efficiency in tasks ranging from deep learning model training and evaluation to robotic exploration and scientific simulations, ultimately leading to more accurate and cost-effective results.
Papers
SnAKe: Bayesian Optimization with Pathwise Exploration
Jose Pablo Folch, Shiqiang Zhang, Robert M Lee, Behrang Shafei, David Walz, Calvin Tsay, Mark van der Wilk, Ruth Misener
Adaptive Sampling Strategies to Construct Equitable Training Datasets
William Cai, Ro Encarnacion, Bobbie Chern, Sam Corbett-Davies, Miranda Bogen, Stevie Bergman, Sharad Goel
L-SVRG and L-Katyusha with Adaptive Sampling
Boxin Zhao, Boxiang Lyu, Mladen Kolar