cs.LGOct 31, 2026

Does Random Search Discover Task Experts? Revisiting Neural Thickets

Authors: Julian Asilis, Guanzhe Hong, Vatsal Sharan

Organizations: University of Oxford

Abstract

Pretrained models are typically viewed as generalists, requiring bespoke post-training to achieve task-specific expertise. Gan & Isola (2026) recently proposed a striking alternative: that pretrained models lie in a dense neural thicket of task specialists, which can be surfaced with simple Gaussian weight perturbations. We examine this neural thicket of task-specific experts and identify several key findings that question this perspective. First, we find that the apparent lift of the best-of-N selected perturbation decays quickly with selection-set size m, strongly suggesting overfitting to the selection questions. In fact, for 10 of the 12 model-task pairs we study, a simple null model of pure selection noise predicts more than 75 percent of the top expert's reward lift. Second, the top experts' advantage often vanishes on held-out questions or remains within the run-to-run variability of the unperturbed pretrained model. Third, we find that majority voting over the top-K selected perturbations, termed RandOpt(N, K) by Gan & Isola (2026), is often matched or outperformed by majority voting over K samples from the base model. Overall, our results suggest that random weight perturbations may be ineffective at uncovering task experts around pretrained models, and that task adaptation requires more sophistication than random search. Code and artifacts are available at github.com/asil012/RevisitingNeuralThickets.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Rethinking Neural Thickets Without Weight Perturbations

    Oct 29, 2026Nicolas Dufour, Elouan Gardès, Amil Dravid +2LLM ReasoningEnsemble Learning

  2. When Are Nearby Experts Composable? Cross-Task Model Merging in Neural Thickets

    Nov 8, 2026Suxin Ji, Hungtao Wan, Mingjun Liu +1Model Merging