q-bio.NCNov 12, 2026

Random Exploration is Random

Authors: Yingkang Luo, Hua-Dong Xiong, Hanbo Xie, Caroline Phelps, Madeline Harms, Ryan Smith, James Waltz, Robert Wilson

Organizations: College of Computing, Georgia Institute of Technology · School of Psychology, Georgia Institute of Technology · Department of Psychology, University of Minnesota Duluth · Laureate Institute for Brain Research · 

Abstract

Decision making often requires balancing exploitation of familiar options with exploration of uncertain alternatives. One strategy for exploration is random exploration, in which choices become more variable and less tied to the option that currently appears best. However, it remains unclear whether this variability reflects genuine stochasticity or instead a deterministic structure that traditional cognitive models fail to capture. We examined this question using the Horizon Task in an aggregated dataset of 1,392 participants completing over 1,270,695 trials. In this task, exploration becomes more valuable when participants have more future choices, and choice variability increases under longer horizons. We tested whether more expressive neural network models could recover deterministic structure from this additional variability. Although neural networks provided better overall fits to behavior than the traditional model, long-horizon choices remained consistently less predictable than short-horizon choices. These findings show that limited model expressiveness cannot fully account for the increased variability associated with random exploration, suggesting random exploration truly is substantially random.

Figures & tables

Explore similar work

CardsList
  1. Learning to Plan from Random Exploration

    Sep 29, 2026Deqian Kong, Guangyan Sun, Sheng Cheng +6Long-Horizon PlanningModel-Based Planning

  2. Variance Driven Exploration: A Provable and Efficient Methodology for Pure Exploration in Highly Stochastic Environments

    Aug 22, 2026Khang Luong, Nam Nguyen, Hoang Ta +2Uncertainty-Aware ExplorationRL Exploration

  3. Not all uncertainty is alike: volatility, stochasticity, and exploration

    May 19, 2026Payam PirayMulti-Armed BanditsExploration-Exploitation Tradeoff