cs.LGOct 16, 2026

Bootstrap Stochastic Interpolant Tree for Inference-time Search Under Sparse Reward

Authors: Binglin Ji, Anindya Sarkar, Yevgeniy Vorobeychik

Organizations: Department of Computer Science & Engineering, Washington University in St. Louis, USA

Abstract

Tree-based samplers offer a compelling alternative for scalable inference-time search, bypassing the per-step reward and gradient dependencies that introduce systematic bias into SMC-style frameworks. Despite this advantage, contemporary tree samplers fail to achieve broad exploration. Their reliance on learned, DDPM-like transitions inherently couples neighbor states in a trajectory, thereby restricting child-parent feature divergence in the tree sampler. Consequently, these samplers suffer from restricted coverage of the target marginal distribution, severely hindering the exploration critical for efficient search under sparse reward. To overcome these limitations, we introduce a simple yet effective Bootstrap Stochastic Interpolant Tree (BSIT) sampler that decouples child node generation from explicit parent dependencies. By expanding the degrees of freedom during child node sampling, BSIT encourages diverse trajectory rollouts and unlocks broader path-space diversity-the exact catalyst needed for efficient exploration. Crucially, we show that BSIT's improved exploration accelerates convergence to the target distribution while achieving broader distributional coverage than samplers that rely on DDPM-like transitions for child-node generation, all without incurring additional function evaluations or reward feedback, thereby providing a highly efficient basis for rare target search. Extensive experiments across diverse search settings, including rare-species discovery and target-aligned molecule generation tasks, demonstrate BSIT's superior search efficiency over the baselines.

Explore similar work

CardsList
  1. BFMT: Enhancing Search Capabilities of Tree Sampler via Bootstrap Flow-Map Tree

    Jul 3, 2026Binglin Ji, Anindya Sarkar, Hengchang Lu +4Inference-Time SearchImage Generation

  2. LATS: Levy Adaptive Tree Sampling for Feedback-Driven Diverse Target Discovery

    Sep 6, 2026Binglin Ji, Anindya Sarkar, Hengchang Lu +3Adaptive SamplingDiffusion Sampling

  3. Sampling Meets Interaction: Sequentially-Controlled Multi-Particle Flow-Maps for Efficient Inference-time Search

    Jul 1, 2026Binglin Ji, Anindya Sarkar, Hengchang Lu +2Inference-Time SearchPosterior Sampling