Overview

Best-of-N sampling spends inference-time compute to generate several answers, then chooses one, aiming to find stronger outputs without retraining the model. Selection methods include reward-model or verifier scores, majority voting and consensus, confidence-based ranking, learned scorers, and regularized or noise-based variants. The approach is used for language-model reasoning and alignment, with evaluations on tasks such as MATH, GSM8K, coding, and instruction following, as well as speech and medical report generation. More samples can improve the chance of finding a good answer, but unreliable judges, reward hacking, tail effects, and rising costs can erase gains or make selections worse; how to evaluate and control these risks remains a central challenge.

Latest papers

CardsList

40 papers7 papers in the last four weeks, up 40% on the four weeks before. 0.1% of all new papers.

  1. GRACE: Parallel Best-of-N Multi-Agent Analysis of Closed-Form Questions over Dataframes with Guardrail Selection and Adaptive Retry

    Nov 16, 2026Fabio Picariello, Salvatore Cipolla, Susanna Bonura +1Table QAData Analysis Agents

  2. Latency-Aware Adaptive Best-of-NN

    Nov 5, 2026Alon Jacobson, Qian Xie, Peter I. FrazierInference-Time Compute AllocationCost-Aware Inference

  3. On Turn-Level Best-of-N Sampling for Scaling LLM Agents

    Nov 4, 2026Jalaj Bhandari, Dhawal Gupta, Hongli Zhan +5Inference-Time ScalingBest-of-N Sampling

  4. Whether or Where? Tail Calibration Signals Finite-Budget Reward Hacking in Best-of-N Selection

    Oct 25, 2026Cheng Gui, Yihua Shao, Lei Li +2Best-of-N SamplingReward Over-Optimization

  5. Efficient Best-of-N policy evaluation for inference-time alignment

    Oct 7, 2026Jonas Schweisthal, Yuxin Wang, Athiya Deviyani +2Best-of-N SamplingOff-Policy Evaluation

  6. Efficient Reasoning Exploration via State-Conditioned Latent Steering with Progress Guidance

    Sep 21, 2026Hengyuan Zhang, Chenming Shang, Zunhai Su +10Best-of-N SamplingInference-Time Guidance

  7. ExpBoN: Exponential-Noise Best-of-nn for Efficient Test-Time LLM Alignment

    Sep 18, 2026Yanxiao Liu, Sicheng Wan, Deniz GündüzBest-of-N SamplingInference-Time Language Model Alignment

  8. Privacy Without Regret: Differentially Private Inference-Time Alignment

    Aug 26, 2026Ishi Jain, Nandini Bhattad, Sayak Ray ChowdhuryInference-Time Language Model AlignmentBest-of-N Sampling

  9. Safety Hacking in Constrained Best-of-NN Inference-time Scaling

    Aug 24, 2026Akifumi Wachi, Takumi Tanabe, Youhei AkimotoLLM SafetyInference-Time Scaling

  10. Evaluator Ensembles Under Reward Hacking: Covariance Geometry and Finite-Search Guarantees

    Aug 8, 2026Fariya Afrin, Ibne Farabi ShihabReward HackingLLM Evaluation

  11. Best-of-Evidence: Best-of-N Selection under Partial Verification

    Jul 23, 2026Cenwei Zhang, Teng Fang, Yuxia Wang +3Model SelectionEvidence-Grounded Reasoning

  12. Flash-BoN: Instant Drafts for Inference-Time Scaling in Diffusion Models

    Jul 5, 2026Ruchit Rawal, Reza Shirkavand, Sayak Paul +5Inference-Time ScalingBest-of-N Sampling

  13. Best-of-Better-NN: Generating Pre-Aligned Responses with In-Context Learning

    Jul 3, 2026Eric Lei, Hsiang Hsu, Chun-Fu ChenLLM AlignmentBest-of-N Sampling

  14. When More Sampling Hurts: The Modal Ceiling and Correlation Ceiling of Test-Time Scaling

    Jun 27, 2026Yong Yi Bay, Kathleen A. YearickLLM EvaluationSelf-Consistency Decoding

  15. Transition-Aware best-of-N sampling for Longitudinal Chest X-ray Reports

    Jun 23, 2026Halil Ibrahim Gulluk, Max Van Puyvelde, Wim Van Criekinge +1Radiology Report GenerationRadiology VLMs

  16. Predicting Inference-Time Scaling Gains from Labeled Validation-Set Output Statistics

    Jun 2, 2026Luyang Zhang, Jingyan LiLLM EvaluationLanguage Model Performance Prediction

  17. Reward Learning from Best-of-NN Preference Data: Targets, Tradeoffs, and Design Principles

    May 28, 2026Rattana Pukdee, Maria-Florina Balcan, Pradeep RavikumarPairwise Preference LearningReward Modeling

  18. CCS: Clinical Consensus Selection for Radiology Report Generation

    May 28, 2026Xi Zhang, Yingshu Li, Zaiqiao Meng +2Radiology Report GenerationRadiology VLMs

  19. What should post-training optimize? A test-time scaling law perspective

    May 11, 2026Muheng Li, Jian Qian, Wenlong MouTest-Time ScalingBest-of-N Sampling

  20. On-Policy Distillation with Best-of-N Teacher Rollout Selection

    May 10, 2026Ke Zhang, Yunjie Tian, Dongdi Zhao +4CoT DistillationBest-of-N Sampling