cs.LGAug 22, 2026

Adaptive Multilevel Twisted Sequential Monte Carlo for Rare Events Estimation in Language Models

Authors: Zixuan Liu, Fangzheng Wu, Brian Summa, Zizhan Zheng

Organizations: Department of Computer Science, Tulane University, New Orleans, LA, 70118, USA

Abstract

Rare unsafe behaviors in large language models can remain practically significant even when their probability is extremely small, particularly at deployment scales involving millions or billions of interactions. Twisted Sequential Monte Carlo (SMC) provides a principled framework for rare-event probability estimation by learning twist functions that guide generation toward a target event. However, the standard twist learning framework relies on positive samples from the rare-event target distribution, which may be nearly absent before an informative twist has been learned, resulting in unreliable rare-event estimation. We propose Adaptive Multilevel Twisted SMC, which learns the rare-event twist through a sequence of progressively rarer intermediate events. At each level, the learned twist provides more informative positive examples for learning the next twist, ultimately leading to a more accurate final twist for the target rare event. Experiments across diverse tasks and model scales show that the proposed method produces more accurate rare-event probability estimates. By enabling more reliable discovery of hard-to-observe unsafe behaviors, our method provides a practical tool for strengthening the evaluation and safety alignment of deployed language models.

Figures & tables

Appendix figures & tables23 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Weighted Ensemble Sampling for Rare-Event Estimation in Language Models

    Oct 13, 2026Zixuan Liu, Gustavo Didier, Fangzheng Wu +2Rare-Event EstimationLLM Reliability

  2. Estimating Tail Risks in Language Model Output Distributions

    Apr 24, 2026Rico Angell, Raghav Singhal, Zachary Horvitz +4Language Model Safety EvaluationImportance Sampling