Overview

Anytime-valid inference studies how to make trustworthy statistical decisions when data are inspected repeatedly and the time to stop is chosen based on what has been observed. It replaces fixed-horizon tests with tools such as e-values and e-processes, betting martingales, and confidence sequences that control false alarms or maintain coverage at every time. These methods are used for sequential audits, model and leaderboard evaluation, selective prediction, streaming decisions, and performance certification, often aiming to save samples or computation through early stopping. A central challenge is balancing power and efficiency with guarantees whose assumptions—such as exchangeability, predictable sampling, or valid dependence models—may not hold in real adaptive systems.

Latest papers

CardsList

37 papers4 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. Anytime-Valid Empirical Likelihood Inference from LLM Annotations with Adaptive Human Auditing

    Nov 11, 2026Hongfu Gao, Jiang Hu, Pengfei Liu +1Anytime-Valid InferenceLLM-Assisted Annotation

  2. Can We Stop the Backtest Yet? Anytime-Valid Promotion Tests for Adaptive Financial Research Agents

    Nov 2, 2026Eric Benhamou, Jean-Jacques Ohana, Beatrice Guez +3Multiple Hypothesis TestingAnytime-Valid Inference

  3. Anytime Valid Confidence Bands for Distribution Functions

    Oct 26, 2026Bror Hultberg, Dave Zachariah, Antônio H. RibeiroConfidence EstimationConfidence Region Estimation

  4. Anytime-Valid Runtime Monitoring of Learned Barrier Certificates

    Oct 20, 2026Zhipeng Cao, Taoran Wu, Weiru Cui +2Runtime VerificationControl Barrier Functions

  5. Certified Corruption Budgets: Anytime-Valid Leaderboard Claims under Adaptive Rigging

    Oct 6, 2026Hamed Khosravi, Xiaoming HuoCorruption RobustnessAnytime-Valid Inference

  6. Evidence-Gated Research: Statistically Controlled Model Adoption in Adaptive Search

    Oct 1, 2026Yifan GuoFDR ControlAnytime-Valid Inference

  7. Anytime-Valid LLM Leaderboards via Benchmark-weighted and Block-Factorized e-Processes

    Sep 26, 2026Hongfu Gao, Songxin Zhang, Zejian Xie +3LLM EvaluationAnytime-Valid Inference

  8. Rank Confidence Sequences:Anytime-valid Leaderboards

    Sep 26, 2026Hamed Khosravi, Xiaoming HuoAnytime-Valid InferenceBenchmark Validity

  9. Human-LLM Deliberation as Interactive Proof: Conditions for Verifiability Without Transparency

    Sep 21, 2026Baotong Zhang, Dean Foster, João SedocLLM Answer VerificationAnytime-Valid Inference

  10. Betting for Sim-to-Real Performance Certificates

    Aug 21, 2026Yujia Chen, Bowen WengRobotic Policy EvaluationSim-to-Real Transfer

  11. Evidence Before Expansion: Reuse, Spawn, or Defer in Lifelong Expert Pools

    Aug 20, 2026Kentaro OdaOnline Continual LearningSequential Hypothesis Testing

  12. Private Anytime Selective-Risk Certification for Federated Retrieval-Augmented Generation: Guarantees and Empirical Limits

    Aug 8, 2026Sanjeda Akter, Ibne Farabi Shihab, Anuj SharmaAnytime-Valid InferenceRAG Evaluation

  13. On Exploring Input Resolution Scaling For Anytime LiDAR Object Detection

    Jul 9, 2026Ahmet Soyyigit, Shuochao Yao, Heechul YunAdaptive InferenceLidar-Based 3D Object Detection

  14. Halt Fast! Early Stopping for Certified Robustness

    Jun 26, 2026Andrew C. Cullen, Paul Montague, Benjamin I. P. RubinsteinEfficient Neural Network InferenceEarly Stopping

  15. Sim-to-Real Betting on the E-Process: Bringing "simulators" to anytime-valid confidence sequences

    Jun 23, 2026Yujia Chen, Bowen WengAnytime-Valid Inference

  16. CELEUS: Certifiable and Efficient LLM Evaluation via E-Processes

    Jun 18, 2026Zhijian Zhou, Zesheng Ye, Zhaorun Chen +2LLM EvaluationAnytime-Valid Inference

  17. Anytime-Valid Confirmation of Label-Shift Corrections

    Jun 12, 2026Seungjin ChoiLabel ShiftAnytime-Valid Inference

  18. Correcting Split Selection in Online Decision Trees via Anytime-Valid Inference

    May 29, 2026Salim I. Amoukou, Saumitra Mishra, Manuela VelosoAnytime-Valid InferenceDecision Tree Learning

  19. Anytime-Valid Federated Conformal RAG for LLM Swarms

    May 27, 2026Prasanjit Dubey, Xiaoming HuoRetrieval-Augmented GenerationFederated Conformal Prediction

  20. When Should an AI Workflow Release? Always-Valid Inference for Black-Box Generate-Verify Systems

    May 13, 2026Young Hyun Cho, Will Wei SunAnytime-Valid InferenceSequential Hypothesis Testing

  21. Asymptotically Log-Optimal Bayes-Assisted Confidence Sequences for Bounded Means

    May 8, 2026Valentin Kilian, Stefano Cortinovis, François CaronAnytime-Valid InferenceBayesian Inference