math.STAug 19, 2026

The Type-II Error of Test Supermartingales: e-Power versus the Chernoff-Stein Exponent

Authors: Patrick Forré

Organizations: AI4Science Lab, Korteweg-de Vries Institute for Mathematics, University of Amsterdam

Abstract

In safe hypothesis testing with test supermartingales, Ville's inequality provides anytime-valid type-I error guarantees for every significance level α∈(0,1]α\in(0,1], if one rejects the null hypothesis whenever the wealth process first exceeds 1/α1/α. Due to an inherent asymmetry, the type-II error behaves differently. We prove two things about the latter, for a simple null and alternative. First, the mean growth rate EP1[log⁡E]\mathbb{E}_{P_1}[\log E], the e-power, that Kelly betting and growth-rate-optimal e-variables maximise, bounds nothing on its own. For every level c>0c>0, every αα and horizon tt we construct e-variables of conditional e-power exactly cc whose probability of not rejecting by tt is arbitrarily close to one. It forces eventual rejection, but no finite-horizon guarantee follows. Second, the quantity that does control the type-II error is the Chernoff-Stein exponent of an e-variable, Λ(E)=sup⁡s≥0{−log⁡EP1[E−s]}Λ(E)=\sup_{s\ge0}\{-\log \mathbb{E}_{P_1}[E^{-s}]\}, whose range is exactly determined: sup⁡EΛ(E)=KL(P0∥P1)\sup_E Λ(E)=\mathrm{KL}(P_0\|P_1), the classical Chernoff-Stein exponent, and so the ceiling of its own per-e-variable form. One conditional application of Hoelder's inequality per step gives it, for every test supermartingale on an arbitrary filtered space, with no independence or product structure; the i.i.d. case adds that it is matched, and attained by nothing. The e-power has its own ceiling, KL(P1∥P0)\mathrm{KL}(P_1\|P_0), and that one is attained, P0P_0-a.s. uniquely, by the likelihood ratio RR. The two optima are the same divergence in opposite arguments, at opposite ends of the flattened family Rβ/EP0[Rβ]R^β/\mathbb{E}_{P_0}[R^β]: the ceiling as β↓0β\downarrow0, RR at β=1β=1. Which ββ is best is settled by the horizon, exactly: RR is optimal at t=log⁡(1/α)/KL(P1∥P0)t=\log(1/α)/\mathrm{KL}(P_1\|P_0) alone, beaten by sharpening (β>1)(β>1) below it and by flattening above.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Type-II Error Bounds for Test Supermartingales from Lower-Tail Hypotheses

    Aug 19, 2026Patrick ForréSequential Hypothesis TestingE-Values

  2. Multi-Armed Sequential Hypothesis Testing by Betting

    Mar 18, 2026Ricardo J. Sandoval, Ian Waudby-Smith, Michael I. JordanSequential Hypothesis TestingStatistical Hypothesis Testing

  3. Anytime-valid simulation-based hypothesis testing

    Oct 6, 2026Patrick Forré, Lydia BrennerSimulation-Based InferenceSequential Hypothesis Testing