The Type-II Error of Test Supermartingales: e-Power versus the Chernoff-Stein Exponent
Organizations: AI4Science Lab, Korteweg-de Vries Institute for Mathematics, University of Amsterdam
Abstract
In safe hypothesis testing with test supermartingales, Ville's inequality provides anytime-valid type-I error guarantees for every significance level , if one rejects the null hypothesis whenever the wealth process first exceeds . Due to an inherent asymmetry, the type-II error behaves differently. We prove two things about the latter, for a simple null and alternative. First, the mean growth rate , the e-power, that Kelly betting and growth-rate-optimal e-variables maximise, bounds nothing on its own. For every level , every and horizon we construct e-variables of conditional e-power exactly whose probability of not rejecting by is arbitrarily close to one. It forces eventual rejection, but no finite-horizon guarantee follows. Second, the quantity that does control the type-II error is the Chernoff-Stein exponent of an e-variable, , whose range is exactly determined: , the classical Chernoff-Stein exponent, and so the ceiling of its own per-e-variable form. One conditional application of Hoelder's inequality per step gives it, for every test supermartingale on an arbitrary filtered space, with no independence or product structure; the i.i.d. case adds that it is matched, and attained by nothing. The e-power has its own ceiling, , and that one is attained, -a.s. uniquely, by the likelihood ratio . The two optima are the same divergence in opposite arguments, at opposite ends of the flattened family : the ceiling as , at . Which is best is settled by the horizon, exactly: is optimal at alone, beaten by sharpening below it and by flattening above.
Figures & tables
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.
Appendix
| Main text | Replaced by | Extra hypothesis |
| Section 2.4 , Theorem 4.29 (a) | Section A.1 | none |
| Section 4.1 , Section 4.4 | Section A.1 | none |
| equality case of Theorem 4.10 | Section A.1 | none |
| Section 4.4 (identity) | Section A.1 | |
| Section 2.4 , Section 4.4 , Theorem 4.25 , Theorem 4.29 (b) | Theorem A.11 | Section A.2 |
| Section 4.3 | Section A.1 | none |
Statistical Hypothesis Testing
Statistical hypothesis testing develops methods for assessing evidence against a stated null while controlling false-positive and false-negative rates.
See all 101 papers