Online Interval Selection with Binary Predictions: Optimal Consistency and a Continuous Robustness Tradeoff
Organizations: Department of Biomedical Engineering, College of Design and Engineering, National University of Singapore.
Abstract
We study online interval selection with binary predictions of membership in a final optimal solution. Requests arrive in arbitrary order; accepted requests may be revoked, but rejected or revoked requests cannot be recovered. With rewards proportional to interval length, the best consistency under finite strict robustness is when both guarantees hold almost surely on each fixed input, including for randomized algorithms. A continuous lower bound forces consistency strictly above at every robustness budget below , whereas our deterministic algorithm attains with exact robustness , where . Each held interval inherits a ledger recording positive prediction mass lost through irrevocable decisions. A tunable replacement cost gives a continuous family with exact consistency throughout and exact robustness on two parameter intervals, including and . Randomization permits expected consistency approaching one with finite expected robustness, whereas almost-sure robustness forces expected consistency strictly above two at every finite budget.
Figures & tables
| Scope | Guarantee |
|---|---|
| Finite almost-sure robustness | |
| Budget | |
| Optimal | |
| LR (prediction-free) | |
| SUM-BANK at | , |
| Shaped-BANK | , |
Appendix figures & tables14 assets
Supplementary material from the paper’s appendix.
Appendix
| Root and endpoint choices | General coefficient | At |
|---|---|---|
| Ordinary: two eligible | ||
| Ordinary: one eligible | ||
| Ordinary: none eligible | ||
| Special: two singletons | ||
| Special: one, | ||
| Special: one, outward child |
| Algorithm | Consistency | Robustness | Error guarantee |
|---|---|---|---|
| LR | (exact) | — | |
| RP λ , | (exact) | — | |
| Naive | |||
| Shaped | (exact) | ||
| Credit | (exact) | ||
| SUM | (exact) |
| Log | Condition | Mean difference | Adjusted 99.375% CI | Win/tie/loss |
|---|---|---|---|---|
| NASA | Perfect | 0.00006 | 2/98/0 | |
| NASA | FN .1 | 0.00000 | 0/100/0 | |
| NASA | FP .1 | 0.01227 | 72/0/28 | |
| NASA | FP 1 | 0.00000 | 0/100/0 | |
| CTC | Perfect | 0.00776 | 17/81/2 | |
| CTC | FN .1 | 0.00406 | 10/89/1 |
| Log | Labels | Act. | LR | |||
|---|---|---|---|---|---|---|
| NASA | Perfect | 20/20 | ||||
| NASA | FP 0.01923 | 20/20 | ||||
| NASA | FP 0.1 | 0/20 | ||||
| NASA | FP 1 | 0/20 | ||||
| CTC | Perfect | 20/20 | ||||
| CTC | FP 0.0034 | 20/20 |
| Log | Labels | SG F | SG | Scalar F | SUM F | MAX( ) | LR | Half(4) | RP F |
|---|---|---|---|---|---|---|---|---|---|
| NASA | Perfect | 99.10 | 99.10 | 99.10 | 99.17 | 98.93 | 96.83 | 99.26 | 98.67 |
| NASA | FP .1 | 94.36 | 94.92 | 94.35 | 92.26 | 96.20 | 96.83 | 93.15 | 91.76 |
| NASA | FP 1 | 89.12 | 88.63 | 89.08 | 88.56 | 93.07 | 96.83 | 89.01 | 88.17 |
| CTC | Perfect | 95.58 | 95.58 | 95.58 | 95.91 | 95.51 | 93.27 | 97.22 | 92.80 |
| CTC | FP .1 | 89.25 | 89.68 | 89.24 | 87.34 | 90.63 | 93.27 | 86.84 | 87.24 |
| CTC | FP 1 | 86.39 | 85.72 | 86.37 | 85.73 | 89.15 | 93.27 | 86.12 | 85.37 |
| Quantity | NASA | CTC |
|---|---|---|
| Data records | 18,239 | 77,222 |
| Excluded zero-runtime records | 173 | 17 |
| Retained intervals | 18,066 | 77,205 |
| Exact optimum | 5,816,181 | 28,353,920 |
| Fixed optimal-set size (FN eligible) | 3,635 | 1,464 |
| Complement size (FP eligible) | 14,431 | 75,741 |
| Condition | Naive | LR | SG | |||
|---|---|---|---|---|---|---|
| Perfect | 100.00 | 94.98 | 95.94 | 98.08 | 95.61 | 95.61 |
| FP .0068 | 95.05 | 94.98 | 94.99 | 95.02 | 95.30 | 95.28 |
| FP .1 | 78.11 | 94.98 | 91.76 | 84.55 | 94.10 | 93.57 |
| Quantity | NASA | CTC |
|---|---|---|
| Precision / recall | ||
| Weighted recall | ||
| Active error branch | ||
| Shaped / filtered | ||
| SUM / MAX at |
| Condition | NASA | CTC |
| Ordinary score, F1-selected | 94.58 | 89.66 |
| Ordinary score, error-selected | 93.71 | 90.30 |
| Ordinary score, reward-selected | 96.96 | 90.30 |
| Cost score, F1-selected | 93.13 | 90.21 |
| Cost score, error-selected | 94.91 | 90.30 |
| Cost score, reward-selected | 96.96 | 90.48 |
| 128 suffixes | No MC | No MC | No MC | |
|---|---|---|---|---|
| Method | % OPT | % OPT | Retained | Revoked |
| Conditional | 94.334 | 94.817 | 13.76302 | 4.86719 |
| Pooled | 94.474 | 94.458 | 13.68750 | 4.91406 |
| Uniform | 94.143 | 94.423 | 13.68229 | 4.66406 |
| Known law | 94.660 | 94.665 | 13.74740 | 4.89063 |
| Myopic | — | 90.652 | 12.91667 | 2.45313 |
| Predeclared comparison | Mean difference | Trial-level 95% interval |
|---|---|---|
| Conditional uniform (primary) | ||
| Conditional pooled | ||
| Conditional swapped | ||
| Uniform myopic | ||
| Known law uniform |
Sequential Decision Making
Sequential Decision Making studies how to choose actions over time when outcomes, information, resources, or goals can change.
See all 139 papers