Waiting Buys Exactly Two Moments: Endogenous Identification in Prediction-Driven Allocation
Authors: Rama AlHamidi, Rasul Khanbayov, Erchin Serpedin, Hasan Kurban
Organizations: Department of Computer and Electrical Engineering, Texas A&M University at Qatar, Doha, Qatar · College of Science and Engineering, Hamad Bin Khalifa University, Doha, Qatar · Department of Computer and Electrical Engineering, Texas A&M University, College Station, TX, USA
A planner with a fixed budget of preventive help must decide whom to help and when. Waiting reveals risk but removes intervention opportunities as higher-risk individuals leave first. We characterize this tradeoff under repeated noisy signals and risk-dependent attrition: in the canonical model, a length-τ observation prefix identifies exactly the latent risk moments mj=E[pj] for j=0,…,2τ−1, buying two new moments per additional period. These identify average next-period attrition among survivors but need not identify allocation welfare or attrition among those prioritized for treatment. Our observationally equivalent constructions establish unavoidable timing regret at any sample size for a fixed observation length, while exact certificates determine whether all compatible populations share a unique optimal date. Matched experiments separate the effects of estimation, bootstrap averaging, and regret weighting. Longer observation often resolves timing ambiguity, but the optimal date may already have passed. In our experiments, bootstrap averaging and early stopping improve decisions, while regret weighting adds no improvement in pooled mean squared regret: better statistical fit need not yield better allocation welfare. The code and artifacts are available at https://github.com/KurbanIntelligenceLab/waiting-buys-two-moments.
Figures & tables
Figure 1: Waiting buys exactly two moments, but the riskiest people leave first. After t periods the planner observes exactly the first 2t−1 moments of the risk distribution (orange tiles), so its reconstruction (orange) of the true distribution (black) sharpens with every period of waiting (blue arrow). The people who generate those clues are the highest-risk ones, and they drop out first (dashed outlines): waiting improves the ranking of a population that has already lost the people most worth helping (red arrow).
Figure 2: Identical observations, different optimal dates. The two populations have matching observation probabilities through τ=2 (a), but different welfare curves (b): Q0 is optimized at s=5 , whereas Q1 is optimized at s=1 . The illustrated recommendation s=5 is optimal for Q0 but incurs relative welfare loss under Q1 . Dates are evaluated as policies for a future population with the same risk distribution.
Observation length
Measure
τ=2
τ=3
τ=4
Welfare uncertainty
Median exhibited welfare spread
42.1%
27.3%
15.2%
Interquartile range
27.8 – 63.8%
14.0 – 38.8%
2.7 – 27.4%
Largest exhibited welfare spread
85.8%
74.3%
50.5%
Timing disagreement
Table 1: Identification ambiguity across observation lengths. Selected population pairs match moments through degree 2τ−1 and therefore generate identical prefix observation laws. Compatibility, welfare trajectories, and regret separation are verified in exact rational arithmetic for all 90 pairs. Welfare spread is the maximum relative difference between the two welfare curves across candidate dates. Regret bounds are exhibited lower bounds, not necessarily sharp over the compatible set. Median regret bounds are calculated among pairs with disjoint optimal-date sets.
Outcome
τ=2
τ=3
τ=4
All dates: 1,…,T−1
Best date identified
1/30
16/30
27/30
Best date ambiguous
29/30
14/30
3/30
Available dates: τ,…,T−1
Best available date identified
3/30
18/30
28/30
Act now ( s=τ )
3/30
14/30
27/30
Table 2: Do the observations determine the best intervention date? Counts across 30 configurations per observation length. Identified means one date is uniquely optimal for every compatible population; ambiguous means no date is optimal for all of them. All cases were resolved after the extended pass. Indented rows partition the identified available-date cases.
N=103
N=105
Procedure
MSR ↓
MSR gain ↑
p10↑
MSR ↓
MSR gain ↑
p10↑
Reference policies
Oracle
0.00
+4.61
1.0000
0.00
+1.60
1.0000
Act immediately
8.64
−4.02
0.8535
8.85
−7.26
0.8201
Single fit and bootstrap aggregation
Certified NPMLE
4.61
+0.00
0.8672
1.60
+0.00
0.9658
Table 3: Overall decision performance. Results at τ=2 on 1,169 matched runs across the two sample sizes. MSR is mean squared relative regret multiplied by 103 ; MSR gain is its reduction relative to certified NPMLE. p10 is the 10th percentile of welfare efficiency. Early-stopped EM uses 55 iterations.
Appendix figures & tables4 assets
Supplementary material from the paper’s appendix.
Appendix
N=103
N=105
Estimator
MSR
p10
MSR
p10
Certified NPMLE
3.37
0.8933
1.55
0.9876
Parametric Beta
4.03
0.8536
3.81
0.8536
EM, 30 iterations
0.19
0.9964
0.05
0.9964
EM, 55 iterations
0.23
0.9964
0.00
0.9969
EM, 80 iterations
0.27
0.9964
0.00
0.9969
Appendix
Table A1: Estimator choice at τ=2 . MSR is multiplied by 103 ; p10 is the tenth percentile of welfare efficiency. Rounded zeros do not imply zero regret.
Rule
p10
Median
Mean
MSR
Exact (%)
Act immediately
0.8535
0.9475
0.9251
8.693
6.66
Worst-case envelope
0.8535
0.9475
0.9251
8.693
6.66
Achieved-welfare LP
0.8535
0.9539
0.9299
8.032
8.43
Maximin welfare
0.8536
0.9933
0.9604
5.006
32.35
Appendix
Table A2: Approximate ambiguity-aware procedures. p10 , median, and mean summarize welfare efficiency; MSR is multiplied by 103 . Exact is agreement with the reference optimal date. All rows use the same 7,189 runs with nonempty estimated sets, out of 7,200 planned runs.
Procedure
N=103
N=105
Certified NPMLE
0.0648
0.0387
EM, 30 iterations
0.0375
0.0383
EM, 55 iterations
0.0357
0.0339
EM, 80 iterations
0.0373
0.0341
Bagged NPMLE
0.0558
0.0302
Regret calibration
0.0576
0.0302
Appendix
Table A3: Worst-member mean regret over 30 compatible pairs. Procedures share pre-failure information and matched trials. Values are relative-regret fractions; bold marks the lowest point estimate per column.
Procedure
N=103
N=105
EM, 55 iterations
−0.0292[−0.0362,−0.0242]
−0.0048[−0.0109,−0.0022]
Bagged NPMLE
−0.0090[−0.0153,−0.0032]
−0.0085[−0.0140,−0.0047]
Regret calibration
−0.0072[−0.0141,−0.0009]
−0.0085[−0.0140,−0.0047]
Appendix
Table A4: Paired differences from certified NPMLE in pooled worst-member mean regret. Negative values favor the listed procedure. Brackets show exploratory, unadjusted 95% percentile-bootstrap intervals conditional on the fixed pairs and retained trials.
Online time-series forecasters receive labels only after horizon-dependent delays, while every adaptation step spends limited compute. We study when an online learner should update, not how to adapt at every opportunity, and introduce ADOWIP: a residual-adapter framework with sealed delay queues, exact budget accounting, and auditable update telemetry. Its main scheduler is an observed decision-loss priority gate that updates only after feedback is revealed, when downstream loss, optionally penalized by prediction MSE, exceeds a calibrated empirical quantile and budget remains. We prove hard-budget feasibility, projected-OGD regret for a convex linear accepted-update subproblem, and stability plus conditional finite-sample gate-selection statements. On public ETT capacity-planning tasks, a frozen calibration/evaluation split selects a gate that lowers held-out decision loss against always, fixed-period, and drift-triggered exact-update baselines under matched compute. Secondary threshold/load-index ETT suites are mixed: 33 of 41 selected contrasts clear the stricter cross-artifact Holm family, and the 8 nonpassing rows are explicitly excluded from primary claims. The same protocol improves an external UCI Bike capacity proxy with 20/0 held-out wins, and a fixed gate passes three full-year Capital Bikeshare station-rebalancing contrasts. Probe-based and finance experiments remain negative, delimiting the current scope of decision-prioritized adaptation.
Public service programs often allocate limited resources under uncertainty about their benefits, creating a need for randomization to support credible evaluation. In practice, however, applicants commonly enter waitlists where resources are prioritized toward individuals judged to have higher need through tiered priority queues, making direct randomization difficult. Motivated by this, we develop an experimental design framework for learning treatment effects while treating those most in need where incoming applicants are randomized into priority queues based on their assessed risk scores. Treatments are then provided across queues in priority order and first-in-first-out within queue as budget becomes available. Our contributions are two-fold. First, we characterize what causal effects are identified under this priority-queue allocation. When arrivals are exogenous, treatments are conditionally randomized, and hence standard estimands are identified; when arrivals are endogenous, queue randomization instead provides an instrument for treatment, identifying local treatment effects induced by the queuing process. Second, we develop optimized queue-assignment designs that trade off statistical efficiency against prioritizing higher-need applicants. We show in the process that, despite dependence in treatment assignments induced by the design, usual iid efficiency bounds remain well-justified design objectives. We illustrate the proposed designs using data from a housing allocation program in a large U.S. county.
JungHo Lee, Johnna Sundberg, Pim Welle +1
1Carnegie Mellon University · 2Allegheny County Department of Human Services
Personal and organizational planning systems maintain two records that drift apart: what was planned (a task's effort budget) and what was done (a logged action's duration and description). Existing systems bridge them with an exclusive, all-or-nothing link that strands genuinely related but unlinked effort and reports false stalls on active goals. We formulate the bridge as a quasi-linear Fisher market: planned tasks are budget-constrained buyers, performed actions are divisible goods, and a fused text/structural/temporal signal sets each buyer's valuation. Two market instruments - a seller reserve price and a buyer cash option - yield conservation, a hard budget cap, and a provable junk filter as theorems. We extend the market with a concave completion utility discounting progress as a task nears its plan; standard convergence theory for the market's algorithm does not transfer here, resolved by a satiation-threshold fixed point with existence (Brouwer) and local uniqueness under an explicit diagonal-dominance condition, validated empirically on random and adversarial instances. A de-circularized, multi-seed benchmark - observed affinity corrupted independently of the scored ground truth - surfaces a genuine weak spot: the market's sharp, zero-entropy equilibrium is more sensitive to affinity noise than entropy-regularized optimal transport's permanently smoothed one. We resolve this with a one-parameter entropy-regularized generalization unifying the two, plus a noise-adaptive rule for its regularization strength. We report full reproducibility parameters, discuss limitations candidly, and relate the result to multi-touch attribution, optimal transport, and online Fisher-market algorithms.