cs.LGNov 19, 2026

The Window Lever: Longer Observation Windows Outweigh the Observed Effects of Data, Capacity, and Architecture in Customer Behavior Forecasting

Authors: Tara Sowrirajan, Yanqiao Wang

Organizations: Amazon

Abstract

In our experiments on long-horizon customer-behavior forecasting, a longer observation window outweighed the observed effects of more data, more capacity and newer architectures. The window is the weeks of history a model sees before the week it forecasts from. Going from an 8- to a 16-week window adds a raw +0.070 to 0.107 log-space R2R^2 in every family at 1M. Matched test cohorts, which score the same customer-weeks at every window, show this raw comparison understates the gain in every family they cover. The direction holds on five public datasets, four spanning over a year (ridge and our transformer on all five). On our internal data, longer windows admit up to 10% more and colder training customers, which matching does not fix. Our design does not separate window length from calendar coverage, because every test anchor (the week a forecast is made from) falls in one eight-week band. On training-period anchors, the weekly ridge probe's gain persists outside the holiday season, keeping about 72% of it. We therefore report a robust positive association with longer windows and do not identify the magnitude of a calendar-independent history effect. Of four internally registered predictions, the only fully blind one failed. An activity-mixture model predicted +0.014 from 24 to 32 weeks; the weekly-aggregate probe returned -0.0004. For the sequence families, the other three levers are about an order of magnitude smaller, bounded and unresolved. Their observed effects are at most 0.006 between the nominal 1M and 10M tiers and 0.0052 among five sequence families at 16 weeks with clocks as built, both single-seed on the full test split, and 0.006 for capacity on three-seed means. These are observed intervals, not equivalence bounds. Our claim is the order-of-magnitude contrast between the window and those bounds. A team building on this class of data should start by lengthening the window.

Figures & tables

Appendix figures & tables1 asset

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Why Do Time Series Models Need Long Context Windows?

    Jun 1, 2026Luca Butera, Giovanni De Felice, Andrea Cini +1Time Series ForecastingLong-Context Modeling

  2. How Early Is Early Enough? Design-Dependent Observation-Window Sufficiency in Subscription Churn Prediction

    Jul 1, 2026Xiao Han, Yao Xiao, Chenyu Wu +1

  3. Temporal horizons in forecasting: a performance-learnability trade-off

    Jun 4, 2025Pau Vilimelis Aceituno, Jack William Miller, Noah Marti +2Long-Term Time Series ForecastingTime Series Forecasting