Conformal Predictive Distributions for Contextual Order Fulfillment Optimization
Organizations: H. Milton Stewart School of Industrial & Systems Engineering, Georgia Institute of Technology, Atlanta, Georgia, USA
Abstract
Ship-to-home fulfillment requires a retailer to select a fulfillment location and carrier before the delivery time is known. These decisions often rely on static transit-time estimates, which cannot represent how delivery-time uncertainty varies across orders and fulfillment options. This paper constructs conformal predictive distributions (CPDs) using Conformal Predictive Systems (CPS) for regression and the cross Venn-Abers predictor (CVAP) for multiclass classification, and uses them in a contextual optimization model for fulfillment decisions. The model is solved by contextual sample-average approximation (C-SAA). The regret of each fulfillment decision, its expected cost above that of the best decision, is bounded by forecast error, scenario-evaluation error, and the candidate-generation gap. The forecast term depends on how well calibration residuals or class probabilities represent the current order. On more than five million proprietary order records, CVAP raises exact-day accuracy from 49.5% for the rule-based estimate to 64.1%. Paired with a decision rule that selects a quantile weighting late errors more heavily, the split CPS (SCPS) gives a point estimate that raises late-delivery detection from 3.8% to 79.4%. Residual-based CPS distributions also meet or slightly exceed nominal interval-coverage targets. In decision experiments with a JD.com simulator over six test dates, C-SAA with CVAP lowers mean total cost by 7.1% and C-SAA with the Mondrian CPS (MCPS) lowers it by 6.7%, relative to C-SAA with the original nonconformal forecast. Both cut the late-delivery rate from 5.7% to below 4.0%.
Figures & tables
| Policy / forecast | Mean total cost (\downarrow$ | Late-delivery rate (%) |
| C-SAA + MC-CLF (CVAP) | 802,106 3,246 | 3.93 0.07 |
| C-SAA + MCPS | 805,419 3,208 | 3.96 0.07 |
| C-SAA + SCPS | 807,636 3,563 | 4.11 0.07 |
| C-SAA + MC-CLF (IVAP) | 817,676 3,375 | 4.55 0.07 |
| C-SAA + original nonconformal forecast | 863,422 3,555 | 5.68 0.07 |
| Greedy | 928,970 4,066 | 9.80 0.08 |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
| Policy / forecast | Median | 75th pct. | 90th pct. | 95th pct. |
| C-SAA + MC-CLF (CVAP) | 800,405 | 808,088 | 816,848 | 819,614 |
| C-SAA + MCPS | 803,530 | 810,090 | 816,314 | 829,527 |
| C-SAA + SCPS | 804,657 | 815,038 | 820,867 | 828,461 |
| C-SAA + MC-CLF (IVAP) | 816,933 | 823,776 | 830,660 | 839,791 |
| C-SAA + original nonconformal forecast | 862,575 | 868,575 | 874,476 | 884,565 |
| Greedy | 925,308 | 936,506 | 951,517 | 959,385 |