A Fairness Audit of the Duckworth-Lewis-Stern Method: Format-Specific and Gender-Differential Bias, with an Interpretable Calibration Layer for Cricket Target Revision
Organizations: St. Xavier’s College (Autonomous), Kolkata, India
Abstract
The Duckworth-Lewis-Stern (DLS) method has been the international standard for revising target scores in rain-interrupted limited-overs cricket since 1999. Despite over two decades of operational use, no large-scale empirical audit of its prediction bias has been published. We conduct such an audit on 8,150 international matches (3,095 ODIs, 5,055 T20Is) from Cricsheet, generating 233,550 synthetic interruption scenarios with temporal splits. We document two structured biases. First, DLS prediction error spans a 137-run range across (overs-remaining, wickets-lost) match-state buckets. Second, DLS exhibits a gender-differential bias on ODIs that has not previously been quantified: on the training split, mean over-prediction is +1.51 runs for men but +7.63 runs for women, a gap of +6.13 runs (F = 195.16, p < 10^-43). We benchmark DLS against five modern alternatives: Bi-LSTM, XGBoost, an enriched XGBoost variant, a deep context-aware model, and a stacking ensemble, and propose DLS-Cal, a lightweight interpretable calibration layer (27K parameters) outputting a state-conditioned correction added to DLS. DLS-Cal reduces absolute bias by 31% on ODI and 19% on T20I, and a gender-aware variant reduces women's ODI residual bias from +6.19 to +0.65 runs while leaving men's calibration unchanged. We release code, models, and data.
Figures & tables
| Term | Definition |
|---|---|
| Prediction error | (predicted minus actual remaining runs) |
| Signed mean bias | (may cancel across states) |
| Mean absolute bias | |
| Per-bucket mean bias | signed mean of within an (overs, wickets) cell |
| Residual bias | signed mean of after applying a correction (e.g. DLS-Cal) |
| Gender gap | (female mean bias) (male mean bias), at matched states |
| Format | Gender | N | Mean bias | RMSE | Mean bias |
|---|---|---|---|---|---|
| ODI | male | 60,660 | 41.82 | 32.87 | |
| ODI | female | 10,350 | 38.49 | 30.60 | |
| T20 | male | 46,740 | 25.51 | 20.50 | |
| T20 | female | 22,410 | 23.06 | 18.04 |
| Method | Type | RMSE | MAE | Bias | RMSE ODI | RMSE T20 | WFR 5 ODI | WFR 5 T20 |
|---|---|---|---|---|---|---|---|---|
| DLS (original) | baseline | 37.41 | 30.54 | 43.25 | 36.25 | 92.0% | 90.0% | |
| DLS (recalibrated) | baseline | 36.84 | 30.01 | 43.42 | 35.51 | 93.0% | 89.0% | |
| DLS (canonical) | baseline | 28.92 | 22.61 | 42.84 | 25.57 | 91.0% | 85.0% | |
| Simple LSTM | deep | 24.42 | 18.22 | 38.92 | 20.70 | 88.0% | 80.0% | |
| XGBoost | tree | 22.20 | 16.77 | 31.00 | 20.19 | 84.0% | 79.0% | |
| XGBoost-Plus | tree | 23.46 | 17.57 | 32.33 | 21.45 | 84.0% | 79.0% |
| Correction scheme | RMSE | MAE | Bias |
|---|---|---|---|
| DLS (uncorrected) | 28.88 | 22.58 | |
| Bucket-mean lookup | 37.20 | 29.79 | |
| Linear (full features) | 22.80 | 17.31 | |
| MLP, no bucket prior | 22.02 | 16.52 | |
| MLP, full (DLS-Cal) | 22.09 | 16.57 |
| Method | Gender | N | RMSE | MAE | Bias [95% CI] |
|---|---|---|---|---|---|
| DLS canonical | male | 40,530 | 30.28 | 23.64 | |
| female | 28,560 | 26.88 | 21.15 | ||
| DLS-Cal (gender-blind) | male | 40,530 | 24.27 | 18.23 | |
| female | 28,560 | 22.92 | 17.00 | ||
| DLS-Cal (gender-aware) | male | 40,530 | 24.50 | 18.41 | |
| female | 28,560 | 22.11 | 16.53 |
Algorithmic Bias
Algorithmic bias studies how automated systems produce or amplify unfair outcomes across demographic groups, and how to measure and reduce them.
See all 100 papers