State-Space Unlearning for Non-Stationary Bias in Land Surface Forecasting
Organizations: Heritage Institute of Technology, Kolkata, India
Abstract
Operational land surface forecasting systems built on Mamba-family Structured State Space Models absorb non-stationary confounding events (unrecorded irrigation booms, dam-operation shifts, sensor recalibrations) into their state-transition matrices, silently biasing NDVI, LST, and crop phenology predictions long after the physical cause ends. This paper introduces SSU-LSF (State-Space Unlearning for Land Surface Forecasting), the first machine-unlearning framework purpose-built for geoscientific Mamba-based SSMs. We develop EKFac influence functions specialized to the Mamba state matrices via a closed-form matrix-exponential gradient, use spectral-radius-weighted elbow thresholding to localize a temporal confounding footprint , and apply Hessian-free projected gradient ascent within a KL-divergence trust region augmented by spatial total-variation (TV) regularization. Proposition 1 establishes that residual confounding is bounded by , which grows with the window length . Across three heterogeneous benchmarks and eleven baselines, SSU-LSF achieves confounding reduction rates of (CropHarvest), (NDVI-LST), and (ERA5), with worst-case clean-domain RMSE degradation of on ERA5, converging in 3--5 epochs at lower GPU-cost per unlearning request than full retraining. Code: https://github.com/Anidipta/SSU-LSF
Figures & tables
| NDVI-LST Fusion | ERA5 Patchified | CropHarvest | ||||||||
| Method | RMSE | CRR | TCI | SKT-R | MIA | ACC | Sp-R | SCS | F1 | GPU-h/req |
| CM | 0.0681 | 0.000 | 0.601 | 2.97 | 0.84 | 0.612 | 0.0543 | 0.083 | 0.697 | – |
| OR † | 0.0398 | 1.000 | 0.891 | 1.19 | 0.51 | 0.903 | 0.0371 | 0.079 | 0.871 | 47.3 |
| SISA [ 13 ] | 0.0418 | 0.612 | 0.833 | 1.26 | 0.52 | 0.871 | 0.0395 | 0.088 | 0.834 | 58.4 |
| GR [ 11 ] | 0.0461 | 0.741 | 0.774 | 1.47 | 0.57 | 0.843 | 0.0428 | 0.127 | 0.799 | 2.3 |
| SR [ 11 ] | 0.0439 | 0.778 | 0.798 | 1.38 | 0.55 | 0.858 | 0.0411 | 0.102 | 0.817 | 7.9 |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Module | Configuration | Key parameters | Params (M) |
|---|---|---|---|
| Patch embedding | Conv2d(5,256,4,stride 4) | , mean pool | 1.0 |
| Mamba encoder | block | , , , drop 0.1 | 39.8 |
| Output norm | LayerNorm(256) | extract | 0.0 |
| Forecast head | MLP 256-512-512-60, GELU | , | 6.5 |
| Total | 47.3 |
| Component | NDVI-LST | ERA5 | CropHarvest | Method |
|---|---|---|---|---|
| Forecast head only | 4.1 | 4.1 | 4.1 | Spectral norm product |
| Full encoder | 17.8 | 18.3 | 16.9 | Randomized smoothing |
| Benchmark | MMD (ref. model) | -value | |
|---|---|---|---|
| NDVI-LST | |||
| ERA5 | |||
| CropHarvest |
| NDVI-LST | ERA5 | CropHarvest | |
|---|---|---|---|
| CRR | |||
| RMSE% |
| Method | SCS | FSS ( ) |
|---|---|---|
| EWC-UL | 0.134 | 0.571 |
| GR | 0.127 | 0.588 |
| ARCANE | 0.109 | 0.619 |
| FAST | 0.099 | 0.638 |
| SR | 0.102 | 0.633 |
| ForgetFS | 0.096 | 0.649 |
| NDVI-LST | CropHarvest | |||||
|---|---|---|---|---|---|---|
| Method | CRR | RMSE% | SCS | CRR | RMSE% | SCS |
| ForgetFS | 0.814 | 4.3 | 0.096 | 0.772 | 3.8 | 0.093 |
| ForgetFS+TV | 0.815 | 4.4 | 0.084 | 0.773 | 3.9 | 0.083 |
| MULL | 0.817 | 3.8 | 0.089 | 0.779 | 3.0 | 0.086 |
| MULL+TV | 0.818 | 3.9 | 0.082 | 0.780 | 3.1 | 0.082 |
| SSU-LSF | 0.821 | 3.5 | 0.081 | 0.773 | 2.1 | 0.081 |
| mo | mo | mo | mo | |
|---|---|---|---|---|
| SSU-LSF CRR | ||||
| Fitted | ||||
| Oracle Retrain CRR | ||||
| GR CRR | ||||
| Window-estimate error mo |
| NDVI-LST Fusion | ERA5 Patchified | |||||||
|---|---|---|---|---|---|---|---|---|
| Method | EKFac | FP | Ascent | Total | EKFac | FP | Ascent | Total |
| OR † | – | – | – | 18.4 | – | – | – | 47.3 |
| SISA | – | – | – | 22.1 | – | – | – | 58.4 |
| GR | – | – | 0.9 | 0.9 | – | – | 2.3 | 2.3 |
| ForgetFS | – | – | 2.9 | 2.9 | – | – | 8.1 | 8.1 |
| MULL | – | – | 2.1 | 2.1 | – | – | 6.4 | 6.4 |
| Block | 1 | 2 | 3 | 4 | 5 | 6 |
|---|---|---|---|---|---|---|
| Mean | 0.79 | 0.82 | 0.84 | 0.86 | 0.87 | 0.88 |
| Std | 0.02 | 0.02 | 0.03 | 0.03 | 0.03 | 0.03 |
| Min | 0.74 | 0.77 | 0.79 | 0.81 | 0.82 | 0.83 |
| Max | 0.83 | 0.86 | 0.88 | 0.90 | 0.91 | 0.91 |
| Configuration | CRR | RMSE% | MIA | SCS |
|---|---|---|---|---|
| Full SSU-LSF | 0.821(0.010) | 3.5(0.2) | 0.53(0.01) | 0.081(0.003) |
| w/o only | 0.694(0.012) | 8.2(0.4) | 0.59(0.02) | 0.092(0.003) |
| w/o KL only | 0.831(0.009) | 21.7(1.1) | 0.52(0.01) | 0.088(0.004) |
| w/o TV only | 0.819(0.010) | 3.6(0.2) | 0.53(0.01) | 0.131(0.006) |
| w/ GCS (not EKFac) | 0.751(0.015) | 5.1(0.3) | 0.56(0.02) | 0.094(0.004) |
| w/ Diag. Fisher | 0.779(0.013) | 4.6(0.3) | 0.55(0.01) | 0.091(0.003) |
| 0 | 0.003 | 0.01 | 0.03 | 0.1 | |
|---|---|---|---|---|---|
| CRR | 0.819 | 0.820 | 0.821 | 0.815 | 0.792 |
| RMSE% | 3.6 | 3.5 | 3.5 | 4.1 | 6.3 |
| SCS | 0.131 | 0.097 | 0.081 | 0.079 | 0.078 |
Machine Unlearning
Machine unlearning removes the influence of selected data or concepts from trained models while preserving useful behavior and avoiding full retraining.
See all 354 papers