Machine learning cannot decarbonise the subsurface until it can be audited
Organizations: Institute of GeoEnergy Engineering, Heriot-Watt University, Edinburgh, UK · Subsurface Energy Transition and Innovation Centre, Heriot-Watt University, Edinburgh, UK · SubsurfaceLabs, Abu Dhabi, UAE · Lyell Centre, Heriot-Watt University, Edinburgh, UK
Abstract
Geological CO2 storage, geothermal energy and underground hydrogen storage depend on irreversible or high-cost decisions made with sparse data and incomplete physical understanding. Machine learning (ML) increasingly informs these decisions, yet methods are usually judged on predictive accuracy rather than on whether their outputs can be trusted, traced and acted upon. We argue that subsurface ML should be designed as decision infrastructure with shared systems that carry calibrated uncertainty and provenance from observation to operating decision. We propose a decision-readiness checklist, an audit-trail workflow for monitoring updates, and benchmark designs that score models by the decisions they support. We identify validation needs shared across the three technologies, and the data-access and governance steps needed for ML to support regulatory and investment decisions.
Figures & tables
| CO 2 storage | Geothermal / EGS | H 2 storage | |
| Shared data types | Seismic surveys, well logs, core and SCAL data, downhole pressure and temperature, microseismic monitoring, legacy reports and analogues. | ||
| Shared ML methods | Uncertainty-aware surrogates, ensemble data assimilation, structure-aware geological priors, hybrid physics-ML, multi-fidelity learning, value-of-information monitoring design. | ||
| Primary decision variables | Containment probability, pressure footprint, plume conformance | Thermal breakthrough time, induced seismicity risk, sustainable flow rate | Cyclic deliverability, recovery efficiency, containment under cycling |
| Dominant coupled physics | Multiphase flow, dissolution and residual trapping, pressure-driven geomechanics | Heat transport, fracture-dominated thermo-hydro-mechanical coupling | Hysteretic multiphase flow under cycling, microbial and geochemical H 2 reactions, cushion-gas mixing |
| Operational regime | One-way injection over decades; stewardship over centuries | Continuous circulation over years to decades | Seasonal to weekly injection-withdrawal cycles |
| System-specific data | Time-lapse (4D) seismic, surface deformation from interferometric synthetic aperture radar (InSAR), geochemical assurance monitoring | Tracer tests, temperature and flow logs, dense microseismic catalogues | Per-cycle pressure and gas-composition histories, well deliverability tests |
| Diagnostic | What it measures | Decision consequence |
|---|---|---|
| Reliability diagram / calibration curve | Whether stated probabilities match observed frequencies | Supports traffic-light decisions when calibration is verified at the relevant risk levels and under the intended operating conditions |
| Prediction-interval coverage | Fraction of held-out outcomes falling inside stated intervals | Illustratively, 90% intervals covering 60% of held-out pressure data indicate undercoverage; recalibrate uncertainty and reassess pressure-limit exceedance before operational use |
| Continuous ranked probability score (CRPS) | Sharpness and calibration of the full predictive distribution 22 | Ranks competing forecast systems for pressure or plume evolution on a proper basis |
| Rank / probability-integral-transform histograms | Empirical rank or PIT distributions relative to uniformity | Assess calibration across operating regimes and evaluate tail-event probabilities directly for seismicity and leakage decisions |
| Expected calibration error (classifiers) | Aggregate miscalibration of event probabilities | Summarises probability calibration; false-alarm and missed-detection rates require threshold-specific evaluation |
| Conformal coverage | Distribution-free finite-sample marginal coverage under exchangeability 24 | Requires decision-specific validation and validity-domain monitoring; distribution shift can invalidate coverage |
| Field | Mature practice | Transfers to subsurface | Does not transfer |
|---|---|---|---|
| Numerical weather prediction | Continuous ensemble verification; proper scoring rules (CRPS); routine reliability reporting 22 ; 23 | Scoring MMV and deliverability forecasts like weather forecasts; calibration as a reported norm | Verification volume: millions of daily outcomes versus a handful of slow, confounded field outcomes |
| Clinical ML | TRIPOD+AI reporting standard 65 ; model cards 66 ; device approval pathways | Structured reporting of data, validation, intended use, and failure modes; pre-deployment review | Patient-scale cohorts; randomised evaluation of the decision itself |
| Aviation and nuclear safety | Mandatory incident reporting; shared failure-mode catalogues; safety cases | Standardised failure-mode reporting and safety-case structure for ML workflows | Component-level failure statistics built from large fleets |
Scientific ML
Scientific machine learning combines data-driven models with scientific knowledge to analyze, predict, and simulate complex systems.
See all 122 papers