cs.LGMay 15, 2026

In-context learning enables continental-scale subsurface temperature prediction from sparse local observations

Authors: Daniel O'MalleyChristopher W. JohnsonJavier E. SantosPablo LaraSandro MalusàBharat SrikishanJohn KathArnab Mazumder+5 more

Organizations: Los Alamos National Laboratory

Abstract

Continental-scale knowledge of subsurface temperature is limited by the cost and sparsity of borehole measurements, but such information is essential for geothermal resource assessment and for understanding heat transport in the shallow crust. The thermal field reflects the interaction between lithology, crustal structure, radiogenic heat production, and advective fluid flow, sometimes producing sharp anomalies that are smoothed by conventional interpolation or difficult to capture with physical models. Here we introduce In-Context Earth, a transformer-based model that uses sparse local borehole observations as geological context to predict continuous temperature-at-depth fields with calibrated uncertainty. In the contiguous United States, the model achieves a mean absolute error of 4.7 °C, outperforming the physics-informed Stanford Thermal Model, a model based on AlphaEarth embeddings, the multimodal Transparent Earth model, and universal kriging, while resolving sharper thermal gradients in geothermal provinces. Its uncertainty estimates are well calibrated, with a Kolmogorov-Smirnov statistic of 2.5%. Without finetuning, the model adapts to Alberta, Australia, and the United Kingdom (UK) using only 20 local observations at inference time, maintaining high accuracy in geologically distinct test regions with a mean absolute error of 2.2 °C in Alberta, 6.2 °C in Australia, and 5.4 °C in the UK. Interpretability analyses show that the model learns internal representations of subsurface properties it never observes during training, including seismic velocities, geochemistry, and crustal structure, and uses these representations in physically consistent ways. More broadly, this work shows that in-context learning can use sparse borehole observations for continental-scale subsurface characterization, without requiring dense measurements or region-specific retraining.

Explore similar work

May 31, 2026physics.geo-ph

Korzhinskii-Net: Physics-Informed Neural Network for Sub-Surface Mineral Prospectivity Modelling

Mineral prospectivity modelling (MPM) underpins exploration economics, yet most operational pipelines reduce to data-driven classifiers trained on shallow surface proxies. Such models are blind to the subsurface physics that actually localises ore: heat advection, fluid flow, and lithology-dependent precipitation. We present Korzhinskii-Net, a 2-D radial physics-informed neural network (PINN) that couples Darcy flow, advective-diffusive heat transport, and a softplus-saturated reaction rate into a single differentiable forward model, weakly supervised by surface and remote-sensing proxies. The network is named after Dmitri S. Korzhinskii (1899-1985), whose theory of infiltration metasomatism provides the physical scaffold. We evaluate Korzhinskii-Net on six ore provinces spanning three commodity classes - Udokan (sandstone-hosted Cu), Sukhoi Log, Olimpiada, and Berezovskoye (orogenic Au), Vorontsovskoye (Carlin-type Au), and Dalnegorsk (skarn polymetallic) - under a fair, leakage-controlled 5-fold cross-validation protocol with hard ring-shaped negatives and baseline proxy features disabled. Korzhinskii-Net attains a mean PR-AUC of 0.708 versus 0.235 for the strongest classical baseline (support vector machine), and a mean fractional rank of 0.036 versus 0.475. The improvement is consistent across all six provinces and three commodity systems, suggesting that physics-informed differentiable simulators, even when constrained only by global open-data proxies, can recover localisation patterns that pure feature-based learners systematically miss. We release the full pipeline and evaluation harness as open source.
Boris Kriuk
Jul 14, 2026cs.LG

A hybrid analytical-PINN model for subsurface simulation of geothermal heat exchangers in heterogeneous underground

In this paper, a parametric physics-informed neural network for solving the heterogeneous soil thermal problem with borehole heat exchangers (BHEs) as singular sources is developed. There are three novel features in the present framework; namely, (i) the singularity is naturally removed by using analytical line source models; (ii) using the explicit formulation for gradient thermal conductivity enables physics-informed learning of the parametrization featuring the conductivity; (iii) the learned correction is utilized as an efficient universal corrector via superposition principles. We first introduce the decomposition of the temperature change and transform the approximation of the entire heterogeneous response to the correction compensating the difference between the practical solution and idealized homogeneous approximation. In such a way, the delta function singularity is excluded and the bulk heat transfer is captured for the sake of facilitating the effective training of the neural network. The original problem is then reformulated as a governing correction diffusion or advection-diffusion equation subject to a homogeneous initial condition. The linearly varying thermal conductivity is used to model the soil heterogeneity. We propose a physics-informed neural network to approximate a universal corrector with respect to a single borehole with unit heat extraction rate. As a result, the network is trained by minimizing the physics-informed and data-anchored loss function that is evaluated for sampled conductivity parameters on adaptively selected training points. In addition, we include the location indicator function regarding the source as a feature input of network and find that it helps the network to process the local information. We perform numerical tests to exhibit the effectiveness of the proposed method based on three different analytical models.
Moke Rao, Thomas Hamacher, Smajil Halilovic
Sep 8, 2026physics.geo-ph

Bayesian deep learning integration of geophysical and drilling data for 3D prediction of copper mineralization and drill targeting: a case study from the Kogodai prospect, Rudny Altai

Exploration drill targeting in structurally complex terranes is hindered by sparse sampling, heterogeneous datasets, and the ambiguity of geophysical inversions. Here, we present an uncertainty-aware 3D workflow for the acceleration of time-to-discovery in brownfield explorations and apply it to the Kogodai prospect in the Rudny Altai metallogenic province. We jointly analyse existing drilling and geophysical data in a comprehensive approach, revealing hidden patterns in already available data. Drillholes and trenches were desurveyed to a common 3D reference frame, and assays were composited to a consistent spatial support to facilitate joint modelling with geophysical inputs. We develop Bayesian deep-learning models to predict 3D fields of Cu grade together with chargeability and apparent resistivity while quantifying epistemic uncertainty via Monte Carlo sampling. The original contribution of this work is to treat the problem not as pointwise regression between co-located observations, but as joint learning of spatially continuous 3D fields from sparse, heterogeneous exploration evidence. The resulting 3D predictions delineate a principal mineralized trend and several localized candidate zones that coincide with elevated induced polarization (IP) responses, while uncertainty mapping highlights where predictions are robust versus where additional drilling would be most informative. The continuous Cu-grade field can also be thresholded to produce binary prospectivity maps, allowing the sensitivity of target delineation to the chosen cutoff to be evaluated. The outputs are intended for qualitative interpretation and risk-aware drill targeting rather than resource estimation, and we discuss key limitations arising from incomplete provenance metadata for geophysical products and heterogeneity of historical sampling.
Margarita Veshchezerova, Egor Barashov, Evgenii Gusev +4