cs.LGAug 14, 2026

Probabilistic indirect models for undrained shear strength: addressing significant data missing and variability with advanced imputation and machine learning techniques

Authors: Haibin Xiong, Shaoheng Dai, Peng Lan, Xuzhen He, Chenxi Tong, Sheng Zhang, Daichao Sheng

Organizations: School of Civil and Environmental Engineering, University of Technology Sydney, Ultimo, NSW 2007, Australia. · School of Infrastructure Engineering, Nanchang University, Xuefu Road, 999, Nanchang 330031, China. · School of Civil Engineering, Central South University, Changsha, 410075, China.

Read PDF
Ask AI
Cite

Copy citation

DOINot available for this paper

Abstract

Accurate prediction of undrained shear strength (su) is crucial for geotechnical design, but is often hampered by substantial uncertainty in traditional empirical methods. This study uses the CLAY/10/7490 global database to develop probabilistic indirect models to predict su based on Atterberg limits and piezocone cone penetration (CPTU) measurements. Firstly, the dataset has a high missing data rate and variability. We test three imputation methods - multivariate normal (MN), multiple imputation by chained equations (MICE), and miss forest (MF) - to fill the missing values. To validate their effectiveness, a Probabilistic Extreme Gradient Boosting (PXGB) model is developed, and the imputation methods are evaluated by comparing the PXGB's performance when trained on the imputed datasets against that on the original incomplete data. Secondly, the indirect model is built by integrating a multi-head attention (MHA) mechanism into an artificial neural network (ANN) to enhance information extraction from limited data, which leads to the MHA-based probabilistic neural networks (MHA-PNN) model. The models' performance, alongside a conventional MN-based prediction model, was evaluated using root mean square error (RMSE), coefficient of determination (R2), mean absolute percentage error (MAPE), conditional interval width (wCI), and coverage rate (CR). Results demonstrate that the proposed MN-enhanced MHA-PNN model substantially outperforms other models in both prediction accuracy and uncertainty quantification. These findings highlight the potential of this integrated strategy for building robust probabilistic indirect models in geotechnical applications, particularly when confronted with sparse and incomplete datasets.

More in this topic

Materials Property Prediction

Materials property prediction uses data and physical models to estimate how composition, structure, and processing determine a material’s behavior.

See all 173 papers

Explore similar work

CardsList
Mar 22, 2026

TabPFN Extensions for Interpretable Geotechnical Modelling

Geotechnical site characterisation relies on sparse, heterogeneous borehole data, where uncertainty quantification and interpretability matter as much as predictive accuracy. We evaluate TabPFN~\citep{Hollmann2025}, a tabular foundation model, and its tabpfn-extensions library on two geotechnical tasks: (1) soil-type classification from N-value and shear-wave velocity data as a controlled illustrative case, and (2) iterative imputation of five mechanical parameters (sus_\mathrm{u}, EuE_{\mathrm{u}}, σ′p{σ'}_\mathrm{p}, CcC_\mathrm{c}, CvC_\mathrm{v}) in BM/AirportSoilProperties/2/2025. Without retraining, we apply cosine-similarity analysis to TabPFN embeddings, visualise predictive distributions, and compute SHAP attributions. On the regression benchmark we compare TabPFN with mean imputation, linear regression, random forests, XGBoost, and HBM; introduce a proxy decomposition of predictive uncertainty across context-perturbation classes; and propagate marginal CcC_\mathrm{c} and σ′p{σ'}_\mathrm{p} distributions through a one-dimensional consolidation model to obtain the reliability index ββ and serviceability exceedance probability PfP_\mathrm{f}. Embeddings exhibit label-consistent Clay/Sand grouping; iterative imputation reduces RMSE for all five targets, with TabPFN lowest on four; SHAP attributions are consistent with the Skempton compression-index correlation and the inverse preconsolidation-pressure-water-content dependence; the within-posterior component is largest in the proxy decomposition. We position the contribution as a worked evaluation workflow that may complement established methods for data-scarce geotechnics, not as algorithmic innovation.

Taiga Saito, Yu Otake, Daijiro Mizutani +1

Department of Civil and Environmental Engineering, Tohoku University, 6-6-06 Aramaki Aoba, Aoba-ku, Sendai, Miyagi 980-8579, Japan · Research Organization of Information and Systems, The Institute of Statistical Mathematics 10-3 Midori-cho, Tachikawa, Tokyo 190-8562, Japan · Department of Statistical Science, The Graduate University for Advanced Studies 10-3 Midori-cho, Tachikawa, Tokyo 190-8562, Japan

Uncertainty QuantificationTabular Foundation ModelsIncomplete Data ImputationMaterials Property PredictionTabular Regression
AskPDF
Mar 16, 2026

Predictive Uncertainty in Short-Term PV Forecasting under Missing Data: A Multiple Imputation Approach

Missing values are common in photovoltaic (PV) power data, yet the uncertainty they induce is not propagated into predictive distributions. We develop a framework that incorporates missing-data uncertainty into short-term PV forecasting by combining stochastic multiple imputation with Rubin's rule. The approach is model-agnostic and can be integrated with standard machine-learning predictors. Empirical results show that ignoring missing-data uncertainty leads to overly narrow prediction intervals. Accounting for this uncertainty improves interval calibration while maintaining comparable point prediction accuracy. These results demonstrate the importance of propagating imputation uncertainty in data-driven PV forecasting.

Parastoo Pashmchi, Jérôme Benoit, Motonobu Kanagawa

SAP Labs France, Mougins, France · EURECOM, Biot, France

Solar Power ForecastingUncertainty PropagationUncertainty CalibrationProbabilistic ForecastingLearning with Missing Data
AskPDF
May 25, 2026

Conformalised imprecise inference for robust extrapolation under limited data

Recent advances in uncertainty quantification increasingly emphasise the distinction between aleatory and epistemic uncertainty in machine learning, motivating the need for more unified frameworks. However, despite much progress in producing reliable predictions, existing methods often lack rigorous guarantees when generalising beyond the training domain. We propose a conformalised imprecise inference framework for robust extrapolation, which is model-agnostic and augments predictive models with imprecision and distance awareness. The proposed approach yields imprecise predictions (probability boxes) that remain valid under distributional shift, maintaining coverage while adaptively expanding uncertainty in extrapolation regimes. Experiments on synthetic and benchmark datasets demonstrate improved robustness and reliable coverage compared to standard probabilistic approaches, particularly under limited data.

Yu Chen, Scott Ferson

Institute for Risk and Uncertainty · University of Liverpool · Liverpool

Distribution Shift RobustnessUncertainty QuantificationOOD GeneralizationConformal PredictionImprecise Probability
AskPDF