Anisotropic Permeability Tensor Prediction from Porous Media Microstructure via Physics-Informed Progressive Transfer Learning with Hybrid CNN-Transformer
Organizations: Faculty of Mathematics and Natural Sciences, University of Oslo, PO Box 1047 Blindern, 0316 Oslo, Norway
Abstract
Accurate prediction of permeability tensors from pore-scale microstructure images is essential for subsurface flow modeling, yet direct numerical simulation requires hours per sample, fundamentally limiting large-scale uncertainty quantification and reservoir optimization workflows. A physics-informed deep learning framework is presented that resolves this bottleneck by combining a MaxViT hybrid CNN-Transformer architecture with progressive transfer learning and differentiable physical constraints. MaxViT's multi-axis attention mechanism simultaneously resolves grain-scale pore-throat geometry via block-local operations and REV-scale connectivity statistics through grid-global operations, providing the spatial hierarchy that permeability tensor prediction physically requires. Training on 20000 synthetic porous media samples spanning three orders of magnitude in permeability, a three-phase progressive curriculum advances from an ImageNet-pretrained baseline with D4-equivariant augmentation and tensor transformation, through component-weighted loss prioritizing off-diagonal coupling, to frozen-backbone transfer learning with porosity conditioning via Feature-wise Linear Modulation (FiLM). Onsager reciprocity and positive definiteness are enforced via differentiable penalty terms. On a held-out test set of 4000 samples, the framework achieves variance-weighted R2 = 0.9960 (R2_Kxx = 0.9967, R2_Kxy = 0.9758), a 33% reduction in unexplained variance over the supervised baseline. The results offer three transferable principles for physics-informed scientific machine learning: large-scale visual pretraining transfers effectively across domain boundaries; physical constraints are most robustly integrated as differentiable architectural components; and progressive training guided by diagnostic failure-mode analysis enables unambiguous attribution of performance gains across methodological stages.
Figures & tables
| Component | RMSE | MAE | RRMSE (%) | KGE | ||
| 0.9961 | 5.77 | 0.986 | 0.9990 | |||
| 0.9962 | 5.70 | 0.989 | 0.9990 | |||
| 0.9725 | 26.07 | 0.176 | 0.9930 | |||
| 0.9725 | 26.07 | 0.176 | 0.9930 | |||
| Overall | 0.9843 | 8.19 | 0.988 | 0.9992 |
| Metric | Phase 4 | Phase 3 | Phase 2 | |
| Global accuracy | ||||
| (variance-weighted) | 0.9960 | 0.9945 | 0.9940 | |
| (component-averaged) | 0.9863 | 0.9848 | 0.9843 | |
| 95 % BCa CI | [0.9852, 0.9874] | [0.9833, 0.9860] | [0.9830, 0.9856] | |
| RMSE | ||||
| 95 % BCa CI | [0.01483, 0.01704] | [0.01617, 0.01794] | [0.01694, 0.01948] | |
Appendix figures & tables13 assets
Supplementary material from the paper’s appendix.
Appendix
| Property | Train | Validation | Test |
| Partitioning | |||
| Number of samples | 16,000 | 4,000 | 4,000 |
| Image dimensions | |||
| Microstructure geometry | |||
| Strictly binary (no. non-binary pixels) | True (0) | True (0) | True (0) |
| Porosity (mean std) | |||
| Split | Kozeny-Carman | Power law | ||||
| Train | 0.0242 | 0.789 | 1.337 | 4.81 | 0.777 | 0.967 |
| Val | 0.0240 | 0.791 | 1.337 | 4.84 | 0.776 | 0.967 |
| Test | 0.0243 | 0.790 | 1.371 | 4.89 | 0.791 | 0.968 |
| Pair | Variable | KS stat | -value | JSD |
| Train vs. Val | 0.0154 | 0.432 | 0.00353 | |
| 0.0174 | 0.286 | 0.00305 | ||
| 0.0134 | 0.605 | 0.00368 | ||
| 0.0141 | 0.547 | 0.00355 | ||
| Train vs. Test | 0.0141 | 0.541 | 0.00312 | |
| 0.0106 | 0.864 | 0.00385 |
| Split | Mahalanobis ( ) | High ( ) | Low ( ) | High AR ( ) |
| Train ( ) | 160 (1.00 %) | 159 ( ) | 160 ( ) | 800 (AR ) |
| Val ( ) | 40 (1.00 %) | 40 ( ) | 40 ( ) | 200 (AR ) |
| Test ( ) | 40 (1.00 %) | 39 ( ) | 40 ( ) | 200 (AR ) |
| Stage | Spatial resolution | Channels | MaxViT blocks | Attention regime |
| 1 | 64 | 2 | Block ( blocks) + Grid | |
| 2 | 128 | 6 | Block ( blocks) + Grid | |
| 3 | 256 | 14 | Full self-attention (spatial ) | |
| 4 | 512 | 3 | Full self-attention (spatial ) |
| Phase | Epochs | Init. from | LR max | LR min | WU | WD | BS | Pat. |
| 2 | 600 | ImageNet | 50 | 0.05 | 32 | 100 | ||
| 3 | 600 | Phase 2 | 50 | 0.01 | 32 | 100 | ||
| 4 | 600 | Phase 3 | 50 | 0.01 | 32 | 150 |
| Epoch range | Trainable components |
| 0–50 | Regression head only (backbone frozen) |
| 50–150 | Regression head + backbone Stages 3–4 |
| (Stages 1–2 and stem frozen) | |
| 150–600 | Full model (all parameters) |
| Phase | ||||
| 2 | 0.10 | 0.05 | ||
| 3–4 | 0.20 | 0.05 | 1.0 |
| Transformation | ||
| Identity | ||
| Rotation | ||
| Rotation | ||
| Rotation | ||
| Horizontal flip | ||
| Vertical flip |
| Comp. | Metric | Observed | Boot. mean | CI low | CI high |
| 0.99674 | 0.99673 | 0.99626 | 0.99708 | ||
| RMSE | |||||
| MAE | |||||
| MAPE (%) | 7.09 | 7.08 | 6.64 | 7.61 | |
| RRMSE (%) | 5.25 | 5.25 | 4.96 | 5.67 | |
| 0.97583 | 0.97579 | 0.97359 | 0.97792 |
| AR bin | RRMSE (%) | RRMSE (%) | RRMSE (%) | |||
| 1.115 | 0.9966 | 0.8152 | 0.1814 | 3.68 | 60.44 | 3.85 |
| 1.233 | 0.9968 | 0.9148 | 0.0820 | 3.98 | 39.46 | 3.90 |
| 1.334 | 0.9966 | 0.9690 | 0.0276 | 4.32 | 24.32 | 3.78 |
| 1.439 | 0.9972 | 0.9756 | 0.0216 | 4.03 | 21.92 | 3.91 |
| 1.556 | 0.9963 | 0.9830 | 0.0133 | 5.40 | 20.71 | 5.03 |
| 1.699 | 0.9963 | 0.9836 | 0.0127 | 6.59 | 23.10 | 5.17 |
| Comp. | RMSE | |||||
| 0.9967 | 0.229 | |||||
| 0.9756 | 0.304 | |||||
| 0.9756 | 0.304 | |||||
| 0.9967 | 0.235 | |||||
| Global | — | — | — | — |
| Metric | Phase 4 | Phase 3 | Phase 2 | |
|---|---|---|---|---|
| A. Global accuracy | ||||
| (component-averaged) | 0.98628 | 0.98476 | 0.98429 | |
| 95 % BCa CI | [0.98516, 0.98738] | [0.98333, 0.98604] | [0.98304, 0.98563] | |
| Bootstrap | 0.00059 | 0.00068 | 0.00070 | |
| (variance-weighted) | 0.99604 | 0.99452 | 0.99403 | |
| MSE | ||||
Materials Property Prediction
Materials property prediction uses data and physical models to estimate how composition, structure, and processing determine a material’s behavior.
See all 173 papers