Domain-decomposed Evolutional Deep Neural Network with Random Features for Transient Pressure Diffusion with Discontinuous and High-Contrast Coefficients
Authors: Peiqi Li, Jie Chen, Hui Zhang, Simon Hands
Organizations: Department of Applied Mathematics, Xi’an Jiaotong-Liverpool University, Suzhou, 215123, China · Department of Mathematical Sciences, University of Liverpool, Liverpool, L69 3BX, United Kingdom
Transient pressure diffusion in heterogeneous porous media becomes difficult to resolve efficiently when permeability is discontinuous and spans several orders of magnitude. We develop a domain-decomposed random-feature evolutional deep neural network (DD RF-EDNN) that separates spatial approximation from temporal evolution. Permeability-informed random features are compressed into an orthonormal pressure space, and a conservative finite-volume operator is projected onto this space so that only the reduced coordinates are advanced in time. This formulation retains the dissipative structure of the discrete flow problem without repeated neural-network optimization. The analysis quantifies dictionary and singular-value truncation errors, proves contractivity under an energy-consistent dissipativity correction, and derives a conditional grid-level estimate for homogeneous dynamics and time-independent data admitting a steady lifting. Experiments on low-permeability inclusions, high-conductivity channels and blocks, and three-dimensional grids demonstrate consistent accuracy across distinct coefficient structures. The method reaches a final-time relative L2 error of 9.54×10−4 in the principal benchmark and maintains errors on the order of 10−2 at a permeability contrast of 103. Numerical diagnostics further show that the observed error balance and temporal convergence are consistent with the analysis. These results support DD RF-EDNN as a structure-preserving and interpretable reduced formulation for transient simulations on prescribed heterogeneous media.
Figures & tables
Figure 1: Material-adapted domain decomposition and random-feature construction. (a) Material subregions {Ωm} and their interface set Γ . (b) Subregion-based feature allocation with additional enrichment near high-contrast interfaces. The schematic is independent of the benchmark geometry.
Stage
Arithmetic cost
Principal storage or reuse
Random-feature evaluation
O(NhM0)
O(NhM0) for the feature matrix
First thin SVD
O(NhM02)
Offline; produces the rank- r compression
Second thin SVD
O(Nhr2)
Offline; produces the rank- k pressure basis
Reduced-operator construction
O(nnz(Lh)k+Nhk2)
Offline; O(Nhk+k2) working storage
Crank–Nicolson factorization
O(k3)
Performed once for fixed Δt and B
Reduced time integration
O(Ntk2)
Online; two vectors and the factored k×k matrix
Table 1: Leading computational costs of the offline and online stages.
Symbol
Definition
Purpose
EpL2
∥ph(T)∥2∥ph(T)−pM(T)∥2
Final-time relative pressure error
EpL∞
∥ph(T)∥∞∥ph(T)−pM(T)∥∞
Final-time maximum relative pressure error
ρΔt
ρ[(Ik−2ΔtB)−1(Ik+2ΔtB)]
One-step stability diagnostic
Table 2: Summary of reported error metrics and stability diagnostic used in the numerical experiments.
Figure 2: Central low-permeability benchmark ( A=0.2 in the inclusion, A=1 elsewhere, and S=1 ). Finite-volume reference, DD RF-EDNN prediction, and absolute error at representative times on the 65×65 grid.
Figure 3: Final-time baseline comparison for the central low-permeability benchmark. The panels show the finite-volume reference, predictions from DD RF-EDNN and the four baselines, and their absolute errors at T=0.05 .
Method
Dimension
EpL2
EpL∞
ρΔt
Runtime (s)
Ours
469
9.54×10−4
1.08×10−3
0.9981
14.60
Global RF-EDNN
600
3.16×10−2
1.02×10−1
1.0000
8.76
RFM
600
4.25×10−2
1.47×10−1
0.9980
1.57
PINN
–
9.52×10−2
7.10×10−2
–
69.41
XPINN
–
3.11×10−2
1.30×10−1
–
165.52
Table 3: Final-time baseline comparison for the central low-permeability benchmark on the 65×65 grid.
Figure 4: Ablation and robustness analysis for the central low-permeability benchmark. The panels examine pressure-space whitening, recurrent correction, random-feature sampling, feature-space size, permeability contrast, and grid/time-step settings.
Setting
Dimension
EpL2
EpL∞
ρΔt
Ours
469
9.54×10−4
1.08×10−3
0.9981
No whitening
469
9.63×10−4
1.15×10−3
1.0000
With recurrent correction
469
9.59×10−4
1.08×10−3
0.9981
Small RF space
409
9.67×10−4
1.34×10−3
0.9981
Rich RF space
528
9.52×10−4
1.11×10−3
0.9981
Strong contrast, Ain=0.01
469
8.37×10−4
5.44×10−4
0.9995
Table 4: Representative final-time ablation and robustness results for the central low-permeability benchmark.
Figure 5: High-contrast permeability fields. Left: four high-permeability square inclusions with Km=1 and Kf=1000 . Right: stripe-like high-permeability fractures with Km=1 , Kf=1000 , and six randomly generated fracture channels. The color scale is shown in logarithmic form.
Figure 6: Four high-permeability block benchmark ( Km=1 , Kf=1000 , and S=50 ). Finite-volume reference and DD RF-EDNN prediction at representative times on the 65×65 grid.
Figure 7: Stripe-like high-permeability fracture benchmark ( Km=1 , Kf=1000 , nf=6 , and S=1 ). Finite-volume reference and DD RF-EDNN prediction at representative times under left–right Dirichlet and top–bottom no-flow conditions.
Case
Kf/Km
S
T
Δt
Dim.
EpL2
EpL∞
ρΔt
Four high- K blocks
1000
50
0.2
5.0×10−4
486
1.76×10−2
5.38×10−2
0.9998
Stripe-like fractures
1000
1
0.05
1.0×10−4
492
2.33×10−2
8.07×10−2
0.9951
Table 5: Final-time results for the high-contrast permeability tests.
Figure 8: Three-dimensional central low-permeability benchmark on the largest tested grid. The panels show pressure snapshots on the central slice, comparing Ours with the finite-volume reference solution at representative time levels, together with the corresponding absolute errors. The right panels show final-time orthogonal slices of the predicted and reference pressure fields.
Grid
DoF
Dimension
EpL2
EpL∞
ρΔt
Runtime (s)
173
3375
500
6.57×10−4
3.10×10−3
0.9855
7.70
253
12167
750
1.21×10−3
6.97×10−3
0.9855
37.48
333
29791
900
1.40×10−3
7.68×10−3
0.9855
86.04
Table 6: Three-dimensional scalability results at T=0.02 .
Figure 9: Accuracy and scalability of the three-dimensional benchmark. The top panels compare the finite-volume reference solution, Ours, and the absolute error on the final-time central slice. The bottom panels report the relative L2 error, runtime, and retained reduced dimension as the number of spatial degrees of freedom increases.
Figure 10: Error decomposition and numerical verification. (a) Reduced-error components over time. (b) Projection and closure quantities. (c) Final-time errors and analytical bounds, with the finite-volume term estimated by Richardson extrapolation. (d) Crank–Nicolson temporal refinement. (e–h) Signed spatial estimates of the four error components, shown with independent symmetric color scales.
Component
Realized relative magnitude
Upper estimate
Effectivity
Finite-volume estimate
1.568×10−2
–
–
Pressure space and closure
1.670×10−4
2.461×10−2
1.47×102
Regularization and dissipativity shift
3.711×10−8
1.928×10−3
5.19×104
Crank–Nicolson time integration
3.085×10−7
4.743×10−2
1.54×105
Estimated total
1.565×10−2
8.965×10−2
–
Table 7: Final-time normalized error decomposition for the central low-permeability benchmark. Effectivity is the analytical bound divided by the realized magnitude; the total estimate includes the empirical finite-volume contribution.
Appendix figures & tables11 assets
Supplementary material from the paper’s appendix.
Appendix
Component
Reproducible implementation rule
Activation and boundary factor
σ(s)=tanh(s) and bΩ(x,y)=x(1−x)y(1−y) .
High-contrast base features
ϕj(x)=bΩ(x)tanh(wj⊤x+βj) , with independent wj∼N(0,32I2) and βj∼U[−2,2] .
Mask enrichment
Φ0=[Φ,mΦs,(1−m)Φs] . The first Ms=round(ϑM) base features are duplicated, where M is the base count and ϑ is the split fraction.
High-contrast mask
Cells satisfying K≥KmKf are selected and the resulting binary mask is expanded by one Manhattan grid layer.
SVD truncation
A singular vector is retained when σj>τsvdσ1 ; the retained dimension is additionally limited by the case-specific rank cap.
Dissipativity correction
μ2(B)=λmax((B+B⊤)/2) and αdiss=max{0,μ2(B)+δ} with δ=10−4 , followed by B=B−αdissI .
Appendix
Table 8: Random-feature construction and truncation rules for the two-dimensional experiments. Here m is the expanded material mask, and Φs contains the first Ms base-feature columns.
Quantity
Value
Sampling or implementation detail
Random seed
2026
One generator is advanced in the row order shown below.
Inner-region features
200
w∼N(0,1.82I2) , β∼U[−2,2] .
Outer-region features
240
w∼N(0,32I2) , β∼U[−2,2] .
Side-localized features
15 per group
wτ∼N(0,2.52) , wn∼N(0,1.52) , β∼U[−2,2] .
Localization length
ℓΓ=0.055
Gaussian normal window exp[−(ρΓ/ℓΓ)2] .
Original feature count
M0=560
200+240+8×15 .
Appendix
Table 9: Random-feature sampling and compression parameters for the central low-permeability benchmark. The side-localized count is specified per side and per material region, giving eight groups in total.
Parameter
Four high- K blocks
Stripe-like fractures
Grid
65×65
65×65
Permeability data
Km=1 , Kf=1000
Km=1 , Kf=1000 , nf=6
Geometry
Centers {1/4,3/4}2 , half-width 0.075
Axis-aligned random channels
Storage coefficient
S=50
S=1
T ; Δt
0.2 ; 5×10−4
0.05 ; 10−4
Permeability seed
–
2026
Appendix
Table 10: Case-specific random-feature and evolution parameters for the two high-contrast benchmarks. A dash denotes a deterministic permeability geometry.
Setting
Dimension
Cond.
EpL2
EpL∞
ρΔt
Runtime (s)
Ours
469
1.00×100
9.54×10−4
1.08×10−3
0.9981
22.87
No whitening
469
6.82×108
9.63×10−4
1.15×10−3
1.0000
22.99
With recurrent correction
469
1.00×100
9.59×10−4
1.08×10−3
0.9981
23.24
Appendix
Table 11: Structural ablation results on the central low-permeability benchmark. The condition number is reported for the reduced coordinate system used in each variant.
Seed
Dimension
EpL2
EpL∞
Eband
ρΔt
Runtime (s)
2022
469
9.64×10−4
1.35×10−3
1.01×10−3
0.9981
22.04
2023
469
9.53×10−4
1.10×10−3
9.80×10−4
0.9981
20.10
2024
469
9.62×10−4
1.24×10−3
1.01×10−3
0.9981
14.70
2025
469
9.69×10−4
1.47×10−3
1.04×10−3
0.9981
15.53
2026
469
9.54×10−4
1.08×10−3
9.78×10−4
0.9981
15.23
Appendix
Table 12: Random-seed robustness results for the proposed method on the central low-permeability benchmark.
Setting
RF size
Dimension
EpL2
EpL∞
ρΔt
Runtime (s)
Small RF space
400
409
9.67×10−4
1.34×10−3
0.9981
13.59
Default RF space
500
469
9.54×10−4
1.08×10−3
0.9981
15.80
Rich RF space
600
528
9.52×10−4
1.11×10−3
0.9981
16.93
Appendix
Table 13: Feature-space sensitivity results on the central low-permeability benchmark. The column “RF size” denotes the original random-feature dictionary size before pressure-space compression.
Ain
Dimension
EpL2
EpL∞
Eband
ρΔt
Runtime (s)
0.30
469
9.65×10−4
1.13×10−3
9.90×10−4
0.9981
14.64
0.20
469
9.54×10−4
1.08×10−3
9.78×10−4
0.9981
14.01
0.10
469
9.20×10−4
8.91×10−4
9.22×10−4
0.9981
13.81
0.05
469
8.93×10−4
7.10×10−4
8.70×10−4
0.9984
15.74
0.01
469
8.37×10−4
5.44×10−4
6.73×10−4
0.9995
14.10
Appendix
Table 14: Permeability-contrast robustness results obtained by varying the inclusion permeability Ain .
N
Δt
Dimension
EpL2
EpL∞
ρΔt
Runtime (s)
33
2.0×10−4
349
1.83×10−3
1.59×10−3
0.9962
1.71
49
1.5×10−4
381
1.42×10−3
1.44×10−3
0.9971
4.77
65
1.0×10−4
469
9.54×10−4
1.08×10−3
0.9981
13.84
Appendix
Table 15: Grid and time-step robustness results on the central low-permeability benchmark.
Figure 11: Schematic implementation of the PINN and XPINN baselines. The PINN baseline uses a single hard-boundary space-time network. The XPINN baseline uses separate subnetworks for the matrix and inclusion regions, with additional pressure-continuity and normal-flux-continuity penalties on the material boundary.
Setting
PINN
XPINN
Grid
65×65
65×65
Final time T
0.05
0.05
Reference time step
10−4
10−4
Network input
(x,y,t)
(x,y,t)
Hidden layers
3
3 per subnet
Layer width
48
48 per subnet
Appendix
Table 16: Common training settings for the PINN and XPINN baselines on the central low-permeability benchmark.
Setting
PINN
XPINN
PDE residual points
2048
1536 outer, 512 inner
Initial-condition points
2048
1536 outer, 512 inner
Interface points
–
512
λpde
1.0
–
λpde,out
–
1.0
λpde,in
–
1.0
Appendix
Table 17: Sampling and loss weights for the PINN and XPINN baselines. Collocation points were randomly resampled during Adam training.
Partial differential equations on unbounded domains are challenging because the exterior region must be represented without excessive truncation error. Truncation-based methods often require problem-dependent artificial boundary conditions, while global spectral bases may be inefficient for localized structures, irregular geometries, or solutions with different near-field and far-field behaviors. We propose a domain-decomposed randomized neural network framework for such problems. Different randomized subnetworks are assigned to different spatial regimes: a near-field subnetwork captures local and geometric features, whereas a far-field subnetwork represents exterior decay. The subnetworks are coupled by boundary and interface conditions, and only the output-layer coefficients are solved from linear least-squares systems arising from Petrov--Galerkin or collocation formulations. We develop a Petrov--Galerkin method for semi-unbounded elliptic problems and a collocation method for fully unbounded, perforated, and time-dependent problems. A conditional bounded-parameter approximation result is proved in a broken Sobolev norm, together with an error decomposition covering approximation, empirical-consistency/quadrature, and least-squares optimization errors. Numerical experiments for Poisson and time-dependent Schrödinger equations demonstrate the accuracy and flexibility of the proposed method.
Haixin Wang, Haoning Dang, Fei Wang +1
School of Mathematics and Statistics, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, P.R. China. · School of Mathematics and Statistics & State Key Laboratory of Multiphase Flow in Power Engineering, Xi’an Jiaotong University, Xi’an, Shaanxi 710049, China.
Machine learning-based partial differential equations (PDEs) solvers have attracted significant attention in recent years. Most progress in this area has been driven by deep neural networks such as physics-informed neural networks (PINNs) and kernel method (such as physics-informed Gaussian Processes). We introduce a physics-informed random feature method for countering part of the spectral bias which PINN-based solvers are facing for a certain class of PDEs. Random feature method was originally proposed to approximate large-scale kernel machines and can be viewed as a specialized randomized neural network. Compared to other state-of-the-art PINN-based solvers which require a large number of collocation points, our proposed method reduces the computational complexity. In this paper, we develop a rigorous approximation error analysis and derive high-probability error bounds on the H1 norm. We provide extensive numerical tests for verifying our theoretical guarantees on error decay rates, as well as several comparison tests to showcase our claimed capability for combating spectral bias in these deep learning based methods.
Chi-An Chen, Chunyang Liao, Ming Zhong
Department of Applied Mathematics, Mathematics, Illinois Institute of Technology, Chicago, IL, 60616 · Department of Mathematical Sciences, University of Arkansas, Fayetteville, AR, 72701 · Department of Mathematics, University of Houston, Houston, TX, 77204
Neural networks with randomly generated hidden weights (RaNNs) have been extensively studied, both as a standalone learning method and as an initialization for fully trainable deep learning methods. In this work, we study RaNN expressivity for learning solutions to non-linear partial differential equations (PDEs). Despite their widespread use in practical applications, a rigorous theoretical understanding of the approximation properties of RaNNs in this context remains limited. Here, we derive error bounds for RaNN approximations to time-dependent Sobolev functions and obtain a dimension-free approximation rate 21 for sufficiently regular functions. We apply our results to two important classes of non-linear PDEs: Porous Medium Equations and Compressible Navier-Stokes Equations, showing that RaNNs are capable of efficiently approximating solutions to these complex, non-linear PDEs. Our theoretical analysis is supported by numerical experiments, showing that the obtained convergence rates extend beyond the considered setting.
Muhammed Ali Mehmood, Lukas Gonon
Department of Mathematics Imperial College London UK · School of Computer Science University of St. Gallen Switzerland