A Seismic Foundation Model for Dense Feature Extraction
Authors: Zhixiang Guo, Xinming Wu, Yimin Dou, Hui Gao, Siyao Zhao, He Huang, Wei Liu
Organizations: Laboratory of Seismology and Physics of the Earth’s Interior, School of Earth and Space Sciences, University of Science and Technology of China, Hefei 230026, China. · State Key Laboratory of Precision Geodesy, University of Science and Technology of China, Hefei 230026, China. · Mengcheng National Geophysical Observatory, University of Science and Technology of China, Hefei 230026, China. · School of Artificial Intelligence, Anhui University of Science and Technology, Hefei 231131, China
Deep-learning-based seismic interpretation is constrained by scarce high-quality annotations, and most existing models are trained separately for individual tasks. We present SeisDFE, a 7B-parameter seismic foundation model for dense feature extraction, pretrained on 5.34 million 2D images derived from more than 500 seismic volumes. A three-stage pretraining strategy, combining discriminative self-supervised learning, Gram feature anchoring, and multi-resolution adaptation, improves feature discriminability while preserving spatial coherence. With its encoder frozen, SeisDFE supports seismic facies classification, salt detection, fault detection, and relative geologic time estimation. It outperforms existing seismic foundation models on all four tasks and a natural-image-pretrained model on all but fault detection, with the largest gains under scarce supervision: using only two annotated sections of the F3 dataset, it improves whole-volume mIoU by 12-19 percentage points over the baselines. The learned features remain effective with task-specific decoders and extend to synthetic-to-field transfer and sparse 3D geobody interpretation. These results show that large-scale seismic pretraining organizes geological information into dense representations that are directly reusable across interpretation tasks.
Figures & tables
Figure 1: Overall framework of SeisDFE. The left panel shows the three-stage pretraining pipeline, consisting of large-scale self-supervised learning, Gram feature anchoring, and multi-resolution adaptation. The middle panel shows the frozen ViT-7B seismic foundation model and its patch-level dense features. The right panel shows the adaptation of task-specific decoders for seismic facies classification, fault detection, salt detection, RGT estimation, and other interpretation tasks.
Figure 2: The discriminative self-supervised pretraining framework of SeisDFE. Each seismic image yields two global views and eight local views, which are fed to the teacher and student encoders respectively, with the teacher parameters updated by an exponential moving average of the student parameters. The training objective comprises the DINO loss, the iBOT loss, the KoLeo regularizer, and the Gram anchoring loss.
Figure 3: Evolution and organization of dense seismic representations. (a) Patch-feature similarity during Stage I at 50k, 80k, and 100k training steps. (b) PCA visualization of dense features after the three pretraining stages. (c) Frozen linear-probing performance of the three stages on SEAM facies classification. (d) PCA visualization of features extracted from different depths of the final SeisDFE encoder.
Figure 4: Extreme few-shot linear probing with frozen encoders. (a) Salt detection, (b) F3 facies classification, (c) RGT estimation, and (d) fault detection. Only a linear prediction head is trained for each task.
Task
Decoder
Encoder
Encoder setting
mIoU
mPA
SEAM facies classification
PUP
DINOv3-7B
Frozen
0.8374
0.9221
SFM-Large
LoRA
0.8243
0.8994
NCS-2D
Frozen
0.8415
0.9121
SeisDFE-Large
Frozen
0.8768
0.9289
SeisDFE
Frozen
0.8845
0.9324
TGS salt detection
Linear
DINOv3-7B
Frozen
0.8116
0.8815
Table 1: Performance of different pretrained encoders on three downstream seismic interpretation tasks. Bold indicates the best result.
Figure 5: Qualitative comparisons for downstream seismic interpretation. The rows show seismic facies classification, salt detection, and fault detection. The columns show the seismic input, predictions from DINOv3-7B, SFM-Large, NCS-2D, and SeisDFE, and the reference interpretation.
Figure 6: Synthetic-to-field transfer on field seismic data. The upper two rows show two examples each of fault detection (left) and karst cave detection (right), with predictions obtained using SeisDFE and U-Net in the first and second rows, respectively. The bottom row shows two RGT estimation examples, each comparing SeisDFE (left) and U-Net (right).
Figure 7: Sparse 3D geobody detection. (a) Overview of the 3D interpretation framework, in which multi-level features from neighboring seismic sections are combined and processed by a 3D convolutional decoder under sparse slice supervision. (b) Sparse manual interpretations used for supervision. (c) Predictions obtained with a 2D PUP decoder. (d) Predictions obtained with the 3D convolutional decoder. The four columns in (b)–(d), from left to right, show channel detection on the Parihaka and Romney datasets, salt dome detection on the F3 dataset, and karst detection on a field seismic dataset.
Computation-based Science and Technology Research Center, The Cyprus Institute, Nicosia, Cyprus · Department of Geosciences, College of Petroleum Engineering and Geosciences, King Fahd University of Petroleum & Minerals, Dhahran, Saudi Arabia · Department of Intelligent Systems, Faculty of Electrical Engineering, Mathematics and Computer Science, Delft University of Technology, Delft, Netherlands +2