Weakly supervised multimodal segmentation of acoustic borehole images with depth-aware cross-attention
Organizations: Federal University of Bahia, Institute of Geosciences, Department of Geophysics, Salvador, BA 40170-115, Brazil · Grupo de Estudos e Aplicac¸ ˜ao de Inteligˆencia Artificial em Geof´ısica (GAIA), Federal University of Bahia, Salvador, BA 40170-115, Brazil
Abstract
Acoustic borehole images provide high-resolution borehole-wall structure, but large-scale interpretation remains difficult because dense expert annotations are rarely available and subsurface information is intrinsically multimodal. The challenge is developing weakly supervised methods combining two-dimensional image texture with depth-aligned one-dimensional well-logs. Here, we introduce a weakly supervised multimodal segmentation framework that refines threshold-guided pseudo-labels through learned models. This preserves the annotation-free character of classical thresholding and clustering workflows while extending them with denoising, confidence-aware pseudo-supervision, and physically structured fusion. We establish that threshold-guided learned refinement provides the most robust improvement over raw thresholding, denoised thresholding, and latent clustering baselines. Multimodal performance depends strongly on fusion strategy: direct concatenation provides limited gains, whereas depth-aware cross-attention, gated fusion, and confidence-aware modulation substantially improve agreement with the weak supervisory reference. The strongest model, confidence-gated depth-aware cross-attention (CG-DCA), consistently outperforms threshold-based, image-only, and earlier multimodal baselines. Targeted ablations show its advantage depends specifically on confidence-aware fusion and structured local depth interaction rather than model complexity alone. Cross-well analyses confirm this performance is broadly stable. These results establish a practical, scalable framework for annotation-free segmentation, showing multimodal improvement is maximized when auxiliary logs are incorporated selectively and depth-aware.
Figures & tables
| Method | Mean over wells | Std. over wells | Min well | Max well | Range |
|---|---|---|---|---|---|
| Raw Otsu | 0.6138 | 0.0366 | 0.5719 | 0.6594 | 0.0875 |
| AE Otsu | 0.7026 | 0.0230 | 0.6726 | 0.7265 | 0.0539 |
| AE+KMeans | 0.4713 | 0.0168 | 0.4544 | 0.4887 | 0.0343 |
| Image-only | 0.7339 | 0.0218 | 0.7138 | 0.7603 | 0.0466 |
| Concat multimodal | 0.7518 | 0.0226 | 0.7134 | 0.7701 | 0.0567 |
| DCA | 0.8044 | 0.0328 | 0.7574 | 0.8425 | 0.0851 |
| Variant | Overall mean | Std. | Broad mean | Heavy mean | vs full | Full wins | Full win rate |
|---|---|---|---|---|---|---|---|
| CG-DCA full | 0.9172 | 0.0888 | 0.8783 | 0.9755 | 0.0000 | – | – |
| CG-DCA no conf-loss | 0.9187 | 0.0837 | 0.8842 | 0.9705 | 0.0016 | 3/10 | 0.30 |
| CG-DCA no conf-fusion | 0.8904 | 0.0984 | 0.8509 | 0.9497 | -0.0268 | 10/10 | 1.00 |
| CG-DCA no conf-loss/fusion | 0.8914 | 0.1006 | 0.8495 | 0.9543 | -0.0258 | 10/10 | 1.00 |
| CG-DCA full | 0.9181 | 0.0867 | 0.8792 | 0.9765 | 0.0010 | 6/10 | 0.60 |
| CG-DCA no gate | 0.9207 | 0.0861 | 0.8821 | 0.9786 | 0.0035 | 3/10 | 0.30 |