OilSAM2: Memory-Augmented SAM2 for Scalable SAR Oil Spill Detection
Authors: Shuaiyu Chen, Ming Yin, Peng Ren, Chunbo Luo, Zeyu Fu
Organizations: Multimodal Intelligence Lab, Department of Computer Science, University of Exeter, United Kingdom · College of Oceanography and Space Informatics, China University of Petroleum (East China), China. · Department of Computer Science, University of Exeter, United Kingdom
Segmenting oil spills from Synthetic Aperture Radar (SAR) imagery remains challenging due to severe appearance variability, scale heterogeneity, and the absence of temporal continuity in real world monitoring scenarios. While foundation models such as Segment Anything (SAM) enable prompt driven segmentation, existing SAM based approaches operate on single images and cannot effectively reuse information across scenes. Memory augmented variants (e.g., SAM2) further assume temporal coherence, making them prone to semantic drift when applied to unordered SAR image collections. We propose OilSAM2, a memory augmented segmentation framework tailored for unordered SAR oil spill monitoring. OilSAM2 introduces a hierarchical feature aware multi scale memory bank that explicitly models texture, structure, and semantic level representations, enabling robust cross image information reuse. To mitigate memory drift, we further propose a structure semantic consistent memory update strategy that selectively refreshes memory based on semantic discrepancy and structural variation.Experiments on two public SAR oil spill datasets demonstrate that OilSAM2 achieves state of the art segmentation performance, delivering stable and accurate results under noisy SAR monitoring scenarios. The source code is available at https://github.com/Chenshuaiyu1120/OILSAM2.
Figures & tables
Figure 1: Overview of the proposed OilSAM2 framework. Given an input SAR image and user prompt, hierarchical features are extracted and organized into texture-, structure-, and semantic-level representations. Each level interacts with a corresponding memory group via scale-wise attention. The retrieved features are adaptively fused and decoded to produce the segmentation mask, while a structure–semantic consistent update strategy regulates memory refreshing for robust reuse across unordered SAR images.
Model
SeaSurface(%, ↑ )
Oil Spill(%, ↑ )
Look-alike(%, ↑ )
Ship(%, ↑ )
Land(%, ↑ )
mIoU(%, ↑ )
Unet [ 23 ]
93.90
53.79
39.55
44.93
92.68
64.97
LinkNet [ 4 ]
94.99
51.53
43.24
40.23
93.97
64.79
PSPNet [ 29 ]
92.78
40.10
33.79
24.42
86.90
55.60
Deeplabv2 [ 5 ]
94.09
25.57
40.30
11.41
74.99
49.27
Deeplabv2(msc) [ 5 ]
95.39
49.28
31.26
88.65
93.97
62.83
Deeplabv3+ [ 6 ]
96.43
53.38
55.40
27.63
92.44
65.06
Table 1: Comparison of OilSAM2 with other oil spill segmentation methods on the M4D Dataset [ 20 ] .
Model
mIoU (%, ↑ )
F1-score (%, ↑ )
Recall (%, ↑ )
Precision (%, ↑ )
PALSAR
Sentinel-1
PALSAR
Sentinel-1
PALSAR
Sentinel-1
PALSAR
Sentinel-1
U-Net [ 23 ]
81.63
81.46
82.20
86.10
77.84
81.22
83.08
85.61
D-LinkNet [ 4 ]
81.58
82.32
84.57
87.08
85.48
85.22
83.69
85.22
Deeplabv3 [ 6 ]
81.79
82.94
84.26
87.70
84.31
84.76
83.02
88.08
CBD-Net [ 15 ]
83.31
83.42
84.84
87.87
86.75
87.32
84.20
91.20
Medical SAM2 [ 30 ]
82.14
80.64
83.04
82.13
83.77
85.92
81.07
85.64
Table 2: Comparison of OilSAM2 with other oil spill segmentation methods (on SOS Dataset [ 15 ] ).
Configuration
mIoU
Prec.
Baseline [ 30 ]
82.14
81.07
Baseline + Multi-Scale Fusion
82.27
81.13
Baseline + Structure–Semantic Update
83.64
81.68
Baseline + Multi-scale Memory Bank
83.53
82.04
Baseline + Fusion + Update
83.92
82.16
Baseline + Fusion + Memory Bank
83.85
82.24
Table 3: Ablation study of components (SOS Dataset PALSAR). Scale adapters are replaced by linear projections in the ablation study.
Figure 2: Qualitative results of the ablation study(On SOS Dataset).
Marine oil spills require rapid detection to mitigate severe ecological and economic damage. While satellite-based Synthetic Aperture Radar (SAR) provides essential all-weather monitoring, analyzing this data remains challenging. Deep learning models often require massive datasets and incur high latency. To address this, a pixel-wise quantum-assisted Support Vector Machine (QSVM) bagging ensemble is developed. Quantum annealing is leveraged to optimize the support vectors of individual weak SVMs on small data subsets, which are then classically aggregated. The approach is evaluated on Sentinel-1 imagery using both quantum simulation and physical quantum annealing hardware. The quantum-assisted pipeline achieved performance comparable to a rigorous classical baseline, yielding an Intersection-over-Union (IoU) of 0.60 and a balanced accuracy of 0.89. Complementary experiments with gate-based quantum computing demonstrated similar segmentation accuracy, although the annealing approach offered superior inference efficiency. Generalization was further assessed on independent oil spill imagery from the Strait of Hormuz, demonstrating the potential transferability of the trained pipeline to geographically distinct spill events. These results establish the feasibility of quantum-assisted, segmentation pipelines for near-real-time environmental monitoring.
Joseph Strauss, Jyotsna Sharma
Division of Computer Science & Engineering Louisiana State University Baton Rouge, United States · Department of Petroleum Engineeering Louisiana State University Baton Rouge, United States
Synthetic Aperture Radar (SAR) plays a critical role in maritime surveillance, yet deep learning for SAR analysis is limited by the lack of pixel-level annotations. This paper explores how general-purpose vision foundation models can enable zero-shot ship instance segmentation in SAR imagery, eliminating the need for pixel-level supervision. A YOLOv11-based detector trained on open SAR datasets localizes ships via bounding boxes, which then prompt the Segment Anything Model 2 (SAM2) to produce instance masks without any mask annotations. Unlike prior SAM-based SAR approaches that rely on fine tuning or adapters, our method demonstrates that spatial constraints from a SAR-trained detector alone can effectively regularize foundation model predictions. This design partially mitigates the optical-SAR domain gap and enables downstream applications such as vessel classification, size estimation, and wake analysis. Experiments on the SSDD benchmark achieve a mean IoU of 0.637 (89% of a fully supervised baseline) with an overall ship detection rate of 89.2%, confirming a scalable, annotation-efficient pathway toward foundation-model-driven SAR image understanding.
Islam Mansour, Francescopaolo Sica, Michael Schmitt
Department of Aerospace Engineering, University of the Bundeswehr Munich, Neubiberg, Germany
The Segment Anything Model 2 (SAM2) has advanced temporal promptable segmentation, yet its deployment remains hindered by heavy memory cross-attention overhead and redundant full-frame visual feature extraction. While recent methods explore efficiency via heuristic memory pruning and window-based sparse routing, they typically suffer from catastrophic performance degradation in complex segmentation scenarios replete with occlusions and distractors. To resolve these limitations, we propose Lean-SAM2, a holistic lightweight framework designed to address the above vulnerabilities while systematically eliminating computational redundancies. Specifically, Lean-SAM2 integrates three collaborative mechanisms: (1) Target-Anchored Memory Pruning (TAMP) safeguards target tokens against deceptive attention by modulating raw attention significance with semantic consistency against prompt-derived foreground anchors; (2) Temporal Condensation with Insurance Memory (TCIM) condenses historical context via a visibility-gated fusion while conditionally archiving high-confidence entries in a parallel insurance bank; and (3) Target-Anchored Risk-Aware Routing (TARR) selectively activates the heavy image encoder for target-related windows based on anchor similarity, utilizing a risk-aware fallback policy to trigger full-frame refreshes during volatile transitions. Extensive evaluations across multiple challenging benchmarks demonstrate that Lean-SAM2 establishes a superior balance between accuracy and efficiency. For example, on the LVOSv2 validation dataset, Lean-SAM2 achieves overall inference speedups of 1.412× and 1.417× on the SAM2.1-Large and SAM2.1-Base+, respectively, significantly outperforming Efficient-SAM2 while boosting the corresponding J&F scores by 5.0% and 3.6%. Code is available at https://github.com/DeawhaleQwQ/Lean-SAM2.
Xudong Ouyang, Wenlun Zhang, Yimin Xu +2
School of Biomedical Engineering, Hainan University, Hainan 570228, China · Department of Electronics and Electrical Engineering, Keio University, Kanagawa 223-8522, Japan · College of Computer Science, Shenyang Aerospace University, Shenyang 110135, China +1