From Signals to Evidence: Interpretable Underwater Acoustic Target Sensing with Large Language Models - Part I: Framework and Recognition
Authors: Yuge Zhang, Jie Chen, Zhengqiao Zhao, Xiling Yao, Lingji Xu, Jingdong Chen, Yixin Yang
Organizations: School of Artificial Intelligence, Northwestern Polytechnical University, Xi’an, Shaanxi 710129, China · School of Ocean Engineering and Technology, Sun Yat-sen University, Zhuhai, 519000, Guangdong, China · School of Marine Science and Technology, Northwestern Polytechnical University, Xi’an, Shaanxi 710129, China · School of Electronic and Optical Engineering, Nanjing University of Science and Technology, Nanjing, Jiangsu 210094, China
Underwater acoustic target detection and recognition are essential to marine surveillance and intelligent ocean sensing. Despite substantial advances in deep learning, existing systems typically produce binary detection decisions, categorical labels, or scalar confidence scores, offering limited insight into the physical evidence underlying their outputs. Large language models (LLMs) offer an opportunity to move underwater acoustic sensing toward interpretable, evidence-grounded understanding; however, generic audio encoders struggle to capture the distinctive physical characteristics of underwater acoustics, and physically annotated data are scarce. In this paper, the first of a two-part series, we propose a from-signals-to-evidence framework that integrates physics-aware acoustic encoding with a pretrained LLM, organized around a unified feature-evidence-decision chain with a shared reasoning core. An open input layer accommodates heterogeneous information-raw waveforms, time-frequency representations, environmental and geographic data, and textual physical priors-unifying detection and recognition within a common formulation. In Part I, we instantiate this framework for target recognition through an Underwater Acoustic Physics-aware Transformer (UPT), which tokenizes complementary acoustic representations and learns task-disentangled physical representations through four physics-oriented learning tasks. We develop a physics-parameterized data engine that provides traceable supervision at two levels of granularity and introduce an attribute-level evaluation protocol to assess the physical fidelity of generated descriptions. Experiments on simulated recordings of four vessels demonstrate accurate vessel recognition and reliable estimation of shaft frequency, blade-passing frequency, and machinery-related attributes.
Figures & tables
Fig. 1 : Conceptual overview of the proposed UPD framework for interpretable underwater acoustic target sensing.
Fig. 2 : Detailed architecture of the proposed from-signals-to-evidence framework.
Fig. 3 : Structured output template for underwater acoustic description.
Fig. 4 : Overview of the proposed physics-parameterized data engine.
Fig. 5 : Selected Korean sea regions and their representative channel impulse responses. (a) Bathymetry and locations of the shallow, slope, and deep regions. (b) Channel impulse responses at a range of 15 km and an azimuth of 195∘ .
Vessel
Blades
fs range(HZ)
fm (Hz)
Oscar Dyson
5
1.55- 2.25
120, 240
Celtic Explorer
5
2-3
50, 75
G.O. Sars
4
1.8 - 2.7
36, 60
Ángeles Alvariño
5
1.8- 2.8
48, 96
TABLE I : Vessel-specific identity parameters
Fig. 6 : Analysis of the complete UPT encoder using the complete UPT configuration under the −5 to 5 dB SNR condition. (a) Average attention weights assigned to the three acoustic representations for different physical tasks on the test set. (b) Evolution of training and validation losses. (c) Evolution of training and validation performance for SFE, STE, BPFE, and MLD.
SNR range (dB)
Input Features
Task Attention
AccSFE
AccSTE
AccBPFE
Micro-F1MLD
Log-Mel
Line
DEMON
−5 to 5
✓
–
–
–
0.809
0.528
0.586
0.614
–
✓
–
–
0.929
0.925
0.900
0.574
–
–
✓
–
0.648
0.527
0.698
0.308
✓
✓
✓
–
0.984
0.951
0.963
0.882
✓
✓
✓
✓
0.995
0.967
0.969
0.892
TABLE II : Performance of UPT under different input feature configurations and SNR conditions.
Fig. 7 : Illustrative input-output examples of the proposed UPD framework
SNR range (dB)
Classification Accuracy
Shaft Frequency MAE (Hz)
BPF MAE (Hz)
Machinery MAE (Hz)
SNR MAE (dB)
Vessel
State
Trend
Initial
Final
Mean
Initial
Final
Mean
−5 to 5
0.992
0.967
0.970
0.015
0.014
0.010
0.070
0.077
0.060
0.911
1.35
−20 to −5
0.977
0.955
0.955
0.017
0.016
0.013
0.070
0.080
0.063
0.930
1.86
TABLE III : Performance of UPD under different SNR conditions.
Large audio-language models (LALMs) are fast becoming a general interface to sound, yet how far their broad pretraining carries into specialized domains remains largely open. Vessel monitoring, maritime safety, and ocean sensing all depend on recognizing underwater signals, but to our knowledge LALMs have not been systematically evaluated on them. Annotated recordings are costly to collect, and a faithful synthetic alternative has to bring together many interacting factors: the structure of detection pulses, communication waveforms, and ship-radiated noise, and the sound-speed profile, geometry, and multipath propagation through which each reaches the receiver. We address this by proposing UA-Bench, to our knowledge the first large-scale benchmark for evaluating LALMs on underwater acoustic signal recognition. It comprises 375,051 audio records that couple parameterized sources with modeled propagation, so that every record can be traced to the conditions that produced it. The records span these three signal families, and each carries a three-level label hierarchy (13 leaf classes), a templated multi-turn dialogue, and source and channel metadata. We evaluate on a balanced 2,600-record subset with a gated coarse-to-fine protocol that locates each error at source routing, fine-grained classification, or output format, and add a paired silent-audio control to test whether the waveform is actually used. Nine open LALMs, evaluated without task-specific adaptation, reach only 2.0%--13.1% leaf accuracy, against a random reference of 7.7%. The waveform helps source routing far more than leaf recognition (for one model, +29.5 versus +2.3 points over silence), and just four models gain reliably at the leaf level, by at most 4.7 points. UA-Bench thus gives a reference point for these models, and its released training partition supports follow-up adaptation work.
This study presents a bio inspired signal processing framework for robust Underwater Acoustic Target Recognition (UATR). The latest state of the art methods often fail to resolve dense low frequency harmonic structures in vessel propulsion signals under high noise conditions, which is addressed by the proposed framework using a biologically inspired Gammatone filter bank that emulates the cochlea nonlinear frequency selectivity. By distributing filters according to the Equivalent Rectangular Bandwidth (ERB) scale, the framework achieves a high fidelity representation of engine radiated tonals while effectively suppressing isotropic ambient interference. The resulting Cochleagram features are processed by a lightweight, custom designed Convolutional Neural Network (CNN) that leverages large receptive fields to integrate spectral-temporal continuities. Experimental results on the VTUAD dataset demonstrate a state of the art classification accuracy of 98.41%, outperforming Continuous Wavelet Transform and Mel Frequency Cepstral Coefficients baselines by 3.5% and 7.7% respectively. Furthermore, the framework achieves an inference latency of only 0.77 ms and a 0.971 Cohen Kappa score, validating its efficacy for real time deployment on autonomous, low-power sonar hardware.
We propose a compact underwater acoustic classification framework combining multi-representation feature engineering, temporal statistical pooling, and compact convolutional architectures designed for acoustic time-frequency and cochlear representations. We investigate multiple conventional and auditory-inspired representations and first evaluate lightweight classifiers and Conventional Neural Networks (CNNs) on ShipsEar dataset. On the provided split, a two-layer CNN achieves a macro F1 of 0.9918, while a Radial Basis Function Support Vector Machine (RBF-SVM) reaches 0.9883. However, source-recording provenance cannot be reconstructed, preventing verification of recording-independent generalisation. We therefore evaluate on DeepShip dataset using recording-level partitioning before segmentation. Under this protocol, a 157K-parameter compact CNN achieves a test macro F1 of 0.7226, while an 11.17M-parameter ResNet18 provides no improvement in validation performance under the matched setting. These results demonstrate the importance of representation-aware feature and model design, together with rigorous recording-level evaluation, for classification performance and deployability in compact underwater acoustic systems.
Abishek Soti, Thura Pyae Sone, Naqib Ibnul +4
ICNS, Western Sydney University, Sydney, Australia