AI-Based On-Board Maritime Object Detection for Earth Observation Payload Data Reduction on Versal Embedded Hardware
Organizations: IRT Saint Exupéry
Abstract
Very-high-resolution Earth-observation satellites acquire more data than they can store and downlink, while in maritime surveillance the vessels cover a tiny fraction of each scene. We study onboard vessel detection as a way to select what is downlinked, which reduces the data according to its content rather than coding every pixel; it is complementary to conventional onboard compression. The work follows three axes. (i) Data and algorithm: a controlled dataset is generated from 68 annotated Maxar scenes with 43 vessel classes, and a YOLOX-S detector is trained on it. (ii) Embedded deployment: the detector is quantized and deployed on the DPU of a Versal VC1902, with a limited loss of detection quality and a processing time of a few seconds per scene. (iii) Data reduction: we propose several downlink modes, from metadata only (box, class and score of each detection) to image crops around vessels, tiles holding detections, or the whole scene with a degraded background, and estimate from the measured detection errors the trade-off each offers between the vessels kept and the volume downlinked. On our dense harbor and coastal scenes, tiles keep 98% of the vessels with 29% of the scene volume, and crops 83% with 3%.
Figures & tables
| Mode | Downlinked content | Size | Main risk | Volume set by |
|---|---|---|---|---|
| 0 – metadata | one record per detection | 9 B per record | no image | number of detections |
| 1 – crops | box + margin = 32 px | 4.5 B per pixel | missed vessels lost | vessel area, , false alarms |
| 2 – tiles | grid tiles with 1 detection | 4.5 B per pixel | missed tiles lost | kept tiles |
| 3 – selective coding | crops + background at CR | crops + rest / CR | missed vessels compressed | crop area, CR |
| reference | full scene | 4.5 B per pixel | none | scene size |
| Vessels [% of all vessels] | |||||||
| Volume of | seen in | only in | box | ||||
| Data | Volume | false alarms | full | compressed | only | ||
| Mode | [MB] | [% of full scene] | only [%] | quality | background | (no image) | lost |
| 0 – metadata | 0.004 | 0.0003 | 25 | – | – | 83 | 17 |
| 1 – crops | 37 | 2.8 | 28 | 83 | – | – | 17 |
| 2 – tiles | 374 | 28.7 | 21 | 98 | – | – | 2 |