In-orbit demonstration of object-based change detection applied to the maritime domain
Authors: Cristopher Castro Traba, Tom Hendrix, Amaury Perrocheau, Francesco Pasanisi, Finian Rogers, Aubrey Dunne, David Rijlaarsdam, Roberto Del Prete, Nicolas Longépé, Gabriele Meoni
Organizations: Ubotica Technologies, Kluyverweg 1, Delft, 2629 HS, South Holland, Netherlands · Φ-lab, European Space Research Institute (ESRIN), European Space Agency (ESA), Via Galileo Galilei, 1, Frascati, 00044, RM, Italy · Advanced Concepts and Studies Office, European Space Research Institute (ESRIN), European Space Agency (ESA), Via Galileo Galilei, 1, Frascati, 00044, RM, Italy
This article presents the successful in-orbit validation of an object-based change detection pipeline for low latency maritime monitoring onboard the CogniSAT-6 mission. We propose and validate a lightweight, three-phase operational sequence: optimized ground-based dual-acquisition scheduling, real-time onboard AI-based vessel segmentation, and multi-temporal matching. Upon acquiring consecutive images over a targeted Area of Interest (AoI), the onboard system correlates vessel detections using a hybrid matching approach that integrates the Hungarian algorithm for optimal assignment with RANSAC-driven spatial and size filters for outlier rejection. A series of in-orbit validations demonstrated robust performance across 11 diverse maritime scenarios, achieving valid recall and precision values (considering only vessel size and location) exceeding 0.8. The validation demonstrated the ability of the system to track both cooperative targets and uncooperative "dark" vessels strictly through geometric consistency. This capacity to autonomously generate and act upon real-time intelligence establishes a foundation for next-generation Insight-as-a-Service (IaaS) and tipping-and-cueing architectures.
Figures & tables
Fig. 1: Diagram for the multi-temporal on orbit change detection solution.
Fig. 2: Block diagram depicting the on board matching flow.
Fig. 3: Visual depiction of the area difference covered by the satellite under different roll angle acquisitions. In dotted red the acquisition with small roll angle and in yellow striped the acquisition with larger roll angle.
Parameter
Value [units]
Vessel length threshold
60 [m]
Final matching distance
1,000 [m]
Coarse matching distance
20,000 [m]
Final size difference
20 [%]
Coarse size difference
30 [%]
Number of RANSAC iterations
2000 [-]
TABLE I: Matching parameters values for the in-orbit validation
Matching pair run
Valid Recall
Valid Precision
Real Recall
Real Precision
Long Beach (13/09/25-16/09/25)
0.8333
1.0000
1.0000
0.8000
Port Said (17/11/25-20/11/25)
0.9706
0.9167
0.3810
0.4211
Khor Fakkan (30/10/25-01/11/25)
0.8750
0.8400
-
-
Gibraltar (04/12/25-07/12/25)*
1.0000
1.0000
-
-
Piraeus (10/12/25-12/12/25)
1.0000
1.0000
0.3333
0.3333
Dakar (28/12/25-30/12/25)
0.8889
1.0000
0.8000
0.8890
TABLE II: Matching results in CogniSAT-6 operational runs.
Fig. 4: Matching performance under low vessel density conditions in the Dakar images taken on the 28/12/2025 (left) and the 20/12/2025 (right). The white boxes correspond to the identified matches considering the minimum vessel length, while the yellow boxes correspond to the AIS matches with the same criteria. Match 5 within the acquisitions is a dark vessel (without AIS).
Fig. 5: Matching performance under low-medium vessel density in the Long Beach images taken on the 13/09/2025 (left) and the 16/09/2025 (right). The white boxes correspond to the identified matches considering the minimum vessel length, while the yellow boxes correspond to the AIS matches with the same criteria.
Fig. 6: Matching performance under low-medium vessel density conditions in the Long Beach images taken on the 10/01/2026 (left) and the 12/01/2026 (right). The white boxes correspond to the identified matches considering the minimum vessel length, while the yellow boxes correspond to the AIS matches with the same criteria.
Fig. 7: Matching performance under high vessel density and cloudy conditions in the Port Said images taken on the 26/02/2026 (left) and the 28/02/2026 (right). The white boxes correspond to the identified matches, while the yellow boxes correspond to the AIS matches.
Fig. 8: Matching performance under high vessel density conditions in the Khor Fakkan images taken on the 30/10/2025 (left) and the 01/11/2025 (right). The white boxes correspond to the identified matches.
Cristopher Castro Traba eceived the Master of Science degree in space engineering with Cum Laude distinction from Delft University of Technology, Delft, Netherlands. He is currently a Space Systems Engineer for Ubotica Technologies, where he manages and designs AI-based solutions for EO missions. He has previously been a Visiting Researcher at the European Space Agency where he implemented Deep Learning models for thermal hotspot segmentation in raw multispectral imagery , an Undergraduate Researcher at the Universidade de Vigo where he developed relative pose estimation algorithms for autonomous spacecraft using LiDAR , and a Graduate Researcher at TU Delft where he researched ML for spacecraft telemetry analysis on resource-constrained microprocessors.
Table 11
Tom Hendrix received the Master of Science degree in aerospace engineering from the Delft University of Technology, Delft, The Netherlands, specializing in Space System Engineering and performing thesis research on radiation effects in a soft processor on an FPGA using proton irradiation. He currently works for Ubotica Technologies as part of the Space System R&D team, where he is a Senior Space System Engineer and Flight Software Developer for several space missions.
Table 12
Amaury Perrocheau received a Master degree in aerospace engineering from ISAE-SUPAERO and another in Astrophysics from Paul Sabatier University. He previously led a gravitational wave observation program for the SETI Institute. He is currently a space systems engineer for Ubotica Technologies where he is involved in the daily operations of the CogniSAT-6 satellite and is developing efficient scheduling algorithms to increase the value obtained from Earth observations. Amaury is also involved in the integration of third-party software and demonstrations such as onboard applications provided by NASA/JPL.
Table 13
Francesco Pasanisi received a Master of Science in Geographic Information Science and Remote Sensing from Wageningen University & Research (WUR), and a Master of Science in Agricultural and Environmental Science from the University of Bari ”Aldo Moro”. He previously served as a Research and Teaching Assistant at WUR, where he developed deep learning datasets for agricultural crop segmentation and assisted in teaching Remote Sensing courses. He is currently a Geospatial Machine Learning Engineer at Ubotica Technologies, where he develops end-to-end geospatial data workflows and engineers Earth Observation solutions for the training and deployment of deep learning models across cloud environments and on-board satellite hardware. Francesco has authored multiple peer-reviewed publications on remote sensing and deep learning, and was awarded the Best Poster Award at the IEEE GRSS IADF School on Computer Vision for Earth Observation, sponsored by the European Space Agency.
Table 14
Finian Rogers received a Bsc of Computer Science in 1955 at the university of Westminster. He is currently senior program manager at Ubotica Technologies. Previous experience as a program manager at Intel leading multiple projects. Most notably, driving DARPA researchs programs within Intel Programmable Solutions Group.
Table 15
Aubrey Dunne received the B.Eng. degree in mechatronic engineering, the M.Eng. degree in electronic systems, and the Ph.D. degree in computer vision, all from Dublin City University, Dublin, Ireland. He is currenly a Co-Founder and Chief Technology Officer (CTO) with Ubotica Technologies, a Space AI company with headquarters in Dublin, Ireland. Ubotica specializes in AI processing at the edge, deploying power-efficient embedded solutions in the Space segments. He led the Ubotica team that in 2020 successfully delivered the AI solution enabling the world’s first AI inference on board an EO CubeSat. Prior to his role in Ubotica, he gained ten years of professional engineering consultancy experience, with companies including Intel and Movidius, in the core areas of computer vision and embedded systems design.
Table 16
David Rijlaarsdam received the Master of Science degree in aerospace engineering from Delft University of Technology, Delft, The Netherlands, with a specialization in Space System Engineering. He is currently the Director of Space System Engineering for Ubotica Technologies, where he manages the Space System R&D team and is involved as a System Engineer in several space missions. He has previously been part of the Automation and Robotics Section of the European Space Agency where he researched relative navigation for spacecraft and has been part of the advanced architecture team of Intel Movidius, where he researched the application of AI for star identification algorithms.
Table 17
Roberto Del Prete received the M.Sc. degree (cum laude) in aerospace engineering, and the Ph.D. degree in industrial engineering disserting about “artificial intelligence onboard satellites” from the University of Naples Federico II, Naples, Italy, in 2019, 2021, and 2024, respectively. He is currently an Internal Research Fellow with Φ -lab, European Space Agency (ESA), Frascati, Italy, specializing in deep learning and edge computing for remote sensing. He focuses on improving time-critical decision-making through advanced AI solutions for space missions and Earth monitoring. His notable work includes the development of “FederNet,” a terrain relative navigation system. His professional experience includes roles as a Visiting Researcher with the Φ -Lab, European Space Agency and SmartSat CRC, Adelaide, SA, Australia. He has contributed to key projects like Kanyini Mission, and developed AI algorithms for real-time maritime monitoring and thermal anomaly detection. He co-authored of more than 30 scientific publications, he is dedicated to leveraging advanced technologies to address global challenges in remote sensing and AI. Dr. Prete codeveloped the award-winning P 3 ANDA project, a compact AI-powered imaging system, was the recipient of the 2024 Telespazio Technology Contest prototype prize.
Table 18
Nicolas Longépé received the M.Eng. degree in electronics and communication systems and the M.Sc. degree in electronics from the National Institute for the Applied Sciences, Rennes, France, in 2005, and the Ph.D. degree in signal processing and telecommunication from the University of Rennes I, Rennes, in 2008. From 2007 to 2010, he was with the Earth Observation Research Center, Japan Aerospace Exploration Agency, Tsukuba, Japan. From 2010 to 2020, he was a Research Engineer with the Space Observation Division, Collecte Localization Satellites, Plouzané, France. Since September 2020, he has been an Earth observation data Scientist, Φ -Lab Explore Office, European Space Research Institute, European Space Agency, Frascati, Italy. He has been working on the development of innovative synthetic aperture radar-based applications for environmental and natural resource management (ocean, mangrove, land and forest cover, soil moisture, snow cover, and permafrost) and maritime security (oil spills, sea ice, icebergs, and ship detection/tracking). At the Φ -Lab, he is particularly involved in the development of innovative Earth Observation missions in which artificial intelligence is directly deployed at the edge (on the spacecraft). His research interests include Earth observation remote sensing and digital technologies, such as machine (deep) learning.
Table 19
Gabriele Meoni received the M.Sc. degree in electronic engineering and the Ph.D. degree in informa- tion engineering, under the supervision of Prof. Luca Fanucci, from the University of Pisa, Pisa, Italy, in 2016 and 2020, respectively. After completing his doctoral studies, from 2020 to 2023 he was a Internal Research Fellow with the European Space Agency (ESA) (Advanced Concepts Team (ACT) 2020–2021 and Φ -lab 2021–2023), where he conducted research on Artificial Intelligence (AI) and neuromorphic computing for onboard spacecraft applications. During 2022–2023, he was a visiting Researcher with AI Sweden, focusing on distributed edge learning for satellite constellations. From 2023 to 2024, he was an Assistant Professor with the Faculty of Aerospace Engineering at Delft University of Technology. He is currently an Innovation Officer with ESA, Frascati, Italy. He has coauthored more than 40 scientific publications. His research interests include satellite onboard processing, AI for Earth observation, and neuromorphic computing
Very-high-resolution Earth-observation satellites acquire more data than they can store and downlink, while in maritime surveillance the vessels cover a tiny fraction of each scene. We study onboard vessel detection as a way to select what is downlinked, which reduces the data according to its content rather than coding every pixel; it is complementary to conventional onboard compression. The work follows three axes. (i) Data and algorithm: a controlled dataset is generated from 68 annotated Maxar scenes with 43 vessel classes, and a YOLOX-S detector is trained on it. (ii) Embedded deployment: the detector is quantized and deployed on the DPU of a Versal VC1902, with a limited loss of detection quality and a processing time of a few seconds per scene. (iii) Data reduction: we propose several downlink modes, from metadata only (box, class and score of each detection) to image crops around vessels, tiles holding detections, or the whole scene with a degraded background, and estimate from the measured detection errors the trade-off each offers between the vessels kept and the volume downlinked. On our dense harbor and coastal scenes, tiles keep 98% of the vessels with 29% of the scene volume, and crops 83% with 3%.
Onboard Artificial Intelligence can improve responsiveness and bandwidth efficiency of Earth Observation systems by processing data directly on the satellite. This paper presents the experience gained from the development, onboard integration, and post-launch adaptation of a lightweight marine anomaly detection pipeline deployed on the European Space Agency's Φsat-2 mission. The application combines sea segmentation, self-supervised feature encoding of marine regions, generic anomaly detection based on deviations from a normal sea state, and optional characterization of selected anomaly types. Before launch, the pipeline was trained and validated on simulated Φsat-2 imagery to assess algorithmic performance and compatibility with resource-constrained onboard hardware. After integration and functional validation in the mission environment, early experiments on real Φsat-2 acquisitions revealed a significant mismatch between simulated and in-orbit data. The pipeline was therefore retrained on real Level-1 imagery using an improved annotation strategy to better handle ambiguous marine regions, substantially enhancing performance. Beyond demonstrating the onboard feasibility of the application, the Φsat-2 experience highlights the importance of robust annotation strategies and sensor-aware design, and shows that simulation-based development is valuable for pre-flight risk reduction, while reliable scientific validation requires representative in-orbit data and should be clearly distinguished from functional validation.
Clotilde Szywala, Thomas Goudemant, Marjorie Bellizzi +2
Institut de Recherche Technologique Saint Exupéry 240 Rue Evariste Galois 06410 Biot, France
We present an ML-based vessel detection and localization system, trained with weak supervision from imperfect AIS labels, that achieves a 97.8% detection rate at 1.98% false-trigger rate, successfully identifies dark-vessel events from unlabeled data.
Tian Tian, Agastya Raj, Lara Flanagan +2
School of Computer Science and Statistics, IRIS Research Group, ADAPT Research Centre, Trinity College Dublin, Ireland · School of Engineering, ADAPT Research Centre, Trinity College Dublin, Ireland