ASTRA: ASV Simulator for Transferable Realistic Autonomy
Authors: Tsimafei Lazouski, Cody Sheltraw, Alan Papalia, Maani Ghaffari
Organizations: Department of Naval Architecture and Marine Engineering, University of Michigan, Ann Arbor, MI · Department of Robotics, University of Michigan, Ann Arbor, MI
Autonomy development for marine autonomous surface vehicles (ASVs) remains challenging because field testing is costly and difficult to reproduce. Existing marine simulation tools provide mature capabilities in vessel dynamics, robotics integration, and visual rendering, but these strengths are emphasized differently across platforms. This paper presents ASTRA, an ASV simulation framework built in NVIDIA Isaac Sim that combines marine vehicle dynamics, photorealistic perception, and Robot Operating System (ROS 2) autonomy interfaces within a common environment. ASTRA incorporates a Fossen-style marine dynamics model together with geometry-based buoyancy and programmable spectral wave disturbances, enabling non-planar hydrostatic and wave-induced motion. The simulator reproduces the sensor configuration of a physical BlueBoat testbed, including GPS, IMU, LiDAR, and RGB-D sensing exposed through ROS 2. This allows localization, perception, planning, and control software to be developed against interfaces consistent with the physical platform. The BlueBoat's existing ROS 2 localization and perception modules were ported directly into ASTRA, while targeted zero-propulsion experiments were used to verify the implemented wave-body coupling. The simulated roll response was consistent with the expected non-oscillatory hydrostatic behavior, and heave remained highly coherent with the generated wave field, with approximately unity gain at the dominant wave frequency in the tested sea states. ASTRA is intended as an open-source testbed for marine autonomy development, simulation-based benchmarking, and sim-to-real experimentation.
Figures & tables
Fig. 1: Demonstration of the Isaac Sim simulation environment and the main features supporting sim-to-real transfer research.
Simulator
Simulation Platform
Surface
Photorealism
Waves
ROS 2
VRX [ 13 ]
Gazebo
✓
∼
✓
✓
Stonefish [ 12 ]
Custom C++
∼
∼
✓
✓
HoloOcean [ 11 ]
Unreal Engine
∼
✓
∼
✓
MarineGym [ 9 ]
Isaac Sim 4.1.0
–
✓
–
∼
RANS-ASV [ 14 ]
Isaac Sim 2022.2.1
✓
∼
–
✓
ASVSim [ 10 ]
Unreal Engine
✓
✓
∼
✓
TABLE I: Positioning of popular marine simulators. ✓: supported, ∼ : partial / domain-dependent.
Fig. 2: Realized vs. target JONSWAP/TMA spectrum, strong sea state.
Condition
Hs [m]
Heave [m]
Roll / Pitch [deg]
Still
0.00
0.0
0.00 / 0.00
Mild
0.29
0.074
3.66 / 3.70
Strong
0.61
0.149
6.72 / 6.77
TABLE II: RMS vessel response vs. sea state, zero propulsion, Tp=2.63 s.
Fig. 3: On the left are the 3rd-person and RGB views of the Isaac Sim stage and the semantic map in RViz built from its localization, LiDAR, and RGB-D inputs. On the right is the same ConvBKI pipeline, with the same weights and configuration, run offline on real-world data from the physical BlueBoat.
Quantity
Source
Rate
Stage playback
Isaac Sim, full sensor suite
35 FPS
Pose estimate
GPS-DRIFT
61.8 Hz
Semantic map update
ConvBKI
2.2 Hz
TABLE III: Observed runtime rates with demonstration stack active.
Autonomous Surface Vehicles (ASVs) operating in dynamic marine environments require robust control policies for tasks such as path following and station keeping, making reinforcement learning (RL) a promising alternative to classical controllers. However, existing ASV simulators rarely support parallel environments for RL training. Such existing simulators require accurate hydrodynamic modeling from computational fluid dynamics solvers or towing tank tests for setting hydrodynamic parameters to address the sim-to-real gap. To address these challenges, we present an ASV simulator and accompanying pipeline that enables training policies starting from unknown vehicle dynamics. Our framework uses only a CAD model and brief set of open-water field trajectories for approximating and refining both hydrodynamic and thruster parameters. Real-world deployments on a BlueBoat ASV demonstrate successful zero-shot sim-to-real transfer in path following and station-keeping tasks without prior hydrodynamic and propeller information.
Simulation is essential for maritime robotics, supporting operator training, mission rehearsal, and human-vehicle interaction in environments where real-world testing is costly or hazardous. Existing simulators focus primarily on autonomy systems and often lack human-in-the-loop interaction and realistic environmental physics. This paper introduces LOTUSim, an open-source, real-time maritime simulator supporting multi-user interaction across aerial, surface, and underwater robotic systems for coordinated naval-style operations. The first contribution of this work is enabling real-time interactive performance for users while ensuring scalability to large fleets operating within a shared interactive simulation environment. Validation demonstrates robust human-in-the-loop performance, maintaining strict real-time execution and high visual fidelity while scaling to large heterogeneous maritime drone swarms. The second contribution is a computationally efficient, Ekman-inspired layered, underwater current model that captures wind-driven, depth-dependent flow dynamics with sufficient physical fidelity for large-scale simulations. Validation against ocean reanalysis data demonstrates substantially improved accuracy compared to commonly used stochastic Gauss-Markov current models. These results confirm LOTUSim's suitability as a simulation platform for operatorin-the-loop maritime robotics research.
Autonomous surface vessels for floating-waste removal operate under varying hydrodynamics, external disturbances, and challenging water-surface perception. We present a field-validated system that combines camera-based polarimetric perception with a lightweight DRL-based controller for floating-waste detection and capture. Camera detections are converted into water-surface target points and tracked by a controller trained entirely in simulation and deployed directly on a retrofitted ASV platform. Our main contribution is a sim-to-real testing methodology that combines a two-stage simulation protocol with a perception abstraction module designed to mimic real camera behavior, enabling reproducible field trials and explicit evaluation of the sim-to-real gap. We apply this framework in matched simulation and field experiments across 14 disturbance regimes to expose failure modes and evaluate robustness. The results show centimeter-level terminal accuracy and indicate robust control performance under the evaluated perturbation regimes. The main source of degradation is insufficient actuation-model fidelity. We also demonstrate the system in a search-and-capture application using real camera detections in real-world conditions over areas of up to 450m2. The study distills practical lessons for reliable transfer, including improved actuation-model fidelity, targeted domain randomization, and careful management of latency and timestamps across modules, while highlighting remaining challenges.
Luis F. W. Batista, Stéphanie Aravecchia, Cédric Pradalier
GeorgiaTech Europe - IRL2958 GT-CNRS, Metz, France