cs.ROMar 16, 2026

CORAL: COntextual Reasoning And Local Planning in A Hierarchical VLM Framework for Underwater Monitoring

Authors: Zhenqi Wu, Yuanjie Lu, Xuesu Xiao, Xiaomin Lin

Organizations: University of South Florida · George Mason University

Abstract

Oyster reefs are critical ecosystem species that sustain biodiversity, filter water, and protect coastlines, yet they continue to decline globally. Restoring these ecosystems requires regular underwater monitoring to assess reef health, a task that remains costly, hazardous, and limited when performed by human divers. Autonomous underwater vehicles (AUVs) offer a promising alternative, but existing AUVs rely on geometry-based navigation that cannot interpret scene semantics. Recent vision-language models (VLMs) enable semantic reasoning for intelligent exploration, but existing VLM-driven systems adopt an end-to-end paradigm, introducing three key limitations. First, these systems require the VLM to generate every navigation decision, forcing frequent waits for inference. Second, VLMs cannot model robot dynamics, causing collisions in cluttered environments. Third, limited self-correction allows small deviations to accumulate into large path errors. To address these limitations, we propose CORAL, a framework that decouples high-level semantic reasoning from low-level reactive control. The VLM provides high-level exploration guidance by selecting waypoints, while a dynamics-based planner handles low-level collision-free execution. A geometric verification module validates waypoints and triggers replanning when needed. Compared with the previous state-of-the-art, CORAL improves coverage by 14.28% percentage points, or 17.85% relatively, reduces collisions by 100%, and requires 57% fewer VLM calls.

Figures & tables

Explore similar work

CardsList
  1. AquaBEV-Nav: Learned BEV Occupancy for Underwater Navigation and Exploration

    Sep 26, 2026Trung Tien Dong, Zhenqi Wu, Sahasra Kondapalli +3Autonomous Underwater NavigationUnderwater Robotics

  2. CAVE-NAV: VLM-Based Autonomous 3D Navigation in Underwater Cave Environments

    Aug 28, 2026Zhenqi Wu, Yuanjie Lu, Yisheng Zhang +4Autonomous Underwater NavigationVision-Language Navigation

  3. Autonomous Search for Sparsely Distributed Visual Phenomena through Environmental Context Modeling

    Mar 10, 2026Eric Chen, Travis Manderson, Nare Karapetyan +3Underwater RoboticsActive Visual Perception