cs.ROMar 13, 2026

GoalSwarm: Multi-UAV Semantic Coordination for Open-Vocabulary Object Navigation

Authors: MoniJesu Wonders James, Amir Atef Habel, Aleksey Fedoseev, Dzmitry Tsetserokou

Organizations: The authors are with the Intelligent Space Robotics Laboratory, Center for Digital Engineering, Skolkovo Institute of Science and Technology, Moscow, Russia.

Abstract

Cooperative visual semantic navigation is a foundational capability for aerial robot teams operating in unknown environments. However, achieving robust open-vocabulary object-goal navigation remains challenging due to the computational constraints of deploying heavy perception models onboard and the complexity of decentralized multi-agent coordination. We present GoalSwarm, a fully decentralized multi-UAV framework for zero-shot semantic object-goal navigation. Each UAV collaboratively constructs a shared, lightweight 2D top-down semantic occupancy map by projecting depth observations from aerial vantage points, eliminating the computational burden of full 3D representations while preserving essential geometric and semantic structure. The core contributions of GoalSwarm are threefold: (1) integration of zero-shot foundation model -- SAM3 for open vocabulary detection and pixel-level segmentation, enabling open-vocabulary target identification without task-specific training; (2) a Bayesian Value Map that fuses multi-viewpoint detection confidences into a per-pixel goal-relevance distribution, enabling informed frontier scoring via Upper Confidence Bound (UCB) exploration; and (3) a decentralized coordination strategy combining semantic frontier extraction, cost-utility bidding with geodesic path costs, and spatial separation penalties to minimize redundant exploration across the swarm.

Figures & tables

Explore similar work

CardsList
  1. GoalVLM: VLM-driven Object Goal Navigation for Multi-Agent System

    Mar 18, 2026MoniJesu James, Amir Atef Habel, Aleksey Fedoseev +1Open-Vocabulary Object NavigationObject-Goal Navigation

  2. Dual-Layer Semantic-Spatial Belief Mapping for Aerial Object Goal Navigation

    Sep 8, 2026Jianqiang Xiao, Xiang Deng, Yuexuan Sun +3UAV NavigationVision-Language Navigation

  3. DM3^3-Nav: Decentralized Multi-Agent Multimodal Multi-Object Semantic Navigation

    Apr 23, 2026Amin Kashiri, Atharva Jamsandekar, Yasin YazıcıoğluVision-Language NavigationMulti-Robot Coordination