cs.SDNov 13, 2026

Dependable Voice Command for Multi-UAV Swarms Using Small Language Models

Authors: Afshin Ameri, Luiz Giacomossi, Håkan Forsberg, Ivan Tomasic, Baran Cürüklü

Organizations: Mälardalen University, Västerås, Sweden

Abstract

Supervisory control of multiple autonomous unmanned aerial vehicles (UAVs) imposes high visual and cognitive demands on human operators, particularly when communicating mission objectives and system constraints. Voice command provides a natural interaction modality that can reduce operator workload; however, its reliability is affected by environmental noise, speech variability, and recognition errors. This paper presents a dependable voice command framework for multi-UAV swarm supervision using Small Language Models (SLMs). The proposed architecture integrates an Automatic Speech Recognition (ASR) module with an SLM-based semantic processing layer to transform spoken operator commands into structured task definitions for downstream multi-UAV planning and execution. To evaluate robustness, an end-to-end assessment pipeline is developed using a Probabilistic Context-Free Grammar (PCFG) to generate synthetic supervisory commands, which are converted into audio samples with varying operator accents and environmental signal-to-noise ratios (SNR). The resulting speech signals are processed by the ASR module, and the SLM performs contextual interpretation and phonetic correction of transcriptions when required. The evaluation isolates the resilience of the voice command pipeline under acoustic degradation and speech variation, demonstrating reliable task generation for multi-UAV supervision in challenging operational conditions.

Figures & tables

Explore similar work

CardsList
  1. Say the Mission, Execute the Swarm: Agent-Enhanced LLM Reasoning in the Web-of-Drones

    May 5, 2026Andrea Iannoli, Lorenzo Gigli, Luca Sciullo +2Aerial RoboticsMulti-Robot Systems

  2. End-to-End Voice Intent Recognition for Spontaneous Human-Drone Interaction with Naive Users

    Jun 19, 2026Allan Henry, Solange Rossato, Christian Graff +2Aerial RoboticsIntent Classification

  3. UAV-SwarmAgent: Scalable Multi-UAV Reconnaissance and Task Allocation via Code Generation and Vision-Language Reasoning

    Oct 23, 2026Oleg Sautenkov, Yasheerah Yaqoot, Muhammad Ahsan Mustafa +3Aerial RoboticsMulti-Robot Coordination