cs.RODec 2, 2024

Human-Machine Interfaces for Subsea Telerobotics: From Soda-straw to Natural Language Interactions

Authors: Adnan Abdullah, David Blow, Ruo Chen, Thanakon Uthai, Eric Jing Du, Md Jahidul Islam

Organizations: RoboPI Laboratory. University of Florida, Gainesville, FL, USA · ICIC Laboratory. University of Florida, Gainesville, FL, USA

Abstract

This review explores the evolution of human-machine interfaces (HMIs) in subsea telerobotics, charting the progression from traditional first-person "soda-straw" consoles-- characterized by narrow field-of-view camera feeds-- to contemporary interfaces leveraging gesture recognition, virtual reality, and natural language processing. The review makes three key contributions. First, we introduce a structured framework that analyzes subsea HMIs through three interrelated aspects: operator experience, robotic autonomy, and bidirectional human-machine communication. Second, using these aspects, we compare visual, haptic, extended-reality, gesture, and natural-language interfaces; examine the progression from direct teleoperation to shared autonomy; and assess the distinct roles of simulators and digital twins in training, prototyping, and mission support. Third, we synthesize the reported evidence to distinguish established industrial tools, selectively deployed technologies, and research-stage capabilities, while identifying limitations in interoperability, communication reliability, immersive feedback, and field validation. From this synthesis, we outline standardization needs and research directions for hydrodynamic feedback, latency-aware shared autonomy, grounded language interaction, and real-to-simulation transfer. The report concludes by identifying open research questions and proposing a roadmap toward more intelligent and intuitive subsea HMI systems.

Figures & tables

Explore similar work

CardsList
  1. Towards Reliable Underwater Diver-Robot Interaction: Gesture Design, Interaction Logic, and Real-World Evaluation

    Sep 20, 2026Yingqi Liu, Kanzhong Yao, Zimeng Peng +4Robotic ControlGesture Recognition

  2. A 3DGS-Driven Dynamic Viewpoint and Vibrotactile Framework for Subsea Teleoperation Validated via fNIRS

    Jul 10, 2026Fang Xu, Tianyu Zhou, Ruitong Tian +2Robot TeleoperationHaptic Feedback

  3. Defining an Evaluation Method for External Human-Machine Interfaces

    Apr 14, 2026Jose Gonzalez-Belmonte, Jaerock KwonAutonomous DrivingV2X Communication