OmniAI: A Surface-Adaptive Aerial Projection Interface for Human--Drone Interaction
Organizations: Intelligent Space Robotics Lab, Skolkovo Institute of Science and Technology, Moscow, Russian Federation · School of Science and Engineering, The Chinese University of Hong Kong, Shenzhen, Guangdong, China
Abstract
Drones in human environments often lack spatially grounded in- terfaces for situated communication. We present OmniAI, an em- bodied aerial agent that supports surface-adaptive interaction by switching projection between an onboard screen and nearby en- vironmental surfaces. A servo-actuated MEMS laser projector renders text-and-image responses from a web-augmented LLM pipeline. Projection surfaces are detected online using RGB-D sensing and RANSAC plane fitting, without pre-mapped geometry. OmniAI provides functionally equivalent voice and gesture con- trol for both drone motion and projected content. By combining speech, mid-air gestures, adaptive projection, and aerial mobility, OmniAI demonstrates a mobile spatial AR interface for context- aware human-drone interaction.