Apr 5, 2026
Interpreting dynamic, heterogeneous multimedia commands with real-time responsiveness is critical for Human-Robot Interaction. We present VA-FastNavi-MARL, a framework that aligns asynchronous audio-visual inputs into a unified latent representation. By treating diverse instructions as a distribution of navigable goals via Meta-Reinforcement Learning, our method enables rapid adaptation to unseen directives with negligible inference overhead. Unlike approaches bottlenecked by heavy sensory processing, our modality-agnostic stream ensures seamless, low-latency control. Validation on a multi-arm workspace confirms that VA-FastNavi-MARL significantly outperforms baselines in sample efficiency and maintains robust, real-time execution even under noisy multimedia streams.
Yang Zhang, Shengxi Jing, Fengxiang Wang +2
Department of Mechanical and Aerospace Engineering, University of Missouri, Columbia, MO, 65201, USA · School of Construction Machinery, Chang’an University, Xi’an, 710064, Shaanxi, China · School of Artificial Intelligence, Hubei University, Wuhan, 430062, Hubei, China +1