Organizations: School of Computer Science, Peking University, Beijing, China · School of Computer Science, South China University of Technology, Guangzhou, China · School of Artificial Intelligence, Beijing Normal University, Beijing, China · School of EECS, Peking University, Beijing, China
Vision-Language-Action (VLA) models are mainstream in embodied intelligence but face high inference costs. Edge-Cloud Collaborative (ECC) deployment offers an effective fix by easing edge-device computing pressure to meet real-time needs. However, existing ECC frameworks are suboptimal for VLA models due to two challenges: (1) Diverse model structures hinder optimal ECC segmentation point identification; (2) Even if the optimal split point is determined, changes in network bandwidth can cause performance drift. To address these issues, we propose a novel ECC deployment framework for various VLA models, termed RoboECC. Specifically, we propose a model-hardware co-aware segmentation strategy to help find the optimal segmentation point for various VLA models. Moreover, we propose a network-aware deployment adjustment approach to adapt to the network fluctuations for maintaining optimal performance. Experiments demonstrate that RoboECC achieves a speedup of up to 3.28x with only 2.55%~2.62% overhead.
Figures & tables
Fig. 1: (a) VLA Inference on Edge Devices (b) Challenges of VLA ECC Deployment (c) Overview of the Proposed RoboECC Framework
Fig. 2: Latency of Model Segmentation under Various Structures
Fig. 3: Performance Drift under Network Bandwidth Fluctuation
School of Computer Science, Peking University, Beijing, China. · School of Artificial Intelligence, Beijing Normal University, Beijing, China. · School of Software Engineering, South China University of Technology, Guangzhou, China. +1