Low-Cost Teleoperation Extension for Mobile Manipulators
Organizations: Research Center for Digital Engineering and Innovation, Moscow, Russia
Abstract
Teleoperation of mobile bimanual manipulators requires simultaneous control of high-dimensional systems, often necessitating expensive specialized equipment. We present an open-source teleoperation framework that enables intuitive whole body control using readily available commodity hardware. Our system combines smartphone-based head tracking for camera control, leader arms for bilateral manipulation, and foot pedals for hands-free base navigation. Using a standard smartphone with IMU and display, we eliminate the need for costly VR helmets while maintaining immersive visual feedback. The modular architecture integrates seamlessly with the XLeRobot framework, but can be easily adapted to other types of mobile manipulators. We validate our approach through user studies that demonstrate improved task performance and reduced cognitive load compared to keyboard-based control.
Figures & tables
| Control setup | Pack part into a box | Place a bottle into a locker | Throw garbage into a garbage bin | |||
|---|---|---|---|---|---|---|
| Success rate | Time | Success rate | Time | Success rate | Time | |
| Keyboard setup | 65.5% | 124 s | 43.6% | 232 s | 75.3% | 80 s |
| Meta Quest 3 + pedals | 74.8% | 108 s | 47.2% | 210 s | 88.1% | 64 s |
| Smartphone VR + pedals | 74.4% | 110 s | 46.6% | 211 s | 89.6% | 67 s |
Robot Teleoperation
Robot teleoperation studies how people remotely control robots through interfaces, sensing, feedback, and autonomy, despite distance, delay, and embodiment gaps.
See all 206 papers