cs.RONov 18, 2026

Single-Controller Teleoperation and Multimodal Dataset Generation for a Mobile Manipulator

Authors: Fardien Azizi, Sitor Sla, Christiaan Peppelman, Dion van Santen, Andrei-Carlo Papuc, Khaled Mustafa, Diego Martinez-Baselga, Javier Alonso-Mora

Organizations: The authors are with the Dept. of Cognitive Robotics, TU Delft, 2628 CD Delft, The Netherlands. · The authors are with RoPeRt Group, DIIS-I3A, University of Zaragoza, 50018 Zaragoza, Spain.

Abstract

Robot learning systems require synchronized, high-quality demonstrations that combine visual, proprioceptive, and action data. However, collecting such datasets with mobile manipulators is often slowed down by fragmented teleoperation interfaces and manual post-processing workflows. This paper presents an integrated framework for teleoperated multimodal data collection on a Clearpath Dingo-O mobile base equipped with a Kinova Gen3 Lite manipulator and an Intel RealSense RGB-D camera. The framework combines single-controller operation of the base, arm, and recording process with an automated ROS-based pipeline for data capture, image-quality filtering, temporal synchronization, visualization, and export to machine-learning-ready Zarr datasets. We validate the system on a pick-and-place mobile-manipulation task in which the robot transports a bottle between two surfaces. The results show that the unified controller supports complete task execution and recording without external commands, while the data pipeline produces synchronized datasets for short demonstrations and identifies corrupted visual frames. The proposed framework provides a practical basis for producing structured demonstrations for robot-learning research.

Figures & tables

Explore similar work

CardsList
  1. TRIP-Bag: A Portable Teleoperation System for Plug-and-Play Robotic Arms and Leaders

    Mar 10, 2026Noboru Myers, Sankalp Yamsani, Obin Kwon +1Robotic Data CollectionRobot Teleoperation

  2. M3-Tele: A Unified Multimodal Teleoperational Framework for Compliant Whole-Body Mobile Manipulation

    Sep 7, 2026Hengxiang Chen, Shenwen Deng, Yujian Ma +3Mobile ManipulationContact-Rich Robotic Manipulation

  3. RoboTacDex: A Dexterous Visual-Tactile-Action Dataset for Humanoid Manipulation

    Jun 30, 2026Xinyi Wang, Donghan Li, Zi'Ang Chen +5Robotic ManipulationBimanual Robotic Manipulation