ROS2MR: Connecting ROS 2 Motion Planning to Mixed-Reality Trajectory Visualization
Organizations: Technical University of Munich, Heilbronn, Germany
Abstract
Mixed reality (MR) allows users to inspect planned robot motion within their physical surroundings, but displaying trajectories from robotics software requires converting their joint configurations and timing into a format the MR application can play back. This paper presents ROS2MR, an extension of the MR-Robotics LAB platform that converts YAML-serialized ROS 2 joint trajectories, including MoveIt motion plans, into the platform's existing JSON playback format. The converter validates the input, maps arm joints by name, and resamples the trajectory at a nominal rate of 30 Hz, using cubic Hermite interpolation when joint velocities are supplied and linear interpolation otherwise, while binary gripper commands are sampled separately using a zero-order hold. A Python export helper combines sequences of motion plans and gripper states into a single trajectory and checks positional agreement at segment boundaries. The MR application was also adapted for Apple Vision Pro in addition to Meta Quest 3. A technical evaluation showed that the converter preserved the normalized duration and endpoint configurations for dense, sparse, and irregularly timed inputs. With supplied velocities, the position RMSE was approximately 2.91x10^-5 degrees for all sampling patterns; without them, sparse input increased it to 0.85 degrees, and close positional agreement did not guarantee accurate velocity profiles. A pick-and-place sequence retained its open--closed--open gripper order, although off-grid transitions were shifted to the output sampling grid. The resulting file-based pathway enables inspection of ROS-generated trajectories in MR without a live ROS connection.
Figures & tables
| Model | Class | Payload (kg) | Reach (mm) |
| KUKA | |||
| KR3 R540 | Industrial | 3 | 541 |
| KR6 R900 sixx | Industrial | 6 | 901.5 |
| KR16 R1610-2 | Industrial | 16 | 1612 |
| KR20 R1810-2 | Industrial | 20 | 1813 |
| KR 120 R2500 pro | Industrial | 120 | 2496 |
| Input | Velocities | RMSE | Maximum |
| Dense | Yes | ||
| Sparse | Yes | ||
| Irregular | Yes | ||
| Dense | No | ||
| Sparse | No | ||
| Irregular | No |
| Quantity | Velocities | RMSE | Maximum |
| Position | Yes | ||
| Position | No | ||
| Velocity | Yes | ||
| Velocity | No |
Robotics
Robotics studies the design and control of machines that perceive, move, and act in physical environments.
See all 801 papers