Demonstration of Space Robot Teleoperation over a Lossy and Delayed Network using ATMOS
Authors: Inkyu Jang, Gregorio Marchesini, Nicola De Carli, Byeongjun Kim, Sunwoo Hwang, Dabin Kim, Elias Krantz, Youngkyoung Kong, Frank J. Jiang, Annika Wong, Pedro Roque, Prasetyo W. L. Sanjaya, Nicola Bastianello, Mani H. Dhullipalla, Karl H. Johansson, Hyungbo Shim, Dimos V. Dimarogonas, H. Jin Kim
Organizations: Seoul National University, Seoul, Korea. · KTH Royal Institute of Technology, Stockholm, Sweden. · FleetMQ, Stockholm, Sweden. · California Institute of Technology, Pasadena, CA, USA.
We present a demonstration showcasing the Autonomy Testbed for Multi-purpose Orbiting Systems (ATMOS), a planar spacecraft-analog robot designed for hardware-in-the-loop evaluation of guidance and control strategies in microgravity-like conditions. Using ATMOS as the physical test platform, we investigate the design, analysis, and performance evaluation of control architectures for remotely operated spacecraft under round-trip communication delays. In this work, we develop and experimentally validate a control strategy that combines state prediction and trajectory tracking control to perform a docking maneuver, accounting for time-varying random communication latency between ground operators and the ATMOS system. The demonstration includes a long-distance remote control experiment between Seoul and Stockholm, introducing realistic intercontinental delays and variability. The results highlight the capability of ATMOS to support rapid, reliable, and cost-effective testing of spacecraft teleoperation concepts, establishing a first step toward robust validation of on-orbit operations in microgravity-like environments.
Figures & tables
Figure 1: The robot hardware (ATMOS, Roque et al. (2025) ) considered in this demonstration.
Figure 2: An illustration of the physical distance of 7450 km between the two labs in Stockholm, Sweden (the ATMOS robot) and Seoul, Korea (the controller).
Figure 3: The Gazebo simulator environment used in the simulation experiments, replicating the real workspace of the KTH Space Robotics Laboratory ( Roque et al. (2025) ).
a [ms]
b [ms]
Drop rate [%]
No delay
0
0
0
Light delay
100
200
20
Moderate delay
200
400
20
Severe delay
300
600
20
Table 1: Delay characteristics used in the simulation experiments
Stabilization Task
Tracking Task
Proposed
Reference Only
Proposed
Reference Only
Position [m]
Yaw [ ∘ ]
Position [m]
Yaw [ ∘ ]
Position [m]
Yaw [ ∘ ]
Position [m]
Yaw [ ∘ ]
No delay
0.022
0.536
0.020
0.430
0.069
0.767
0.081
8.511
Light delay
0.022
1.515
0.025
1.714
0.060
1.496
0.118
15.456
Moderate delay
0.024
2.385
0.212
31.977
0.104
2.318
0.326
91.094
Severe delay
0.032
4.421
0.618
76.208
-
-
-
-
Table 2: Simulation result: Position and yaw RMSE under various delay levels
Figure 4: Position trajectories under various delay levels with and without delay compensation in stabilization task of the simulation experiment. The ★ symbols denote the stabilization target positions.
Figure 5: Position trajectories under various delay levels with and without delay compensation in the tracking task of the simulation experiment. The reference circular trajectory is drawn as black dotted curves.
Figure 6: (Left) The message transmission and arrival times. Each point corresponds to one message, whose horizontal and vertical coordinates representing the time when it first appeared on the KTH and the SNU sides, respectively. (Right) The histograms of the apparent transmission delay. Since the two clocks cannot (and need not) be perfectly synchronized, the one-way delay is not accurately observable and the apparent delay might be biased.
Figure 7: The position trajectory of the hardware experiment. The robot first stabilizes to the docking configuration marked green, and then the optimal trajectory computed from the optimal control problem ( 9 ) is executed.
Figure 8: The configuration trajectory recorded in the hardware experiment. Even under losses of data and transmission delays, the actual robot trajectory well converged to the desired trajectory.
Robot teleoperation studies how people remotely control robots through interfaces, sensing, feedback, and autonomy, despite distance, delay, and embodiment gaps.
Low-cost planar air-bearing testbeds have matured into a standard proxy for free-flying spacecraft GNC, but they remain largely thruster-only and are rarely equipped for contact-rich, inertia-coupled manipulation. Building on the open-source ATMOS testbed, we contribute a reaction wheel and two force/torque-sensed robotic arms (LEVION) with interchangeable end-effectors, integrated as first-class control actuators through a unified ROS 2 abstraction layer. On top of the software stack we build a reinforcement-learning training environment and digital twin, and a controller that exploits these added degrees of freedom, letting classical optimal controllers and learned policies be swapped on the same hardware without modification. We validate the integrated system, PINGU, across four benchmark tasks: point-to-pose navigation (classical LQR vs. sim-to-real PPO), dynamic disturbance rejection under arm-induced center-of-mass shifts, reaction-wheel momentum stabilization, and force-controlled docking. The results show that these additions extend an ATMOS-class emulator into the contact-rich regime and bridge classical optimal control and reinforcement learning on one reproducible platform.
Ricard Marsal I Castan, Akiyoshi Uchida, Aman Arora +7
University of Luxembourg · Tohoku University · Georgia Institute of Technology
This article presents a bimanual teleoperation pipeline and conceptual design of a deployable four-finger payload for intra-vehicular free-flyers. Future habitats in low-Earth orbit (LEO) will require systems to perform mundane tasks like cargo handling and maintenance during crewed and uncrewed periods. The gripper payload provides 17 manipulation degrees-of-freedom (DoF) through four independently actuated fingers on a linear rail system. To control it, a virtual reality (VR) device interface maps the human ground operator's hand motions to the finger pairs, their separation to the rail, and common wrist motion to Astrobee translation. We present the preliminary results of teleoperating Astrobee in a custom zero-gravity MuJoCo-based International Space Station (ISS) simulator through ten repeated trials of transporting a rigid ISS Cargo Transfer Bag (CTB). We measure task success, continuous contact retention, completion time, and cargo motion.
William Su, Jordan Kam, Yunosuke Nakamura +3
Aerospace Engineering Program, University of California, Berkeley, Berkeley, CA 94720, USA · Department of Aerospace Engineering, California Institute of Technology, Pasadena, CA 91125, USA · Department of Mechanical Engineering, University of California, Berkeley, Berkeley, CA 94720, USA +1
We present an experimental validation framework for space robotics that leverages underwater environments to approximate microgravity dynamics. While neutral buoyancy conditions make underwater robotics an excellent platform for space robotics validation, there are still dynamical and environmental differences that need to be overcome. Given a high-level space mission specification, expressed in terms of a Signal Temporal Logic specification, we overcome these differences via the notion of maximal disturbance robustness of the mission. We formulate the motion planning problem such that the original space mission and the validation mission achieve the same disturbance robustness degree. The validation platform then executes its mission plan using a near-identical control strategy to the space mission where the closed-loop controller considers the spacecraft dynamics. Evaluating our validation framework relies on estimating disturbances during execution and comparing them to the disturbance robustness degree, providing practical evidence of operation in the space environment. Our evaluation features a dual-experiment setup: an underwater robot operating under near-neutral buoyancy conditions to validate the planning and control strategy of either an experimental planar spacecraft platform or a CubeSat in a high-fidelity space dynamics simulator.
Joris Verhagen, Elias Krantz, Chelsea Sidrane +9
Division of Robotics, Perception and Learning, KTH Royal Institute of Technology, Stockholm, Sweden. · School of Engineering Sciences, KTH Royal Institute of Technology, Stockholm, Sweden. · Division of Decision and Control Systems, KTH Royal Institute of Technology, Stockholm, Sweden. +1