Sub-Millisecond Reflexes for Continuous Physical Human-Robot Interaction
Authors: Jon Škerlj, Sami Haddadin
Organizations: Munich Institute of Robotics and Machine Intelligence (MIRMI), Technische Universität München (TUM), Germany. · Mohamed Bin Zayed University of Artificial Intelligence, UAE
Continuous physical human-robot interaction requires robots to rapidly adapt their control behaviour without interrupting task execution. However, existing ROS 2 control architectures rely on stop-to-switch mechanisms that introduce substantial delays and interrupt execution. We present an open-source, sub-millisecond reflex engine based on an enhanced ROS 2-compatible multimode controller that enables deterministic switching between control modalities and integrates reflex behaviours for mitigating contact hazards and kinematic limit violations. Experiments on a Franka Robotics manipulator demonstrate switching delays below 0.1 ms, more than four orders of magnitude faster than conventional ros2_control, while maintaining continuous operation during safety-critical events. In a multi-stage manipulation task, the proposed framework reduced execution time by 3.5% and peak trajectory jerk by more than threefold. By eliminating runtime middleware overhead, controller transitions are implemented as lock-free pointer operations, enabling reflex-level responsiveness within an open-source robotics framework.
Figures & tables
Fig. 1 : Conventional control frameworks interrupt tasks during control mode switching and hazardous events (left), whereas the proposed framework enables sub-millisecond reflex responses and uninterrupted physical human-robot interaction (right).
Fig. 2 : Visualization of the improved multimodal controller within the ros2_control framework. More detail about ros2_control components can be found in [ 20 ] .
Fig. 3 : State machine for reactive reflex behaviours.
TABLE I : Available state-of-the-art reflex behaviours [ 10 ] .
Fig. 4 : Box plots of controller switching delays using a logarithmic scale for a) baseline ros2_control framework, b) original multimode controller, and c) improved multimode controller for 100 switches per each configuration.
Fig. 5 : Stopping distances displayed per joint for a) joint position test and b) joint velocity test.
Fig. 6 : Example trajectories of Joint 2 for (a) joint position and (b) velocity limit tests. Recorded joint angles are shown in blue and velocities in black, corresponding to the respective colour-coded vertical axes.
Fig. 7 : Results of the contact detection tests displaying time to mitigate force after an unexpected collision.
Fig. 8 : Results of the contact detection tests displaying the magnitudes of end-effector force (blue) and velocity (black). Both trajectories correspond to the respective color-coded vertical axes.
Fig. 9 : Multi-stage task velocity comparison between state-of-the-art baseline ( ros2_control ) in red and our approach (enhanced multimode controller) in blue.
Metric
Proposed approach
ros2_control
Total Task Duration [s]
14.09±0.06
14.58±0.10
Peak Trajectory Jerk [m/s3]
155.4±40.6
499.0±96.9
TABLE II : Quantitative performance comparison across 20 trials of the multifaceted task ( N=10 per configuration).
We present multipanda_ros2, a novel open-source ROS2 architecture for multi-robot control of Franka Robotics robots. Leveraging ros2 control, this framework provides native ROS2 interfaces for controlling any number of robots from a single process. Our core contributions address key challenges in real-time torque control, including interaction control and robot-environment modeling. A central focus of this work is sustaining a 1kHz control frequency, a necessity for real-time control and a minimum frequency required by safety standards. Moreover, we introduce a controllet-feature design pattern that enables controller-switching delays of ≤2 ms, facilitating reproducible benchmarking and complex multi-robot interaction scenarios. To bridge the simulation-to-reality (sim2real) gap, we integrate a high-fidelity MuJoCo simulation with quantitative metrics for both kinematic accuracy and dynamic consistency (torques, forces, and control errors). Furthermore, we demonstrate that real-world inertial parameter identification can significantly improve force and torque accuracy, providing a methodology for iterative physics refinement. Our work extends approaches from soft robotics to rigid dual-arm, contact-rich tasks, showcasing a promising method to reduce the sim2real gap and providing a robust, reproducible platform for advanced robotics research.
Jon Škerlj, Seongjin Bien, Abdeldjallil Naceri +1
Munich Institute of Robotics and Machine Intelligence (MIRMI), Technische Universität München (TUM), Germany · Technische Universität Nürnberg (UTN), Germany · Mohamed Bin Zayed University of Artificial Intelligence, UAE
During contact-rich manipulation, interactions between a robot and its environment carry information about local geometry: a surface prevents penetration, a bore guides a peg. A controller that exploits these interactions can comply with environmental constraints while preserving task intent. Robot-earning systems commonly use position, hybrid force-position, or Cartesian impedance control. Their prescribed tracking objectives, stiffness, or force-control directions may not match local constraints and may degrade performance. We learn a proprioceptive reflex policy in simulation on three simple interaction primitives: a spring, a plane, and a rail. The policy maps task-space commands to joint-position targets using state history, without direct force or geometrical measurements. Once trained, it serves as a frozen execution layer beneath higher-level controllers. We evaluate it in dual-arm box lifting, peg insertion, and surface following. In box lifting, the reflex kept the force below the threshold while the baseline failed. In rough-surface following it stayed below the 10 N reference, on par with tuned hybrid force-position control. In 0.02 mm peg insertion It reduced mean estimated contact force to less than half that of the baseline while increasing hardware success rates from at most 22 % to 36-58 %. By separating contact response from command generation, the reflex policy provides motion planners, learned policies, and teleoperators with robust contact-rich execution.
Robot manipulation data collection has been shifting from teleoperation toward robot-free demonstrations, through interfaces such as the Universal Manipulation Interface (UMI) or directly from human hands. Vision-Language-Action (VLA) policies trained on such data inherit the demonstrator's timing. Yet human timing does not directly transfer to robots: compliant hands tolerate fast contact, whereas robots may overshoot due to actuator and tracking limitations; conversely, robots can move faster in free space. This motivates a unified approach that reconciles execution speed with contact safety. We present RoboPace, an online retiming layer that preserves the policy's geometric path while adapting its timing, respecting the target robot's kinematic and dynamic constraints. It adapts execution speed based on predicted contact, jointly accounting for contact-dependent speed limits and the robot's motion constraints. The method requires no policy retraining and operates in real time. Across three contact-rich tasks on a dual-arm robot, faster uniform execution and physical-limit-only retiming largely fail. RoboPace instead achieves higher overall success than slow uniform execution while completing four of five commands in approximately half the time, retaining the reliability of slow execution without its time cost.
Mimo Shirasaka, Takehiko Ohkawa, Takuya Okubo +3
AI Robot Association (AIRoA) · The University of Tokyo