cs.ROJun 11, 2025

A Unified Framework for Probabilistic Dynamic-, Trajectory- and Vision-based Virtual Fixtures

Authors: Maximilian Mühlbauer, Bernhard Weber, Sylvain Calinon, Freek Stulp, Alin Albu-Schäffer, João Silvério

Organizations: School of Computation, Information and Technology, Sensor Based Robotic Systems and Intelligent Assistance Systems, Technical University of Munich, Friedrich-Ludwig-Bauer-Str. 3, Garching, Germany. · German Aerospace Center (DLR), Robotics and Mechatronics Center (RMC), Münchener Str. 20, 82234 Weßling, Germany. · Idiap Research Institute, Martigny, Switzerland. · École Polytechnique Fédérale de Lausanne (EPFL), Switzerland.

Abstract

Probabilistic Virtual Fixtures (VFs) enable the adaptive selection of the most suitable haptic feedback for each phase of a task, based on learned or perceived uncertainty. While keeping the human in the loop remains essential, for instance, to ensure high precision, partial automation of certain task phases is critical for productivity. We present a unified framework for probabilistic VFs that seamlessly switches between manual fixtures, semi-automated fixtures (with the human handling precise tasks), and full autonomy. We introduce a novel probabilistic Dynamical System-based VF for coarse guidance, enabling the robot to autonomously complete certain task phases while keeping the human operator in the loop. For tasks requiring precise guidance, we extend probabilistic position-based trajectory fixtures with automation, allowing for seamless human interaction, geometry-awareness and optimal impedance gains. For manual tasks requiring very precise guidance, we also extend visual servoing fixtures with the same geometry-awareness and impedance behavior. We validate our approach on different robots, including an evaluation with expert users, showcasing operation modes, the ease of programming fixtures and lower interaction forces and favorable usability compared to a baseline.

Figures & tables

Appendix figures & tables8 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Learning Geometry-Aware Virtual Fixtures From Sparse Demonstrations

    Sep 26, 2026Maximilian Mühlbauer, Marcella Piacentino, Raffaella Mancino +10RoboticsRobot Teleoperation

  2. PhysVLA: Towards Physically-Grounded VLA for Embodied Robotic Manipulation

    Jun 11, 2026Namai Chandra, Shriram Damodaran, Lin WangRobotic ControlRobotic Manipulation

  3. AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

    Jun 14, 2025Wenbo Li, Yiteng Chen, Wenhao Li +1Trajectory GenerationLanguage-Conditioned Robot Manipulation