Robot Teleoperation

Ask about this topic

Overview

Robot teleoperation lets a human guide a distant robot when direct access is unsafe, impractical, or impossible, from surgery and space operations to mobile and dexterous manipulation. Interfaces include joysticks, leader arms, gloves, exoskeletons, and VR or augmented reality, while visual, tactile, and force feedback help operators judge contact and motion. Shared autonomy, motion retargeting, predictive control, and learned policies can reduce workload, avoid collisions, and turn demonstrations into training data for robot learning. A central challenge is balancing responsive, intuitive control with stability and safety under network delay, limited sensing, and mismatches between human and robot bodies; broader real-world and clinical validation remains important.

Latest papers

CardsList

207 papers34 papers in the last four weeks, up 26% on the four weeks before. 0.2% of all new papers.

  1. Residual Reinforcement Learning for Robot Teleoperation under Stochastic Delays

    May 14, 2026Kaize Deng, Zewen YangRobotic ControlRL Control

    Technical University of Munich, 80333 Munich, Germany

  2. Beyond VMAF: Towards Application-Specific Metrics for Teleoperation Video

    May 13, 2026Ines Trautmannsheimer, Richard Grauberger, Frank DiermeyerRobot TeleoperationVideo Quality Assessment

    Chair of Automotive Technology Technical University of Munich Munich, Germany

  3. Real-Time Whole-Body Teleoperation of a Humanoid Robot Using IMU-Based Motion Capture with Sim2Sim and Sim2Real Validation

    May 12, 2026Hamza Ahmed Durrani, Suleman KhanRobot TeleoperationHumanoid Robot Control

    WeGo Robotics

  4. DexTwist: Dexterous Hand Retargeting for Twist Motion via Mixed Reality-based Teleoperation

    May 12, 2026Dongmyoung Lee, Chengxi Li, Dongheui LeeDexterous ManipulationContact-Rich Robotic Manipulation

    Autonomous Systems Lab, Institute of Computer Technology, TU Wien, Vienna, Austria. · Institute of Robotics and Mechatronics (DLR), German Aerospace Center, Wessling, Germany.

  5. Towards Generative Predictive Display for Vision-Based Teleoperation: A Zero-Shot Benchmark of Off-the-Shelf Video Models

    May 10, 2026Aws Khalil, Jaerock KwonVideo Diffusion ModelsRobot Teleoperation

    Department of Electrical and Computer Engineering, University of Michigan - Dearborn, Dearborn, MI, USA

  6. VISTA: A Benchmark for Real-Time Video Streaming under Network Impairments in Surgical Teleoperation

    May 9, 2026Zexin Deng, Zhenhui Yuan, Tian Lu +3Robot TeleoperationVideo Quality Assessment

    Institute for Applied and Translational Technologies in Surgery, University Hospitals Coventry & Warwickshire NHS Trust, UK · College of Control Science and Engineering and the State Key Laboratory of Industrial Control Technology, Zhejiang University, China · South China University of Technology, Guangzhou 511442, China +1

  7. Intention assimilation control for accurate tracking with variable impedance in teleoperation

    May 7, 2026Atsushi Takagi, Yanan Li, Hiroaki Gomi +1Robot Trajectory TrackingRobot Teleoperation

  8. AssistDLO: Assistive Teleoperation for Deformable Linear Object Manipulation

    May 7, 2026Berk Guler, Simon Manschitz, Kay Pompetzki +1Bimanual Robotic ManipulationDeformable Object Manipulation

    TU Darmstadt, Institute for Intelligent Autonomous Systems, Computer Science Department, 64289 Darmstadt, Germany · Honda Research Institute Europe GmbH, Carl-Legien-Straße 30, 63073 Offenbach/Main, Germany · German Research Center for AI (DFKI), Research Department: Systems AI for Robot Learning; Hessian.AI; Robotics Institute Germany (RIG); Centre for Cognitive Science, Hochschulstr. 10, 64293 Darmstadt, Germany

  9. Shared Autonomy Assisted by Impedance-Driven Anisotropic Guidance Field

    May 4, 2026Sihan Chen, Hang Xu, Yupu Lu +4Robot TeleoperationShared Autonomy

    School of Computing and Data Science, The University of Hong Kong, Hong Kong, China · School of Engineering, Nanjing University of Information Science and Technology, Nanjing, China

  10. Phone2Act: A Low-Cost, Hardware-Agnostic Teleoperation System for Scalable VLA Data Collection

    May 3, 2026Om Mandhane, Bipin Yadav, Sangeetha Prasanna Ram +1Robotic Data CollectionRobot Teleoperation

    Dept. of Automation & Robotics Engineering, Vivekanand Education Society’s Institute of Technology (VESIT), Mumbai, India.

  11. DEX-Mouse: A Low-cost Portable and Universal Interface with Force Feedback for Data Collection of Dexterous Robotic Hands

    Apr 16, 2026Joonho Koh, Haechan Jung, Nayoung Kim +2Dexterous ManipulationRobotic Data Collection

    Dept. of Artificial Intelligence, Sogang University, Korea · Dept. of Electronic Engineering, Sogang University, Korea · Dept. of Mechanical Engineering, Sogang University, Korea +1

  12. GeoVision-Enabled Digital Twin for Hybrid Autonomous-Teleoperated Medical Responses

    Apr 14, 2026Parham Kebria, Soheil Sabri, Laura J BrattainDigital TwinsRobotics

    Electrical and Computer Engineering / North Carolina A&T State University / Greensboro, USA · Urban Digital Twin Lab, School of Modeling Simulation and Training / University of Central Florida / Orlando, USA · Department of Internal Medicine / College of Medicine, University of Central Florida / Orlando, USA

  13. Adaptor: Advancing Assistive Teleoperation with Few-Shot Learning and Cross-Operator Generalization

    Apr 10, 2026Yu Liu, Yihang Yin, Tianlv Huang +8Robot TeleoperationRobot Learning

    School of Artificial Intelligence, Jilin University. · IO-AI TECH.

  14. Towards Multi-Object Nonprehensile Transportation via Shared Teleoperation: A Framework Based on Virtual Object Model Predictive Control

    Apr 8, 2026Xinyang Fan, Zhaoyang Chen, Shu Xin +4Robot TeleoperationDynamic Robotic Manipulation

    State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin 150001, China. · Advanced Manufacturing Laboratory, Huawei Technologies, Shenzhen 518129, China.

  15. OpenRC: An Open-Source Robotic Colonoscopy Framework for Multimodal Data Acquisition and Autonomy Research

    Apr 4, 2026Siddhartha Kapuria, Mohammad Rafiee Javazm, Naruhiko Ikoma +4Robotic EndoscopySurgical Robotics

    Walker Department of Mechanical Engineering, The University of Texas at Austin, Austin, 78712, TX, USA · Department of Surgical Oncology, Division of Surgery, The University of Texas MD Anderson Cancer Center, Houston, 77030, TX, USA · Department of Surgery & Perioperative Care, Dell Medical School, The University of Texas at Austin, Austin, 78712, TX, USA +1

  16. A Multi-View 3D Telepresence System for XR Robot Teleoperation

    Apr 4, 2026Enes Ulas Dincer, Manuel Zaremski, Alexandra Nick +3Robot TeleoperationVirtual Reality

    Institute for Anthropomatics and Robotics, Karlsruhe Institute of Technology, 76137 Karlsruhe, Germany · Institute of Human and Industrial Engineering, Karlsruhe Institute of Technology, 76137 Karlsruhe, Germany

  17. A Rapid Instrument Exchange System for Humanoid Robots in Minimally Invasive Surgery

    Apr 3, 2026Bingcong Zhang, Yihang Lyv, Lianbo Ma +6Surgical RoboticsHumanoid Robotics

    Tianjin University, Tianjin, China · Institute of Medical Robotics and Intelligent Systems, Tianjin University, Tianjin, China

  18. HapCompass: A Rotational Haptic Device for Contact-Rich Robotic Teleoperation

    Mar 31, 2026Xiangshan Tan, Jingtian Ji, Tianchong Jiang +2Haptic Feedback for Robot TeleoperationHaptic Feedback

    Toyota Technological Institute at Chicago (TTIC) · University of Chicago

  19. Feel Robot Feels: Tactile Feedback Array Glove for Dexterous Manipulation

    Mar 30, 2026Feiyu Jia, Xiaojie Niu, Sizhe Yang +5Haptic Feedback for Robot TeleoperationRobot Teleoperation

    University of Science and Technology of China · Shanghai AI Laboratory · The Chinese University of Hong Kong +1

  20. Tele-Catch: Adaptive Teleoperation for Dexterous Dynamic 3D Object Catching

    Mar 30, 2026Weiguang Zhao, Junting Dong, Rui Zhang +3Robot TeleoperationRobotic Manipulation

    University of Liverpool · Xi’an Jiaotong-Liverpool University · Shanghai AI Lab +2

  21. Visualizing Impedance Control in Augmented Reality for Teleoperation: Design and User Evaluation

    Mar 26, 2026Gijs van den Brandt, Femke van Beek, Elena TortaBimanual Robotic ManipulationContact-Rich Robotic Manipulation

    Department of Mechanical Engineering, Eindhoven University of Technology, The Netherlands

  22. MIRROR: Visual Motion Imitation via Real-time Retargeting and Teleoperation with Parallel Differential Inverse Kinematics

    Mar 25, 2026Junheng Li, Lizhi Yang, Aaron D. AmesInverse KinematicsRobot Kinematics

    Department of Mechanical and Civil Engineering, California Institute of Technology, Pasadena, USA.

  23. Affordance-Guided Enveloping Grasp Demonstration Toward Non-destructive Disassembly of Pinch-Infeasible Mating Parts

    Mar 22, 2026Masaki Tsutsumi, Takuya Kiyokawa, Gen Sako +1Robotic ManipulationRobotic Grasping

    Department of Systems Innovation, Graduate School of Engineering Science, The University of Osaka, 1-3 Machikaneyama, Toyonaka, Osaka, Japan. · Industrial Cyber-physical Systems Research Center, The National Institute of Advanced Industrial Science and Technology (AIST), 2-3-26 Aomi, Koto-ku, Tokyo, Japan.

  24. Training-Free Adaptive 360-degree Video Streaming via Semantic Potential Fields

    Mar 22, 2026Aizierjiang Aiersilan, Zhangfei YangGaze EstimationRobot Teleoperation

    The George Washington University

  25. KUKAloha: A General, Low-Cost, and Shared-Control based Teleoperation Framework for Construction Robot Arm

    Mar 20, 2026Yifan Xu, Qizhang Shen, Vineet Kamat +1Robot TeleoperationRobotic Control

    Department of Civil and Environmental Engineering, University of Michigan, United States of America · Department of Robotics, University of Michigan, United States of America

  26. TeleDex: Accessible Dexterous Teleoperation

    Mar 17, 2026Omar Rayyan, Maximilian Gilles, Yuchen CuiRobot TeleoperationRobotic Data Collection

    University of California, Los Angeles

  27. Efficient and Reliable Teleoperation through Real-to-Sim-to-Real Shared Autonomy

    Mar 17, 2026Shuo Sha, Yixuan Wang, Binghao Huang +2Robot TeleoperationShared Autonomy

    Columbia University · University of Pennsylvania

  28. Beyond Cybathlon: On-demand Quadrupedal Assistance for People with Limited Mobility

    Mar 17, 2026Carmen Scheidemann, Andrei Cramariuc, Changan Chen +2Assistive RoboticsHealthcare Robotics

    ETH Zurich, Robotic Systems Lab, Zurich, Switzerland.

  29. OmniClone: Engineering a Robust, All-Rounder Whole-Body Humanoid Teleoperation System

    Mar 15, 2026Yixuan Li, Le Ma, Yutang Lin +8Robot TeleoperationHumanoid Robot Control

  30. Stiffness Copilot: An Impedance Policy for Contact-Rich Teleoperation

    Mar 14, 2026Yeping Wang, Zhengtong Xu, Pornthep Preechayasomboon +4Robot TeleoperationContact-Rich Robotic Manipulation

    All authors are with Meta Reality Labs Research · Yeping Wang is with University of Wisconsin-Madison, Madison, WI, USA · Zhengtong Xu is with Purdue University, West Lafayette, IN, USA