Overview

Robotic tool use studies how machines choose and control tools to extend what they can do, from cutting and grinding to drilling and household tasks. Methods combine visual affordance grounding, geometric and physics-based planning, tactile or force feedback, and controllers learned from demonstrations, reinforcement learning, or simulation. Research increasingly targets dexterous and articulated tools, transfer to unseen objects, and long-horizon execution by humanoid and other robots. A central challenge is turning correct tool selection into reliable contact-rich action despite changes in tools and materials, imperfect sensing, and sim-to-real gaps.

Latest papers

CardsList

48 papers5 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. ToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool Use

    Nov 6, 2026Mohamed Elmoghany, Kehan Li, Ruoqu Chen +11Multimodal DatasetRobotic Tool Use

  2. Democratizing Robot-Use Agents: A Unified Harness with Open Models

    Nov 1, 2026Jiarui Yuan, Yuxin Zuo, Xiaoyu Huang +25Robotic Tool UseEmbodied Agent Benchmarks

  3. Which Hand Was Late? Diagnosis for Robot Failure Recovery in Bimanual Tool Use

    Oct 27, 2026Baptiste Bonin, Caro Strickland, Audrey DurandRobot Failure DetectionRobot Failure Recovery

  4. Multi-Tool Selection for Robotic Systems: Comparing Semantic Retrieval and LLM

    Oct 22, 2026Miguel Sousa, Luis Ramos Pinto, João P. Matos-CarvalhoRobotic Tool UseSemantic Search

  5. DexNinja: Learning Robust Dexterous Cutting Policy with a Real-to-Sim-to-Real Data Engine

    Oct 12, 2026Haozhe Lou, Runyi Yang, Wanqi Zhong +10Sim-to-Real TransferContact-Rich Robotic Manipulation

  6. TeleHairing: A Teleoperation Baseline for Robotic Haircutting

    Oct 5, 2026Zhendai Huang, Aleksi Vilkki, Jianan Huang +4Robot TeleoperationRobotic Tool Use

  7. HumanoidToolBench: Benchmarking Humanoid Tool Use from Selection to Mobile Execution

    Oct 1, 2026Kyochul Jang, Seohyeon Park, Ohchul Kwon +9Mobile ManipulationRobotic Tool Use

  8. Tool-Policy Co-Design for Powder Weighing in Laboratory Automation

    Sep 30, 2026Nikola Radulov, Xin Yang, Kevin S. Luck +1Robot Morphology-Control Co-DesignRobotic Tool Use

  9. Make Code as Policy Great Again: Frontier Agents Write, Call, and Evolve Robot Tools

    Sep 30, 2026Shijia Ge, Alex Zhou, Jianshu Zeng +12Robotic Tool UseTool-Using Agents

  10. Robot Tool Design from Scratch via Behavior-Aware Hierarchical Optimization

    Sep 28, 2026Yinghan Chen, Xiyao Tian, Yizan Dai +2Robot Morphology-Control Co-DesignRobotics

  11. From Pixel to Poses: Object-centric Tool Manipulation Learning from Human Demonstrations

    Sep 28, 2026Bangjun Wang, Longyan Wu, Yukun Wei +8Object-Centric World ModelsRobotic Tool Use

  12. BladeMaster: Real-Time Robotic Cutting Simulation with Online-Generated Persistent Discontinuities

    Sep 23, 2026Zhanyu Yang, Yunuo Chen, Yanjia Huang +3Robotics SimulationDeformable Object Manipulation

  13. Relative Contact Velocity-Controlled Hand-Object Mechanism for Dexterous Tool Manipulation

    Sep 22, 2026Sunyu Wang, Jean Oh, Nancy S. PollardContact-Aware Motion PlanningDexterous Manipulation

  14. Mechanical Precision Weeding with a Quadruped Robot

    Sep 17, 2026Ruben Beumer, Tom Janssen, René van de Molengraft +1Robotic Tool UseAgricultural Robotics

  15. ARTiS: An Adaptive Robotic Gripper for Enhanced Tool Manipulation in Disassembly Applications

    Sep 3, 2026Roman Mykhailyshyn, Yukiyasu Domae, Kensuke HaradaRobotic Hand DesignRobotic Grasping

  16. Multi-Tool Robotics Enables In-Situ Sample Manipulation for Time-Resolved Synchrotron Measurements

    Aug 19, 2026Aditya Bondada, Elizabeth M. Wall, Eric Yuan Xiao +4Robotic ManipulationLaboratory Automation

  17. Evolve Vision-Language-Action Model into an Agent with On-the-fly Tool-use

    Aug 14, 2026Ding Yi, Yanzhao Yu, Xili Dai +5Robotic Tool UseTool-Using Vision-Language Agents

  18. Pose-Parameterized Motion Planning and CBF-QP Self-Collision Filtering for a Long-Reach Drilling Boom

    Jul 21, 2026Mehdi Heydari Shahna, Tuomo Kivelä, Jouni MattilaConstrained Motion PlanningControl Barrier Functions

  19. Predicting Grasping Compliance in Robotic Hands through Analytical-Model-Informed Neural Networks

    Jul 20, 2026Qianwen Zhao, Long WangRobotic GraspingRobotic Tool Use

  20. FuncBridge: Towards Functional Tool-Use Generalization via Keypoint Trajectory Reasoning

    Jul 7, 2026Chuhao Zhou, Liquan Wang, Shuxin Cao +5Robot Skill LearningGeneralization in Robotic Manipulation

  21. A Perception-Manipulation Robotics System for Food Cutting

    Jul 5, 2026Xinyuan Luo, Wenzhen YuanRobotic Tool UseRobotic Manipulation

  22. From Grasps to Dexterity: Large-Scale Grasp Pretraining for Dexterous Manipulation

    Jun 29, 2026Ying Yuan, Xinyu Liu, Sriram Krishna +1Robotic GraspingDexterous Manipulation

  23. GROW2^2: Grounding Which and Where for Robot Tool Use

    Jun 29, 2026Yuhong Deng, Yuyao Liu, David Hsu3D Visual GroundingRobotic Tool Use

  24. Lessons from the Field: A Case Study of Robotic Intervention in an Industrial Emergency

    Jun 22, 2026Jonathan Lichtenfeld, Frederik Bark, Robert Grafe +1Mobile RoboticsRobotics

  25. Geometric Reconstruction of Extrinsic Contact Trajectories using Tactile Sensing and Proprioception for Tool Manipulation

    Jun 20, 2026Seojung Min, Yoonjin Kim, Jeong-Jung Kim +1Tactile SensingRobotic Tool Use

  26. Mana: Dexterous Manipulation of Articulated Tools

    Jun 11, 2026Zhao-Heng Yin, Guanya Shi, Pieter Abbeel +1Robotic GraspingDexterous Manipulation

  27. Any-ttach: Quick End-effector Swapping Enables Manipulation Dexterity with Simplicity

    May 28, 2026Weizhe Ni, Jinzhou Li, Xinyu Ma +5Long-Horizon Robotic ManipulationRobotic Tool Use