cs.ROFeb 7, 2025

Training-free Task-oriented Grasp Generation

Authors: Jiaming Wang, Jizhuo Chen, Diwen Liu, Harold Soh

Abstract

This paper presents a training-free pipeline for task-oriented grasp generation that combines pre-trained grasp generation models with vision-language models (VLMs). Unlike traditional approaches that focus solely on stable grasps, our method incorporates task-specific requirements by leveraging the semantic reasoning capabilities of VLMs. We evaluate five querying strategies, each utilizing different visual representations of candidate grasps, and demonstrate significant improvements over a baseline method in both grasp success and task compliance rates, with absolute gains of up to 36.9% in overall success rate. Our results underline the potential of VLMs to enhance task-oriented manipulation, providing insights for future research in robotic grasping and human-robot interaction.

Figures & tables

Explore similar work

CardsList
  1. TGrasp6D: Task-Informed Vision-Language Priors and Pose Refinement enable Zero-Shot Task-Oriented 6DoF Grasping

    Oct 14, 2026Manav Kulshrestha, Apoorva Vashisth, Damon Conover +1Robotic GraspingZero-Shot Robotic Manipulation

  2. SeededGrasp: Language-Guided Grasping in Complex Scenes with Multiple Embodiments

    Jul 22, 2026Yang Xu, Gurpreet Singh Mukker, Raymond Wang +3Robotic GraspingLanguage-Conditioned Robot Manipulation

  3. OpenDexGrasp: Open-vocabulary Task-Oriented Dexterous Grasping

    Sep 16, 2026Jiyao Zhang, Junhan Wang, Tianyu Wang +4Robotic GraspingDexterous Manipulation