cs.RONov 18, 2026

LAGR: Language-Aware Grasp Re-Ranking for Task Oriented Grasping

Authors: Manav Kulshrestha, Shreyans Jain, Apoorva Vashisth, Ankush Gupta, Damon Conover, Aniket Bera

Organizations: Purdue University, West Lafayette, IN, USA · IIT Delhi, New Delhi, India · DEVCOM ARL, Adelphi, MD, USA

Abstract

Grasping is a fundamental capability for robotic manipulation, with the appropriate grasp depending on the downstream task. For example, a hammer should be held by its handle for hammering but by its head when it is handed over. Selecting such a grasp requires consideration of two criteria: physical feasibility on the object and suitability for the task. Developing such an approach requires dense grasp labels with both feasibility and task scores on real observations, but existing task-oriented grasping datasets are small, synthetic, or costly to annotate. To address this gap, we construct a dataset of 2.68 million scored 5-DoF grasp annotations over 100,911 image-task pairs from 1717 object categories. Additionally, we introduce LAGR, a task-oriented grasp detection method that explicitly addresses both these challenges. Given vision-language inputs, LAGR first generates task-independent grasp proposals along with a physical feasibility score, and then scores the generated grasps with a language-conditioned re-ranker that reasons over all proposals jointly. Experiments show that LAGR outperforms the next best method by 9.3 percentage points. We further validate LAGR on real objects by executing task-oriented grasps with a Franka Research 3 robot.

Figures & tables

Explore similar work

CardsList
  1. TGrasp6D: Task-Informed Vision-Language Priors and Pose Refinement enable Zero-Shot Task-Oriented 6DoF Grasping

    Oct 14, 2026Manav Kulshrestha, Apoorva Vashisth, Damon Conover +1Robotic GraspingZero-Shot Robotic Manipulation

  2. Training-free Task-oriented Grasp Generation

    Feb 7, 2025Jiaming Wang, Jizhuo Chen, Diwen Liu +1Robotic GraspingVLMs for Robotics

  3. SeededGrasp: Language-Guided Grasping in Complex Scenes with Multiple Embodiments

    Jul 22, 2026Yang Xu, Gurpreet Singh Mukker, Raymond Wang +3Robotic GraspingLanguage-Conditioned Robot Manipulation