cs.ROSep 23, 2025

Lang2Morph: Language-Driven Morphological Design of Robotic Hands

Authors: Yanyuan Qiao, Kieran Gilday, Yutong Xie, Josie Hughes

Organizations: CREATE Lab, Swiss Federal Institute of Technology Lausanne (EPFL), Lausanne, Switzerland. · Computer Vision Department, Mohamed bin Zayed University of Artificial Intelligence (MBZUAI), Abu Dhabi, UAE.

Abstract

Designing task-specific robotic hands requires translating diverse task requirements into morphologies that are both functional and manufacturable. Existing parametric and optimization-based approaches provide systematic design tools, but often rely on expert-defined objectives, manual tuning, or simulation-based search. Large language models (LLMs), with broad semantic knowledge and reasoning capabilities, offer a promising way to interpret task requirements directly from natural language. We present Lang2Morph, an LLM-driven framework that maps natural-language task descriptions to fabricable robotic hand morphologies within the Open Parametric Hand (OPH) design space. Lang2Morph combines task reasoning, structured morphology generation, geometric constraints, and feedback-guided selection to produce task-conditioned hand designs. Morphology-level analyses demonstrate high design feasibility and task-dependent structural variation, while real-world experiments with three fabricated hands reveal distinct functional characteristics across manipulation tasks. These results highlight the potential of LLMs as practical interfaces for task-driven robotic hand design.

Figures & tables

Explore similar work

Sep 8, 2026

Bridging Language and Physics: Automated Design of Continuum Robots with Large Language Models

Large language models (LLMs) have recently emerged as a promising tool for automating robot design from high-level specifications, yet they remain ineffective for robots operating under complex physical interactions. This limitation stems from the gap between language-based reasoning and the physical consequences of embodiment, often resulting in designs with low physical validity. In this work, we propose a multi-layered framework, AID-SR, that establishes a closed loop by translating simulator-observed physical states into structured feedback for the LLM designer. Combined with semantic critique, human feedback, and iterative refinement, the framework promotes the generation of physically feasible and functionally meaningful robot designs. We evaluate our approach on tendon-driven continuum robots across a benchmark of 14 tasks spanning reaching, grasping, locomotion, and manipulation. The proposed framework achieves 96.2% rate for passing the simulation feasibility check and by applying a common reinforcement learning training, 26.7% robots can successfully fulfill the corresponding task. We then fabricate three designed robots of AID-SR that successfully complete the task in real-world. These extensive experiments across simulation and real-world environments demonstrate and break the wall of utilizing the LLMs for automated design of continuum robots. The source code and experimental resources are publicly available at https://github.com/UNITES-Lab/AID-SR.
Dec 3, 2025

House of Dextra: Cross-embodied Co-design for Dexterous Hands

Dexterous manipulation is limited by both control and design, without consensus as to what makes manipulators best for performing dexterous tasks. This raises a fundamental challenge: how should we design and control robot manipulators that are optimized for dexterity? We present a co-design framework that learns task-specific hand morphology and complementary dexterous control policies. The framework supports 1) an expansive morphology search space including joint, finger, and palm generation, 2) scalable evaluation across the wide design space via morphology-conditioned cross-embodied control, and 3) real-world fabrication with accessible components. We evaluate the approach across multiple dexterous tasks, including in-hand rotation with simulation and real deployment. Our framework enables an end-to-end pipeline that can design, train, fabricate, and deploy a new robotic hand in under 24 hours. The full framework and generated robot hands are open-sourced and available on our website.
Feb 28, 2026

UniHM: Unified Dexterous Hand Manipulation with Vision Language Model

Planning physically feasible dexterous hand manipulation is a central challenge in robotic manipulation and Embodied AI. Prior work typically relies on object-centric cues or precise hand-object interaction sequences, foregoing the rich, compositional guidance of open-vocabulary instruction. We introduce UniHM, the first framework for unified dexterous hand manipulation guided by free-form language commands. We propose a Unified Hand-Dexterous Tokenizer that maps heterogeneous dexterous-hand morphologies into a single shared codebook, improving cross-dexterous hand generalization and scalability to new morphologies. Our vision language action model is trained solely on human-object interaction data, eliminating the need for massive real-world teleoperation datasets, and demonstrates strong generalizability in producing human-like manipulation sequences from open-ended language instructions. To ensure physical realism, we introduce a physics-guided dynamic refinement module that performs segment-wise joint optimization under generative and temporal priors, yielding smooth and physically feasible manipulation sequences. Across multiple datasets and real-world evaluations, UniHM attains state-of-the-art results on both seen and unseen objects and trajectories, demonstrating strong generalization and high physical feasibility. Our project page at https://unihm.github.io/.