Training-free Task-oriented Grasp Generation
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
This paper presents a training-free pipeline for task-oriented grasp generation that combines pre-trained grasp generation models with vision-language models (VLMs). Unlike traditional approaches that focus solely on stable grasps, our method incorporates task-specific requirements by leveraging the semantic reasoning capabilities of VLMs. We evaluate five querying strategies, each utilizing different visual representations of candidate grasps, and demonstrate significant improvements over a baseline method in both grasp success and task compliance rates, with absolute gains of up to 36.9% in overall success rate. Our results underline the potential of VLMs to enhance task-oriented manipulation, providing insights for future research in robotic grasping and human-robot interaction.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 7 Feb 2025.
Builds on
No reference list yet.
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025OmniDexVLG: Learning Dexterous Grasp Generation from Vision Language Model-Guided Grasp Semantics, Taxonomy and Functional Affordance
- 2025VCoT-Grasp: Grasp Foundation Models with Visual Chain-of-Thought Reasoning for Language-driven Grasp Generation
- 2024SemGrasp: Semantic Grasp Generation via Language Aligned Discretization
- 2024Reasoning Grasping via Multimodal Large Language Model
- 2025GraspCorrect: Robotic Grasp Correction via Vision-Language Model-Guided Feedback
- 2025PartDexTOG: Generating Dexterous Task-Oriented Grasping via Language-driven Part Analysis
- 2024Multi-GraspLLM: A Multimodal LLM for Multi-Hand Semantic Guided Grasp Generation
- 2025Free-form language-based robotic reasoning and grasping