DextER: Language-driven Dexterous Grasp Generation with Embodied Reasoning
On the map: LLM reasoning → Spatial and embodied reasoning
Abstract (arXiv)
Language-driven dexterous grasp generation requires the models to understand task semantics, 3D geometry, and complex hand-object interactions. While vision-language models have been applied to this problem, existing approaches directly map observations to grasp parameters without intermediate reasoning about physical interactions. We present DextER, Dexterous Grasp Generation with Embodied Reasoning, which introduces contact-based embodied reasoning for multi-finger manipulation. Our key insight is that predicting which hand links contact where on the object surface provides an embodiment-aware intermediate representation, bridging task semantics with physical constraints. DextER autoregressively generates embodied contact tokens specifying which finger links contact where on the object surface, followed by grasp tokens encoding the hand configuration. On DexGYS, DextER achieves 67.14% success rate, outperforming state-of-the-art by 3.83 p.p. with 96.4% improvement in intention alignment. We also demonstrate steerable generation through partial contact specification, providing fine-grained control over grasp synthesis.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Spatial and embodied reasoning, one of 17 directions in LLM reasoning. Builds on 46 of its 54 references that are in the map. First posted on arXiv 22 Jan 2026.
Builds on
46 of 54 references.
Closest ancestors · 6
Same direction, newest first
- 2025MolmoAct: Action Reasoning Models that can Reason in Space11 Aug
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planning22 Jul
- 2025Training Strategies for Efficient Embodied Reasoning13 May
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2024Emma-X: An Embodied Multimodal Action Model with Grounded Chain of Thought and Look-ahead Spatial Reasoning16 Dec
- 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
Other references · 40
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,302
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024Qwen2 Technical Reportcited by 2,076
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025Gemma 3 Technical Reportcited by 1,686
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2022Point-E: A System for Generating 3D Point Clouds from Complex Promptscited by 694
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025SmolLM2: When Smol Goes Big -- Data-Centric Training of a Small Language Modelcited by 307
- 2023Diffusion-based Generation, Optimization, and Planning in 3D Scenescited by 237
28 more
- 2023Uni3D: Exploring Unified 3D Representation at Scalecited by 231
- 2023OpenShape: Scaling Up 3D Shape Representation Towards Open-World Understandingcited by 183
- 2021Hand-Object Contact Consistency Reasoning for Human Grasps Generationcited by 160
- 2022DexGraspNet: A Large-Scale Robotic Dexterous Grasp Dataset for General Objects Based on Simulationcited by 129
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2023UniDexGrasp: Universal Robotic Dexterous Grasping via Learning Diverse Proposal Generation and Goal-Conditioned Policycited by 117
- 2023UniDexGrasp++: Improving Dexterous Grasping Policy Learning via Geometry-aware Curriculum and Iterative Generalist-Specialist Learningcited by 101
- 2025PARTFIELD: Learning 3D Feature Fields for Part Segmentation and Beyondcited by 91
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
- 2021Synthesizing Diverse and Physically Stable Grasps with Arbitrary Hand Structures using Differentiable Force Closure Estimatorcited by 70
- 2024GraspXL: Generating Grasping Motions for Diverse Objects at Scalecited by 59
- 2022Grasp'D: Differentiable Contact-rich Grasp Synthesis for Multi-fingered Handscited by 49
- 2024DexDiffuser: Generating Dexterous Grasps with Diffusion Modelscited by 46
- 2024DexGraspNet 2.0: Learning Generative Dexterous Grasping in Large-scale Synthetic Cluttered Scenescited by 41
- 2024Grasp as You Say: Language-guided Dexterous Grasp Generationcited by 39
- 2023Dexterous Functional Graspingcited by 36
- 2023Fast-Grasp'D: Dexterous Multi-finger Grasp Generation Through Differentiable Simulationcited by 35
- 2023UGG: Unified Generative Graspingcited by 30
- 2024SemGrasp: Semantic Grasp Generation via Language Aligned Discretizationcited by 29
- 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 25
- 2025DexGrasp Anything: Towards Universal Robotic Dexterous Grasping with Physics Awarenesscited by 25
- 2025Action-Free Reasoning for Policy Generalizationcited by 24
- 2025Dexonomy: Synthesizing All Dexterous Grasp Types in a Grasp Taxonomycited by 19
- 2025DexVLG: Dexterous Vision-Language-Grasp Model at Scalecited by 19
- 2024Dexterous Grasp Transformercited by 18
- 2024BODex: Scalable and Efficient Robotic Dexterous Grasp Synthesis Using Bilevel Optimizationcited by 18
- 2024Multi-GraspLLM: A Multimodal LLM for Multi-Hand Semantic Guided Grasp Generationcited by 12
- 2024Cross-Category Functional Grasp Transfercited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SECOND-Grasp: Semantic Contact-guided Dexterous Graspingcited by 0
- 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulationcited by 0
- 2026Potential-Guided Particle Steering for Negation-Constrained Dexterous Graspingcited by 0
- 2026IM-ENGINE: Image Editing for Embodied Data Generationcited by 0
- 2026IM-ENGINE: Image Editing for Embodied Data Generation5 Sep 2026
- 2026Potential-Guided Particle Steering for Negation-Constrained Dexterous Grasping1 Sep 2026
- 2026WristMimic: Full-Body Humanoid Control with Wrist-Guided Manipulation7 Jul 2026
- 2026SECOND-Grasp: Semantic Contact-guided Dexterous Grasping13 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025OmniDexVLG: Learning Dexterous Grasp Generation from Vision Language Model-Guided Grasp Semantics, Taxonomy and Functional Affordance
- 2025PartDexTOG: Generating Dexterous Task-Oriented Grasping via Language-driven Part Analysis
- 2026GraspGraphNet: Graph-Structured Multi-Embodiment Dexterous Grasp Generation ↗
- 2026TouchWorld: A Predictive and Reactive Tactile Foundation Model for Dexterous Manipulation
- 2025Training-free Task-oriented Grasp Generation
- 2026Function beyond Form: Functional Correspondence for Cross-Embodiment Dexterous Grasp Generation ↗
- 2026Steerable and Reactive Grasping Through Modular Design with a Three-Point Interface ↗
- 2026UniHM: Unified Dexterous Hand Manipulation with Vision Language Model