BLaDA: Bridging Language to Functional Dexterous Actions within 3DGS Fields
Not on the map. Why?
Abstract (arXiv)
In unstructured environments, functional dexterous grasping calls for the tight integration of semantic understanding, precise 3D functional localization, and physically interpretable execution. Modular hierarchical methods are more controllable and interpretable than end-to-end VLA approaches, but existing ones still rely on predefined affordance labels and lack the tight semantic--pose coupling needed for functional dexterous manipulation. To address this, we propose BLaDA (Bridging Language to Dexterous Actions in 3DGS fields), an interpretable zero-shot framework that grounds open-vocabulary instructions as perceptual and control constraints for functional dexterous manipulation. BLaDA establishes an interpretable reasoning chain by first parsing natural language into a structured sextuple of manipulation constraints via a Knowledge-guided Language Parsing (KLP) module. To achieve pose-consistent spatial reasoning, we introduce the Triangular Functional Point Localization (TriLocation) module, which utilizes 3D Gaussian Splatting as a continuous scene representation and identifies functional regions under triangular geometric constraints. Finally, the 3D Keypoint Grasp Matrix Transformation Execution (KGT3D+) module decodes these semantic-geometric constraints into physically plausible wrist poses and finger-level commands. Extensive experiments on complex benchmarks demonstrate that BLaDA significantly outperforms existing methods in both affordance grounding precision and the success rate of functional manipulation across diverse categories and tasks. Code will be publicly available at https://github.com/PopeyePxx/BLaDA.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 9 Apr 2026.
Builds on
32 of 52 references.
References · 32
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 20233D Gaussian Splatting for Real-Time Radiance Field Renderingcited by 6,141
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2019ContactDB: Analyzing and Predicting Grasp Contact via Thermal Imagingcited by 145
20 more
- 2023Distilled Feature Fields Enable Few-Shot Language-Guided Manipulationcited by 130
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2022Towards Human-Level Bimanual Dexterous Manipulation with Reinforcement Learningcited by 113
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2019ContactGrasp: Functional Multi-finger Grasp Synthesis from Contactcited by 87
- 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
- 20226-DoF Pose Estimation of Household Objects for Robotic Manipulation: An Accessible Dataset and Benchmarkcited by 85
- 2022Learning Affordance Grounding from Exocentric Imagescited by 82
- 2024GaussianGrasper: 3D Language Gaussian Splatting for Open-vocabulary Robotic Graspingcited by 77
- 2023LOCATE: Localize and Transfer Object Parts for Weakly Supervised Affordance Groundingcited by 64
- 2024GraspSplats: Efficient Manipulation with 3D Feature Splattingcited by 41
- 2024Learning Precise Affordances from Egocentric Videos for Robotic Manipulationcited by 34
- 2021DDGC: Generative Deep Dexterous Grasping in Cluttercited by 28
- 2025AffordDexGrasp: Open-set Language-guided Dexterous Grasp with Generalizable-Instructive Affordancecited by 25
- 2025Grounding 3D Object Affordance with Language Instructions, Visual Observations and Interactionscited by 19
- 2025DexVLG: Dexterous Vision-Language-Grasp Model at Scalecited by 19
- 2024Learning Granularity-Aware Affordances from Human-Object Interaction for Tool-Based Functional Dexterous Graspingcited by 5
- 2025Multi-Keypoint Affordance Representation for Functional Dexterous Graspingcited by 4
- 2021Contact Transfer: A Direct, User-Driven Method for Human to Robot Transfer of Grasps and Manipulationscited by 3
- 2025Grasp Like Humans: Learning Generalizable Multi-Fingered Grasping from Human Proprioceptive Sensorimotor Integrationcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ZeroDex: Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D-Grounded VLM Reasoning
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraints
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation
- 2025Free-form language-based robotic reasoning and grasping
- 2026Bridging Semantics and Kinematics: A Modular Framework for Zero-Shot Robotic Manipulation ↗
- 2024Towards Open-World Grasping with Large Vision-Language Models
- 2025OmniDexVLG: Learning Dexterous Grasp Generation from Vision Language Model-Guided Grasp Semantics, Taxonomy and Functional Affordance
- 2025ZeroDexGrasp: Zero-Shot Task-Oriented Dexterous Grasp Synthesis with Prompt-Based Multi-Stage Semantic Reasoning