Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulation
Not on the map. Why?
Abstract (arXiv)
Enabling robots to perform precise and generalized manipulation in unstructured environments remains a fundamental challenge in embodied AI. While Vision-Language Models (VLMs) have demonstrated remarkable capabilities in semantic reasoning and task planning, a significant gap persists between their high-level understanding and the precise physical execution required for real-world manipulation. To bridge this "semantic-to-physical" gap, we introduce GRACE, a novel framework that grounds VLM-based reasoning through executable analytic concepts (EAC)-mathematically defined blueprints that encode object affordances, geometric constraints, and semantics of manipulation. Our approach integrates a structured policy scaffolding pipeline that turn natural language instructions and visual information into an instantiated EAC, from which we derive grasp poses, force directions and plan physically feasible motion trajectory for robot execution. GRACE thus provides a unified and interpretable interface between high-level instruction understanding and low-level robot control, effectively enabling precise and generalizable manipulation through semantic-physical grounding. Extensive experiments demonstrate that GRACE achieves strong zero-shot generalization across a variety of articulated objects in both simulated and real-world environments, without requiring task-specific training.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 43 of its 46 references that are in the map. First posted on arXiv 9 Oct 2025.
Builds on
43 of 46 references.
References · 43
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Segment Anythingcited by 8,158
- 2024GPT-4o System Cardcited by 4,467
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2023Vision-Language Models for Vision Tasks: A Surveycited by 834
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
31 more
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2023FoundationPose: Unified 6D Pose Estimation and Tracking of Novel Objectscited by 411
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2024Large Language Models for Mathematical Reasoning: Progresses and Challengescited by 283
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
- 2025Hi Robot: Open-Ended Instruction Following with Hierarchical Vision-Language-Action Modelscited by 216
- 2023Where are we in the search for an Artificial Visual Cortex for Embodied Intelligence?cited by 215
- 2021Neural Descriptor Fields: SE(3)-Equivariant Object Representations for Manipulationcited by 204
- 2021Where2Act: From Pixels to Actions for Articulated 3D Objectscited by 179
- 2023ManipLLM: Embodied Multimodal Large Language Model for Object-Centric Robotic Manipulationcited by 157
- 2019kPAM: KeyPoint Affordances for Category-Level Robotic Manipulationcited by 152
- 2025GraspVLA: a Grasping Foundation Model Pre-trained on Billion-scale Synthetic Action Datacited by 120
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2024CoPa: General Robotic Manipulation through Spatial Constraints of Parts with Foundation Modelscited by 97
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robotscited by 88
- 2024Manipulate-Anything: Automating Real-World Robots using Vision-Language Modelscited by 82
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
- 2025OmniManip: Towards General Robotic Manipulation via Object-Centric Interaction Primitives as Spatial Constraintscited by 58
- 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 53
- 2025RoboGround: Robotic Manipulation with Grounded Vision-Language Priorscited by 50
- 2021SORNet: Spatial Object-Centric Representations for Sequential Manipulationcited by 48
- 2025SoFar: Language-Grounded Orientation Bridges Spatial Reasoning and Object Manipulationcited by 46
- 2024Physically Embodied Gaussian Splatting: A Realtime Correctable World Model for Roboticscited by 39
- 2019Object-Centric Task and Motion Planning in Dynamic Environmentscited by 34
- 2023Where2Explore: Few-shot Affordance Learning for Unseen Novel Categories of Articulated Objectscited by 33
- 2023What's Left? Concept Grounding with Logic-Enhanced Foundation Modelscited by 33
- 2024DoughNet: A Visual Predictive Model for Topological Manipulation of Deformable Objectscited by 9
- 2024ConceptFactory: Facilitate 3D Object Knowledge Annotation with Object Conceptualizationcited by 6
- 2025Physically Ground Commonsense Knowledge for Articulated Object Manipulation with Analytic Conceptscited by 5
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Explicit Kinematic Guidance from Analytic Concepts for Vision-Language-Action Modelscited by 0
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptationcited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environmentscited by 0
- 2026RoboRSI: Stable, efficient, and reusable robot self-evolution in complex real-world environments8 Oct 2026
- 2026DualManip: Agentic Dynamic Manipulation via Dual-Path Semantic Reasoning and Geometric Adaptation25 Sep 2026
- 2026Explicit Kinematic Guidance from Analytic Concepts for Vision-Language-Action Models29 Jul 2026
Similar, not cited
Close in wording, no citation either way
- 2025Perceiving, Reasoning, Adapting: A Dual-Layer Framework for VLM-Guided Precision Robotic Manipulation
- 2025Unified Embodied VLM Reasoning with Robotic Action via Autoregressive Discretized Pre-training
- 2026PLanAR: Planning-Language-Grounded Agentic Reasoning for Robot Manipulation
- 2025Unfettered Forceful Skill Acquisition with Physical Reasoning and Coordinate Frame Labeling
- 2023Programmatically Grounded, Compositionally Generalizable Robotic Manipulation
- 2025Reinforced Embodied Planning with Verifiable Reward for Real-World Robotic Manipulation
- 2026HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System
- 2025From Seeing to Doing: Bridging Reasoning and Decision for Robotic Manipulation