Foundation Model Driven Robotics: A Comprehensive Review
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The rapid emergence of foundation models, particularly Large Language Models (LLMs) and Vision-Language Models (VLMs), has introduced a transformative paradigm in robotics. These models offer powerful capabilities in semantic understanding, high-level reasoning, and cross-modal generalization, enabling significant advances in perception, planning, control, and human-robot interaction. This critical review provides a structured synthesis of recent developments, categorizing applications across simulation-driven design, open-world execution, sim-to-real transfer, and adaptable robotics. Unlike existing surveys that emphasize isolated capabilities, this work highlights integrated, system-level strategies and evaluates their practical feasibility in real-world environments. Key enabling trends such as procedural scene generation, policy generalization, and multimodal reasoning are discussed alongside core bottlenecks, including limited embodiment, lack of multimodal data, safety risks, and computational constraints. Through this lens, this paper identifies both the architectural strengths and critical limitations of foundation model-based robotics, highlighting open challenges in real-time operation, grounding, resilience, and trust. The review concludes with a roadmap for future research aimed at bridging semantic reasoning and physical intelligence through more robust, interpretable, and embodied models.
Key facts. Cited by 9 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. First posted on arXiv 14 Jul 2025.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2025: 3; 2026: 6.
9 papers.
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AIcited by 3
- 2025FALCON: Actively Decoupled Visuomotor Policies for Loco-Manipulation with Foundation-Model-Based Coordinationcited by 3
- 2026World Models as Group Actionscited by 3
- 2026M3-ACE: Rectifying Visual Perception in Multimodal Math Reasoning via Multi-Agentic Context Engineeringcited by 1
- 2026CoRAL: Contact-Rich Adaptive LLM-based Control for Robotic Manipulationcited by 1
- 2025Emergence: Overcoming Privileged Information Bias in Asymmetric Embodied Agents via Active Queryingcited by 0
- 2026IntentVLM: Open-Vocabulary Intention Recognition through Forward-Inverse Modeling with Video-Language Modelscited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directionscited by 0
- 2026A Review Of Robotic World Models For Dynamic Environments Based On Factor And Scene Graphscited by 0
- 2026Security and Privacy in Large-Model-Driven Embodied Agents: Attacks, Defenses, and Future Directions19 Aug 2026
- 2026A Review Of Robotic World Models For Dynamic Environments Based On Factor And Scene Graphs27 Jul 2026
- 2026World Models as Group Actions23 May 2026
- 2026CoRAL: Contact-Rich Adaptive LLM-based Control for Robotic Manipulation4 May 2026
- 2026IntentVLM: Open-Vocabulary Intention Recognition through Forward-Inverse Modeling with Video-Language Models27 Apr 2026
- 2026M3-ACE: Rectifying Visual Perception in Multimodal Math Reasoning via Multi-Agentic Context Engineering9 Mar 2026
- 2025Emergence: Overcoming Privileged Information Bias in Asymmetric Embodied Agents via Active Querying13 Dec 2025
- 2025FALCON: Actively Decoupled Visuomotor Policies for Loco-Manipulation with Foundation-Model-Based Coordination4 Dec 2025
- 2025Aligning Perception, Reasoning, Modeling and Interaction: A Survey on Physical AI6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2024Real-World Robot Applications of Foundation Models: A Review
- 2026Foundation Models in Robotics: A Comprehensive Review of Methods, Models, Datasets, Challenges and Future Research Directions
- 2025From Grounding to Manipulation: Case Studies of Foundation Model Integration in Embodied Robotic Systems
- 2023Foundation Models in Robotics: Applications, Challenges, and the Future
- 2025Embodied AI with Foundation Models for Mobile Service Robots: A Systematic Review
- 2025Using Language Models as Closed-Loop High-Level Planners for Robotics Applications: A Brief Overview and Benchmarks
- 2026The Embodiment Gap in Robot Foundation Models
- 2025Towards Embodied Agentic AI: Review and Classification of LLM- and VLM-Driven Robot Autonomy and Interaction