mlsanityData to 14 Oct 2026

Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey

arXiv 2508.13073 ↗First posted 18 Aug 2025cs.RO cs.CVcited by 69

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Robotic manipulation, a key frontier in robotics and embodied AI, requires precise motor control and multimodal understanding, yet traditional rule-based methods fail to scale or generalize in unstructured, novel environments. In recent years, Vision-Language-Action (VLA) models, built upon Large Vision-Language Models (VLMs) pretrained on vast image-text datasets, have emerged as a transformative paradigm. This survey provides the first systematic, taxonomy-oriented review of large VLM-based VLA models for robotic manipulation. We begin by clearly defining large VLM-based VLA models and delineating two principal architectural paradigms: (1) monolithic models, encompassing single-system and dual-system designs with differing levels of integration; and (2) hierarchical models, which explicitly decouple planning from execution via interpretable intermediate representations. Building on this foundation, we present an in-depth examination of large VLM-based VLA models: (1) integration with advanced domains, including reinforcement learning, training-free optimization, learning from human videos, and world model integration; (2) synthesis of distinctive characteristics, consolidating architectural traits, operational strengths, and the datasets and benchmarks that support their development; (3) identification of promising directions, including memory mechanisms, 4D perception, efficient adaptation, multi-agent cooperation, and other emerging capabilities. This survey consolidates recent advances to resolve inconsistencies in existing taxonomies, mitigate research fragmentation, and fill a critical gap through the systematic integration of studies at the intersection of large VLMs and robotic manipulation. We provide a regularly updated project page to document ongoing progress: https://github.com/JiuTian-VL/Large-VLM-based-VLA-for-Robotic-Manipulation

Key facts. Cited by 69 papers in the map (data through 14 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 240 of its 274 references that are in the map. First posted on arXiv 18 Aug 2025.

Builds on

240 of 274 references.

Closest ancestors · 28

Same direction, newest first

  1. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
  2. 2025GR-3 Technical Report21 Jul
  3. 2025VOTE: Vision-Language-Action Optimization with Trajectory Ensemble Voting7 Jul
  4. 2025Unified Vision-Language-Action Model24 Jun
  5. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  6. 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks31 May
  7. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
  8. 2025Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructions16 May
  9. 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation6 May
  10. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  12. 2025MoManipVLA: Transferring Vision-language-action Models for General Mobile Manipulation17 Mar
16 more
  1. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  2. 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulation19 Feb
  3. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
  4. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation8 Feb
  5. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
  6. 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding8 Jan
  7. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  9. 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLM21 Oct
  10. 2024Towards Synergistic, Generalized, and Efficient Dual-System for Robotic Manipulation10 Oct
  11. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
  12. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers12 Sep
  13. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  14. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
  15. 2024A Survey on Vision-Language-Action Models for Embodied AI23 May
  16. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 212

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2022Training language models to follow instructions with human feedbackcited by 15,971
  6. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  7. 2023Segment Anythingcited by 8,234
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2023Visual Instruction Tuningcited by 7,869
  10. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  11. 2022Scalable Diffusion Models with Transformerscited by 6,054
  12. 2025Qwen2.5-VL Technical Reportcited by 5,587
38 more
  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2017Neural Discrete Representation Learningcited by 4,712
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  6. 2017PointNet++: Deep Hierarchical Feature Learning on Point Sets in a Metric Spacecited by 4,401
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  8. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  9. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  10. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  12. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  13. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,348
  14. 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
  15. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  16. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  17. 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
  18. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  19. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,556
  20. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  21. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  22. 2021Offline Reinforcement Learning with Implicit Q-Learningcited by 1,293
  23. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  24. 2019Meta-World: A Benchmark and Evaluation for Multi-Task and Meta Reinforcement Learningcited by 1,204
  25. 2019Habitat: A Platform for Embodied AI Researchcited by 1,191
  26. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  27. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,081
  28. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  29. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  30. 2023Vision-Language Models for Vision Tasks: A Surveycited by 839
  31. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 809
  32. 2018Scaling Egocentric Vision: The EPIC-KITCHENS Datasetcited by 795
  33. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 783
  34. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 750
  35. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 725
  36. 2023CogAgent: A Visual Language Model for GUI Agentscited by 704
  37. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 689
  38. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665

50 most cited of 212 All 212 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 19; 2026: 50.

69 papers.

Sort:

By area:

  1. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsificationcited by 74
  2. 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
  3. 2025Vision-Language-Action Models for Autonomous Driving: Past, Present, and Futurecited by 33
  4. 2025From Spatial to Actions: Grounding Vision-Language-Action Model in Spatial Foundation Priorscited by 28
  5. 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 24
  6. 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 21
  7. 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
  8. 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Modelscited by 12
  9. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
  10. 2025Compose Your Policies! Improving Diffusion-based or Flow-based Robot Policies via Test-time Distribution-level Compositioncited by 9
  11. 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
  12. 2026HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation Systemcited by 8
38 more
  1. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Enginescited by 8
  2. 2026H-WM: Robotic Task and Motion Planning Guided by Hierarchical World Modelcited by 7
  3. 2026Mean-Flow based One-Step Vision-Language-Actioncited by 7
  4. 2026Point Tracking Improves World Action Modelscited by 7
  5. 2025NEBULA: Do We Evaluate Vision-Language-Action Agents Correctly?cited by 6
  6. 2025RESample: A Robust Data Augmentation Framework via Exploratory Sampling for Robotic Manipulationcited by 6
  7. 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventionscited by 6
  8. 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6
  9. 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
  10. 2026TIDAL: Temporally Interleaved Diffusion and Action Loop for High-Frequency VLA Controlcited by 5
  11. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
  12. 2026Action Draft and Verify: A Self-Verifying Framework for Vision-Language-Action Modelcited by 4
  13. 2026CF-VLA: Efficient Coarse-to-Fine Action Generation for Vision-Language-Action Policiescited by 4
  14. 2025AnywhereVLA: Language-Conditioned Exploration and Mobile Manipulationcited by 3
  15. 2025Executable Analytic Concepts as the Missing Link Between VLM Insight and Precise Manipulationcited by 3
  16. 2025Dejavu: Towards Experience Feedback Learning for Embodied Intelligencecited by 3
  17. 2025Agentic Physical AI toward a Domain-Specific Foundation Model for Energy Systems: A Case Study on Nuclear Reactor Controlcited by 3
  18. 2026SA-VLA: Spatially-Aware Flow-Matching for Vision-Language-Action Reinforcement Learningcited by 3
  19. 2026RoboHarness: A Memory-Augmented Policy Harness for Vision-Language-Action Model Robustness via In-Context Adaptationcited by 3
  20. 2025R4: Retrieval-Augmented Reasoning for Vision-Language Models in 4D Spatio-Temporal Spacecited by 2
  21. 2026Listen, Look, Drive: Coupling Audio Instructions for User-aware VLA-based Autonomous Drivingcited by 2
  22. 2026TorchUMM: A Unified Multimodal Model Codebase for Evaluation, Analysis, and Post-trainingcited by 2
  23. 2026Dynamic Execution Commitment of Vision-Language-Action Modelscited by 2
  24. 2026PolicyTrim: Boosting Intrinsic Policy Efficiency of Vision-Language-Action Modelscited by 2
  25. 2025Sigma: The Key for Vision-Language-Action Models toward Telepathic Alignmentcited by 1
  26. 2026CoEnv: Driving Embodied Multi-Agent Collaboration via Compositional Environmentcited by 1
  27. 2026Evolvable Embodied Agent for Robotic Manipulation via Long Short-Term Reflection and Optimizationcited by 1
  28. 2026RoboEvolve: Co-Evolving Planner-Simulator for Robotic Manipulation with Limited Datacited by 1
  29. 2026ManiSoft: Towards Vision-Language Manipulation for Soft Continuum Roboticscited by 1
  30. 2026GraspFoM: Towards Reconstruction-Driven Robotic Grasping with 3D Foundation Priorscited by 1
  31. 2026ESC: Emotional Self-Correction for Reliable Vision-Language Modelscited by 1
  32. 2026FibVLA: An Efficient Temporal Vision-Language-Action Model with Fibonacci Samplingcited by 1
  33. 2026Weights or Skills? A Survey of Robot-Learning Techniques: from Action-Predicting Weights to Robots that Write their Own Skillscited by 1
  34. 2026Robust Bimanual Vision-Language-Action Models via Embarrassingly Simple Modality Maskingcited by 1
  35. 2026Not All Attention Heads Contribute to Critical Visual Token Selection: Head-Aware Pruning Matters Morecited by 1
  36. 2026RoboSPA: Can VLA Models Go Beyond Simple Scenes and Short-Horizon Tasks?cited by 1
  37. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
  38. 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1

50 most cited of 69 All 69 (JSON)

Similar, not cited

Close in wording, no citation either way

  1. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  2. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  3. 2025Survey of Vision-Language-Action Models for Embodied Manipulation
  4. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation
  5. 2024What Matters in Building Vision-Language-Action Models for Generalist Robots
  6. 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulation
  7. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey
  8. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications