mlsanityData to 7 Oct 2026

An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges

arXiv 2512.11362 ↗First posted 12 Dec 2025cs.ROcited by 4

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-Language-Action (VLA) models are driving a revolution in robotics, enabling machines to understand instructions and interact with the physical world. This field is exploding with new models and datasets, making it both exciting and challenging to keep pace with. This survey offers a clear and structured guide to the VLA landscape. We design it to follow the natural learning path of a researcher: we start with the basic Modules of any VLA model, trace the history through key Milestones, and then dive deep into the core Challenges that define recent research frontier. Our main contribution is a detailed breakdown of the five biggest challenges in: (1) Representation, (2) Execution, (3) Generalization, (4) Safety, and (5) Dataset and Evaluation. This structure mirrors the developmental roadmap of a generalist agent: establishing the fundamental perception-action loop, scaling capabilities across diverse embodiments and environments, and finally ensuring trustworthy deployment-all supported by the essential data infrastructure. For each of them, we review existing approaches and highlight future opportunities. We position this paper as both a foundational guide for newcomers and a strategic roadmap for experienced researchers, with the dual aim of accelerating learning and inspiring new ideas in embodied intelligence. A live version of this survey, with continuous updates, is maintained on our hrefhttps://suyuz1.github.io/VLA-Survey-Anatomy/project page.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 266 of its 281 references that are in the map. First posted on arXiv 12 Dec 2025.

Builds on

266 of 281 references.

Closest ancestors · 41

Same direction, newest first

  1. 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignment6 Nov
  2. 2025GraSP-VLA: Graph-based Symbolic Action Representation for Long-Horizon Planning with VLA Policies6 Nov
  3. 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations4 Nov
  4. 2025Dexbotic: Open-Source Vision-Language-Action Toolbox27 Oct
  5. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct
  6. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct
  7. 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep
  8. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
  9. 2025Mechanistic interpretability for steering vision-language-action models30 Aug
  10. 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation27 Aug
  11. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug
  12. 2025Human Centric General Physical Intelligence for Agile Manufacturing Automation16 Aug
29 more
  1. 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Model14 Aug
  2. 2025FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulation4 Aug
  3. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review14 Jul
  4. 2025Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends26 Jun
  5. 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models11 Jun
  6. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  7. 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks31 May
  8. 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
  9. 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Model27 May
  10. 2025Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructions16 May
  11. 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation6 May
  12. 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructions4 May
  13. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
  14. 2025CombatVLA: An Efficient Vision-Language-Action Model for Combat Tasks in 3D Action Role-Playing Games12 Mar
  15. 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extraction5 Mar
  16. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  17. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
  18. 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation8 Feb
  19. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
  20. 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding8 Jan
  21. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
  22. 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks4 Nov
  23. 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLM21 Oct
  24. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
  25. 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers12 Sep
  26. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  27. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
  28. 2024A Survey on Vision-Language-Action Models for Embodied AI23 May
  29. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 225

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  5. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  6. 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
  7. 2017Proximal Policy Optimization Algorithmscited by 14,441
  8. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  9. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  10. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
  11. 2022Flow Matching for Generative Modelingcited by 5,426
  12. 2017Neural Discrete Representation Learningcited by 4,650
38 more
  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  4. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  7. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
  8. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  10. 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
  11. 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
  12. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  13. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  14. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  15. 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
  16. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  17. 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
  18. 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
  19. 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
  20. 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
  21. 2022A Generalist Agentcited by 802
  22. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  23. 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
  24. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  25. 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
  26. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
  27. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  28. 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
  29. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  30. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
  31. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  32. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  33. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
  34. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  35. 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
  36. 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
  37. 2023LERF: Language Embedded Radiance Fieldscited by 538
  38. 2015An Introduction to Convolutional Neural Networkscited by 510

50 most cited of 225 All 225 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  2. 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
  3. 2025A Survey on Efficient Vision-Language-Action Models
  4. 2024What Matters in Building Vision-Language-Action Models for Generalist Robots
  5. 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baseline
  6. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
  7. 202510 Open Challenges Steering the Future of Vision-Language-Action Models
  8. 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systems