An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
On the map: Vision-language-action models → Generalist VLA models and benchmarks
Abstract (arXiv)
Vision-Language-Action (VLA) models are driving a revolution in robotics, enabling machines to understand instructions and interact with the physical world. This field is exploding with new models and datasets, making it both exciting and challenging to keep pace with. This survey offers a clear and structured guide to the VLA landscape. We design it to follow the natural learning path of a researcher: we start with the basic Modules of any VLA model, trace the history through key Milestones, and then dive deep into the core Challenges that define recent research frontier. Our main contribution is a detailed breakdown of the five biggest challenges in: (1) Representation, (2) Execution, (3) Generalization, (4) Safety, and (5) Dataset and Evaluation. This structure mirrors the developmental roadmap of a generalist agent: establishing the fundamental perception-action loop, scaling capabilities across diverse embodiments and environments, and finally ensuring trustworthy deployment-all supported by the essential data infrastructure. For each of them, we review existing approaches and highlight future opportunities. We position this paper as both a foundational guide for newcomers and a strategic roadmap for experienced researchers, with the dual aim of accelerating learning and inspiring new ideas in embodied intelligence. A live version of this survey, with continuous updates, is maintained on our hrefhttps://suyuz1.github.io/VLA-Survey-Anatomy/project page.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 266 of its 281 references that are in the map. First posted on arXiv 12 Dec 2025.
Builds on
266 of 281 references.
Closest ancestors · 41
Same direction, newest first
- 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignment6 Nov
- 2025GraSP-VLA: Graph-based Symbolic Action Representation for Long-Horizon Planning with VLA Policies6 Nov
- 2025XR-1: Towards Versatile Vision-Language-Action Models via Learning Unified Vision-Motion Representations4 Nov
- 2025Dexbotic: Open-Source Vision-Language-Action Toolbox27 Oct
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct
- 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications8 Oct
- 2025Pure Vision Language Action (VLA) Models: A Comprehensive Survey23 Sep
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025Mechanistic interpretability for steering vision-language-action models30 Aug
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulation27 Aug
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Survey18 Aug
- 2025Human Centric General Physical Intelligence for Agile Manufacturing Automation16 Aug
29 more
- 2025CorrectNav: Self-Correction Flywheel Empowers Vision-Language-Action Navigation Model14 Aug
- 2025FedVLA: Federated Vision-Language-Action Learning with Dual Gating Mixture-of-Experts for Robotic Manipulation4 Aug
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review14 Jul
- 2025Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trends26 Jun
- 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models11 Jun
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025LoHoVLA: A Unified Vision-Language-Action Model for Long-Horizon Embodied Tasks31 May
- 2025Knowledge Insulating Vision-Language-Action Models: Train Fast, Run Fast, Generalize Better29 May
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Model27 May
- 2025Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructions16 May
- 2025OpenHelix: A Short Survey, Empirical Analysis, and Open-Source Dual-System VLA Model for Robotic Manipulation6 May
- 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructions4 May
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
- 2025CombatVLA: An Efficient Vision-Language-Action Model for Combat Tasks in 3D Action Role-Playing Games12 Mar
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extraction5 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Control9 Feb
- 2025HAMSTER: Hierarchical Action Models For Open-World Robot Manipulation8 Feb
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
- 2025Beyond Sight: Finetuning Generalist Robot Policies with Heterogeneous Sensors via Language Grounding8 Jan
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
- 2024Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks4 Nov
- 2024A Dual Process VLA: Efficient Robotic Manipulation Leveraging VLM21 Oct
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulation19 Sep
- 2024HiRT: Enhancing Robotic Control with Hierarchical Robot Transformers12 Sep
- 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulation6 Jun
- 2024A Survey on Vision-Language-Action Models for Embodied AI23 May
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 225
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2019Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformercited by 14,491
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,415
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
38 more
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,286
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024Gemma 2: Improving Open Language Models at a Practical Sizecited by 1,928
- 2021Ego4D: Around the World in 3,000 Hours of Egocentric Videocited by 1,530
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2018Learning Latent Dynamics for Planning from Pixelscited by 1,221
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,143
- 2022Inner Monologue: Embodied Reasoning through Planning with Language Modelscited by 1,057
- 2017Vision-and-Language Navigation: Interpreting visually-grounded navigation instructions in real environmentscited by 1,013
- 2024Gemma: Open Models Based on Gemini Research and Technologycited by 889
- 2022A Generalist Agentcited by 802
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2019ALFRED: A Benchmark for Interpreting Grounded Instructions for Everyday Taskscited by 773
- 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 699
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2022R3M: A Universal Visual Representation for Robot Manipulationcited by 678
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 617
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
- 2023Eureka: Human-Level Reward Design via Coding Large Language Modelscited by 542
- 2023LERF: Language Embedded Radiance Fieldscited by 538
- 2015An Introduction to Convolutional Neural Networkscited by 510
50 most cited of 225 All 225 (JSON)
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulationcited by 10
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoringcited by 6
- 2026PVI: Plug-in Visual Injection for Vision-Language-Action Modelscited by 1
- 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulationcited by 0
- 2026VistaVLA: Geometry- and Semantic-Aware 3D Gaussian-Grounded VLA for Robotic Manipulation14 Jul 2026
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring29 May 2026
- 2026PVI: Plug-in Visual Injection for Vision-Language-Action Models13 Mar 2026
- 2026SimVLA: A Simple VLA Baseline for Robotic Manipulation20 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
- 2025A Survey on Efficient Vision-Language-Action Models
- 2024What Matters in Building Vision-Language-Action Models for Generalist Robots
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baseline
- 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
- 202510 Open Challenges Steering the Future of Vision-Language-Action Models
- 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systems