VLANeXt: Recipes for Building Strong VLA Models
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
also in 1 more
Abstract (arXiv)
Following the rise of large foundation models, Vision-Language-Action models (VLAs) emerged, leveraging strong visual and language understanding from Vision-Language Models for general-purpose policy learning. Yet, the current VLA landscape remains fragmented and exploratory. Although many groups have proposed their own VLA models, inconsistencies in training protocols and evaluation settings make it difficult to identify which design choices truly matter. To bring structure to this evolving space, we reexamine the VLA design space under a unified framework and evaluation setup. Starting from a simple VLA baseline similar to RT-2, which is the origin of VLA, we systematically dissect design choices along three dimensions: foundational components, perception essentials, and action modeling perspectives. From this study, we distill 12 key findings that together form a practical recipe for building strong VLA models. The outcome of this exploration is a simple yet effective model, VLANeXt. It outperforms the state-of-the-art methods on the LIBERO and LIBERO-plus benchmarks and demonstrates strong performance in real-world experiments. Beyond identifying the core recipe, we further ask how far these design principles extend to the emerging paradigms in VLAs. We thus expand VLANeXt along several emerging directions, including model scaling, latent-action pretraining, latent predictive representation learning, and world action modeling. These studies give rise to the VLANeXt family, spanning compact and scaled VLA variants, latent-action models, JEPA-style predictive models, and World Action Models. Our results show that the core recipe provides a strong foundation across different model scales and emerging paradigms.
Key facts. Cited by 12 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 134 of its 171 references that are in the map. First posted on arXiv 20 Feb 2026.
Builds on
134 of 171 references.
Closest ancestors · 12
Same direction, newest first
- 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Models12 Feb
- 2026Causal World Modeling for Robot Control29 Jan
- 2026VLM4VLA: Revisiting Vision-Language-Models in Vision-Language-Action Models6 Jan
- 2025MergeVLA: Cross-Skill Model Merging Toward a Generalist Vision-Language-Action Agent24 Nov
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model11 Sep
- 2025CronusVLA: Towards Efficient and Robust Manipulation via Multi-Frame Vision-Language-Action Modeling24 Jun
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Models27 Mar
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agent31 Jan
- 2023Vision-Language Foundation Models as Effective Robot Imitators2 Nov
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul
Other references · 122
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2017Neural Discrete Representation Learningcited by 4,650
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,229
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2025Qwen3-VL Technical Reportcited by 2,534
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
38 more
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025DINOv3cited by 1,297
- 2022FEDformer: Frequency Enhanced Decomposed Transformer for Long-term Series Forecastingcited by 1,200
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
- 2022Language Models as Zero-Shot Planners: Extracting Actionable Knowledge for Embodied Agentscited by 1,029
- 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
- 2021VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learningcited by 1,013
- 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024Training Large Language Models to Reason in a Continuous Latent Spacecited by 763
- 2023VoxPoser: Composable 3D Value Maps for Robotic Manipulation with Language Modelscited by 733
- 2017Learning Complex Dexterous Manipulation with Deep Reinforcement Learning and Demonstrationscited by 685
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2018Learning Dexterous In-Hand Manipulationcited by 643
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 545
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2020Learning Quadrupedal Locomotion over Challenging Terraincited by 494
- 2021RMA: Rapid Motor Adaptation for Legged Robotscited by 430
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2026World Action Models are Zero-shot Policiescited by 411
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2020Transporter Networks: Rearranging the Visual World for Robotic Manipulationcited by 342
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2024ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulationcited by 305
- 2024Latent Action Pretraining from Videoscited by 302
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
50 most cited of 122 All 122 (JSON)
Built on by
Citing papers per year: 2026: 12.
12 papers.
- 2026Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVRcited by 5
- 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Modelscited by 3
- 2026PearlVLA: Progressive Embodied Action-Plan Refinement in Latent Spacecited by 2
- 2026VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Expertscited by 1
- 2026Look Where It Matters: Adaptive Visual Refinement for Vision-Language-Action Modelscited by 1
- 2026Holo-Captioning: Toward the Text Equivalent of 3D Scenescited by 0
- 2026WorldDiT: A Unified Diffusion Architecture for World and Action Modelingcited by 0
- 2026Teach and Grow: An Agent-Centered Architecture for General Robot Learningcited by 0
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modescited by 0
- 2026What Makes an Efficient VLA? Navigating Action-Head Design, Scaling, and Latencycited by 0
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunkscited by 0
- 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAscited by 0
- 2026When Listening Becomes Easier: Scrubbing Visual Cues for Shortcut-Free VLAs7 Oct 2026
- 2026Staircase Policy: Streaming Inference for World-Action Models with Large Action Chunks29 Sep 2026
- 2026What Makes an Efficient VLA? Navigating Action-Head Design, Scaling, and Latency12 Sep 2026
- 2026TrapVLA: Trapping Vision-Language-Action Models in Configured Failure Modes27 Aug 2026
- 2026Teach and Grow: An Agent-Centered Architecture for General Robot Learning17 Aug 2026
- 2026Look Where It Matters: Adaptive Visual Refinement for Vision-Language-Action Models3 Aug 2026
- 2026WorldDiT: A Unified Diffusion Architecture for World and Action Modeling27 Jul 2026
- 2026Holo-Captioning: Toward the Text Equivalent of 3D Scenes3 Jul 2026
- 2026PearlVLA: Progressive Embodied Action-Plan Refinement in Latent Space16 Jun 2026
- 2026Rethinking Muon Beyond Pretraining: Spectral Failures and High-Pass Remedies for VLA and RLVR19 May 2026
- 2026CKT-WAM: Parameter-Efficient Context Knowledge Transfer Between World Action Models7 May 2026
- 2026VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts7 May 2026
Similar, not cited
Close in wording, no citation either way
- 2025Vision-Language-Action (VLA) Models: Concepts, Progress, Applications and Challenges
- 2026VLA Foundry: A Unified Framework for Training Vision-Language-Action Models
- 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
- 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspective
- 2026One Token Per Frame: Reconsidering Visual Bandwidth in World Models for VLA Policy
- 2026Rethinking VLM Representation for VLA Initialization
- 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models