mlsanityData to 7 Oct 2026

Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization

arXiv 2602.09722 ↗First posted 10 Feb 2026cs.ROcited by 7

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

While Vision-Language-Action (VLA) models show strong promise for generalist robot control, it remains unclear whether -- and under what conditions -- the standard "scale data" recipe translates to robotics, where training data is inherently heterogeneous across embodiments, sensors, and action spaces. We present a systematic, controlled study of VLA scaling that revisits core training choices for pretraining across diverse robots. Using a representative VLA framework that combines a vision-language backbone with flow-matching, we ablate key design decisions under matched conditions and evaluate in extensive simulation and real-robot experiments. To improve the reliability of real-world results, we introduce a Grouped Blind Ensemble protocol that blinds operators to model identity and separates policy execution from outcome judgment, reducing experimenter bias. Our analysis targets three dimensions of VLA scaling. (1) Physical alignment: we show that a unified end-effector (EEF)-relative action representation is critical for robust cross-embodiment transfer. (2) Embodiment mixture: we find that naively pooling heterogeneous robot datasets often induces negative transfer rather than gains, underscoring the fragility of indiscriminate data scaling. (3) Training regularization: we observe that intuitive strategies, such as sensory dropout and multi-stage fine-tuning, do not consistently improve performance at scale. Together, this study challenge some common assumptions about embodied scaling and provide practical guidance for training large-scale VLA policies from diverse robotic data. Project website: https://research.beingbeyond.com/rethink_vla

Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 44 of its 47 references that are in the map. First posted on arXiv 10 Feb 2026.

Builds on

44 of 47 references.

Closest ancestors · 9

Same direction, newest first

  1. 2026InternVLA-A1: Unifying Understanding, Generation and Action for Robotic Manipulation5 Jan
  2. 2025InternData-A1: Pioneering High-Fidelity Synthetic Data for Pre-training Generalist Policy20 Nov
  3. 2025Galaxea Open-World Dataset and G0 Dual-System VLA Model30 Aug
  4. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Robotics2 Jun
  5. 2025π0.5: a Vision-Language-Action Model with Open-World Generalization22 Apr
  6. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation29 Nov
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  9. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 35

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
  4. 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,655
  5. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
  6. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  7. 2025Qwen3-VL Technical Reportcited by 2,534
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2025InternVL3.5: Advancing Open-Source Multimodal Models in Versatility, Reasoning, and Efficiencycited by 1,419
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  11. 2022Planning with Diffusion for Flexible Behavior Synthesiscited by 1,023
  12. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
23 more
  1. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  2. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  3. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  4. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  5. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  6. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 391
  7. 2025AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systemscited by 390
  8. 2019RoboNet: Large-Scale Multi-Robot Learningcited by 268
  9. 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
  10. 2023RH20T: A Comprehensive Robotic Dataset for Learning Diverse Skills in One-Shotcited by 173
  11. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  12. 2023On Bringing Robots Homecited by 101
  13. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
  14. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  15. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  16. 2025Eagle 2: Building Post-Training Data Strategies from Scratch for Frontier Vision-Language Modelscited by 69
  17. 2026Being-H0.5: Scaling Human-Centric Robot Learning for Cross-Embodiment Generalizationcited by 61
  18. 2025RoboMIND 2.0: A Multimodal, Bimanual Mobile Manipulation Dataset for Generalizable Embodied Intelligencecited by 31
  19. 2025Dex1B: Learning with 1B Demonstrations for Dexterous Manipulationcited by 23
  20. 2024From Pixels to Tokens: Byte-Pair Encoding on Quantized Visual Modalitiescited by 16
  21. 2019Robot Learning of Shifting Objects for Grasping in Cluttered Environmentscited by 12
  22. 2024VideoOrion: Tokenizing Object Dynamics in Videoscited by 12
  23. 2025Unified Multimodal Understanding via Byte-Pair Visual Encodingcited by 9

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 7.

7 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Beyond Data Scaling: Representation-Centric Continued Pre-training for Vision-Language-Action Models
  2. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  3. 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
  4. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  5. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review
  6. 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models
  7. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges
  8. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications