mlsanityData to 7 Oct 2026

VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment

arXiv 2607.01586 ↗First posted 2 Jul 2026cs.CV cs.AI cs.ROcited by 2

On the map: Vision-language-action models → Generalist VLA models and benchmarks

Abstract (arXiv)

Vision-language-action models (VLAs) have recently advanced robotic manipulation, yet the effects of different robot-data pre-training paradigms remain difficult to compare because existing models often differ in architecture, data, action space, and evaluation protocol. We present VLAFlow (Vision-Language-Action Flow), a unified flow-matching framework for controlled comparison of VLA training objectives. Using a heterogeneous robot corpus, OXEMix, containing approximately 5,000 hours of data from DROID, OpenX-Embodiment, OpenX-Augmented, and RoboCOIN, we evaluate four paradigms under the same pi0-style architecture, shared VLM backbone, action expert, and 14-dimensional action space: action-only modeling (MindPI), language-supervised co-training (MindLPI), future latent alignment (MindWPI), and their combination (MindLWPI). Experiments on LIBERO, LIBERO-Plus, and SimplerEnv show that action-only pre-training is sensitive to heterogeneous data. In contrast, language supervision helps preserve vision-language generalization, while future latent alignment improves state-transition and action-outcome modeling. By combining both signals, MindLWPI achieves the most stable overall transfer performance across benchmarks. These results suggest a meta-action space view: language and future latent representations provide complementary intermediate constraints that make heterogeneous action supervision smoother and more transferable.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Generalist VLA models and benchmarks, one of 13 directions in Vision-language-action models. Builds on 45 of its 48 references that are in the map. First posted on arXiv 2 Jul 2026.

Builds on

45 of 48 references.

Closest ancestors · 6

Same direction, newest first

  1. 2026A Pragmatic VLA Foundation Model26 Jan
  2. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Tasks28 Apr
  3. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Success27 Feb
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Control31 Oct
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Model13 Jun
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Control28 Jul

Other references · 39

  1. 2022Scalable Diffusion Models with Transformerscited by 5,931
  2. 2022Flow Matching for Generative Modelingcited by 5,426
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  5. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  6. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  7. 2019ZeRO: Memory Optimizations Toward Training Trillion Parameter Modelscited by 1,278
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  9. 2023Self-Supervised Learning from Images with a Joint-Embedding Predictive Architecturecited by 982
  10. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  11. 2017GradNorm: Gradient Normalization for Adaptive Loss Balancing in Deep Multitask Networkscited by 816
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
27 more
  1. 2025V-JEPA 2: Self-Supervised Video Models Enable Understanding, Prediction and Planningcited by 738
  2. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  3. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  4. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  5. 2024Revisiting Feature Prediction for Learning Visual Representations from Videocited by 490
  6. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  7. 2026World Action Models are Zero-shot Policiescited by 411
  8. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  9. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  10. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 278
  11. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 274
  12. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 183
  13. 2024RoboMIND: Benchmark on Multi-embodiment Intelligence Normative Data for Robot Manipulationcited by 166
  14. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 129
  15. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  16. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
  17. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policiescited by 90
  18. 2025RoboCOIN: An Open-Sourced Bimanual Robotic Data Collection for Integrated Manipulationcited by 72
  19. 2026Being-H0.7: A Latent World-Action Model from Egocentric Videoscited by 68
  20. 2026LDA-1B: Scaling Latent Dynamics Action Model via Universal Embodied Data Ingestioncited by 46
  21. 2024VidMan: Exploiting Implicit Dynamics from Video Diffusion Model for Effective Robot Manipulationcited by 45
  22. 2024Re-Mix: Optimizing Data Mixtures for Large Scale Imitation Learningcited by 44
  23. 2026JEPA-VLA: Video Predictive Embedding is Needed for VLA Modelscited by 22
  24. 2025FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correctioncited by 21
  25. 2026JoyAI-RA 0.1: A Foundation Model for Robotic Autonomycited by 21
  26. 2026LAP: Language-Action Pre-Training Enables Zero-shot Cross-Embodiment Transfercited by 17
  27. 2025OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learningcited by 10

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training
  2. 2025VLA-0: Building State-of-the-Art VLAs with Zero Modification
  3. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  4. 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
  5. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulation
  6. 2026LARA: Latent Action Representation Alignment for Vision-Language-Action Models
  7. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  8. 2025Vision-Language-Action Models for Robotics: A Review Towards Real-World Applications