mlsanityData to 14 Oct 2026

Alignment-Guided Flow Transformer for Efficient Vision-Language-Action Policy Learning

arXiv 2609.34467 ↗First posted 28 Sep 2026cs.LGcited by 0

On the map: Vision-language-action models → Efficient VLA inference and adaptation also fits: Generalist VLA models and benchmarks

also in 1 more
Abstract (arXiv)

Recent advances in Vision-Language-Action (VLA) models point toward general-purpose robotic intelligence by unifying perception, instruction, and control. Despite impressive progress, existing VLA models often adapt poorly due to tri-modal misalignment among vision, language, and action, which weakens action grounding and hurts generalization and fine-tuning efficiency. In this work, we present Alignment-Guided Flow Transformer (AGFT), a novel framework that explicitly enforces tri-modal alignment through a dedicated alignment loss, bridging the representational gap across modalities and enhancing task adaptation. While prior research has predominantly emphasized bi-modal vision--language alignment, we systematically formalize and study tri-modal alignment in VLA models, and provide both ablations and analysis to isolate its role in improving adaptation and robustness. To further accelerate deployment, we adopt a flow-matching objective, enabling substantially fewer inference steps than diffusion-based policies while maintaining accuracy. Theoretically, we establish a quantitative connection between the tri-modal alignment gap and the optimization tightness of flow matching; empirically, experiments on the extensive benchmark show that AGFT achieves superior success rates and lower inference latency compared to SOTA baselines, underscoring tri-modal alignment as a key ingredient for scaling robust VLA manipulation.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 61 of its 66 references that are in the map. First posted on arXiv 28 Sep 2026.

Builds on

61 of 66 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy25 Mar
  2. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan

Other references · 58

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  5. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  6. 2020Denoising Diffusion Implicit Modelscited by 9,781
  7. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  8. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  9. 2022Scalable Diffusion Models with Transformerscited by 6,054
  10. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  11. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  12. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
38 more
  1. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  2. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
  3. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  4. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  5. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  6. 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  8. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  9. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  10. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  11. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
  12. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  13. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
  14. 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
  15. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  16. 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
  17. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  18. 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
  19. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  20. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  21. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  22. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
  23. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  24. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  25. 2024Latent Action Pretraining from Videoscited by 321
  26. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
  27. 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
  28. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
  29. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 269
  30. 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 195
  31. 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 134
  32. 2019Training Agents using Upside-Down Reinforcement Learningcited by 107
  33. 2019Reward-Conditioned Policiescited by 102
  34. 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
  35. 2024The Ingredients for Robotic Diffusion Transformerscited by 73
  36. 2024Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matchingcited by 65
  37. 2024Affordance-based Robot Manipulation with Flow Matchingcited by 54
  38. 2024GR-MG: Leveraging Partially Annotated Data via Multi-Modal Goal-Conditioned Policycited by 39

50 most cited of 58 All 58 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
  2. 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
  3. 2026Fewer Steps, Better Actions: Rethinking Flow-Matching Inference for VLA Policies
  4. 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
  5. 2026AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models
  6. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  7. 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Models
  8. 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification