Alignment-Guided Flow Transformer for Efficient Vision-Language-Action Policy Learning
On the map: Vision-language-action models → Efficient VLA inference and adaptation also fits: Generalist VLA models and benchmarks
also in 1 more
Abstract (arXiv)
Recent advances in Vision-Language-Action (VLA) models point toward general-purpose robotic intelligence by unifying perception, instruction, and control. Despite impressive progress, existing VLA models often adapt poorly due to tri-modal misalignment among vision, language, and action, which weakens action grounding and hurts generalization and fine-tuning efficiency. In this work, we present Alignment-Guided Flow Transformer (AGFT), a novel framework that explicitly enforces tri-modal alignment through a dedicated alignment loss, bridging the representational gap across modalities and enhancing task adaptation. While prior research has predominantly emphasized bi-modal vision--language alignment, we systematically formalize and study tri-modal alignment in VLA models, and provide both ablations and analysis to isolate its role in improving adaptation and robustness. To further accelerate deployment, we adopt a flow-matching objective, enabling substantially fewer inference steps than diffusion-based policies while maintaining accuracy. Theoretically, we establish a quantitative connection between the tri-modal alignment gap and the optimization tightness of flow matching; empirically, experiments on the extensive benchmark show that AGFT achieves superior success rates and lower inference latency compared to SOTA baselines, underscoring tri-modal alignment as a key ingredient for scaling robust VLA manipulation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 61 of its 66 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
61 of 66 references.
Closest ancestors · 3
Same direction, newest first
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy25 Mar
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 58
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2020Denoising Diffusion Implicit Modelscited by 9,781
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2022Scalable Diffusion Models with Transformerscited by 6,054
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
38 more
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2021Decision Transformer: Reinforcement Learning via Sequence Modelingcited by 1,546
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 691
- 2021Offline Reinforcement Learning as One Big Sequence Modeling Problemcited by 644
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2022Perceiver-Actor: A Multi-Task Transformer for Robotic Manipulationcited by 551
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2023DynamiCrafter: Animating Open-domain Images with Video Diffusion Priorscited by 471
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 349
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024Latent Action Pretraining from Videoscited by 321
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 20243D Diffuser Actor: Policy Diffusion with 3D Scene Representationscited by 282
- 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 279
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 269
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 195
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 134
- 2019Training Agents using Upside-Down Reinforcement Learningcited by 107
- 2019Reward-Conditioned Policiescited by 102
- 2025A Survey on Vision-Language-Action Models: An Action Tokenization Perspectivecited by 96
- 2024The Ingredients for Robotic Diffusion Transformerscited by 73
- 2024Learning Robotic Manipulation Policies from Point Clouds with Conditional Flow Matchingcited by 65
- 2024Affordance-based Robot Manipulation with Flow Matchingcited by 54
- 2024GR-MG: Leveraging Partially Annotated Data via Multi-Modal Goal-Conditioned Policycited by 39
50 most cited of 58 All 58 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026VLAFlow: A Unified Training Framework for Vision-Language-Action Models via Co-training and Future Latent Alignment
- 2026Generalizable VLA Finetuning via Representation Anchoring and Language-Action Alignment
- 2026Fewer Steps, Better Actions: Rethinking Flow-Matching Inference for VLA Policies
- 2026AWM-VLA: AlignedWorld Modeling for Efficient and Explainable Vision-Language-Action Policies
- 2026AdaVLA: Adaptive Step Flow Matching for Training-free Acceleration of Vision-Language-Action Models
- 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
- 2026ROCKET: Residual-Oriented Multi-Layer Alignment for Spatially-Aware Vision-Language-Action Models
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification