mlsanityData to 14 Oct 2026

What Makes an Efficient VLA? Navigating Action-Head Design, Scaling, and Latency

arXiv 2609.13984 ↗First posted 12 Sep 2026cs.RO cs.CVcited by 0

On the map: Vision-language-action models → VLA architectures and generalization

Abstract (arXiv)

Vision-Language-Action (VLA) models combine a pretrained vision encoder, a language backbone, and an action head, but their relative contribution has not been established under controlled, latency-paired conditions. We fix the backbone families (SigLIP2 and Qwen2.5) and the training pipeline, sweep action-head design and module scale, and pair each configuration with measured on-device latency. The study yields three findings. First, action-head performance is governed primarily by initialization rather than decoder architecture, loss, or inference budget: copying the last transformer layers of the language backbone into the head is the single largest lever, at no latency cost, and the only axis that helps at every module scale. Alignment also explains the other axes: flow matching and a heavier decoder pay off only while the head is misaligned and reverse once it is aligned, and extra inference passes give no measurable benefit; expressiveness appears to substitute for missing alignment. We read this as representation transfer: the aligned head keeps attending to the instruction's object nouns and stays close to the backbone in weight space rather than relearning to act from scratch. Because we reach alignment only through initialization, we offer this as the account that best organizes the measurements, not a demonstrated cause, and name the control that would settle it. Second, capacity pays only after alignment: the aligned action head is the highest-return module to scale. Third, those returns diminish sharply near the size today's π-series VLAs already use, so further growth buys little in-domain accuracy for its latency. These specify EffVLA, a compact model matching the strongest open-source VLAs on standard LIBERO, leading on most LIBERO-Plus perturbation axes at lower latency, and transferring to a real SO-ARM101 arm with the recipe unchanged.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. Builds on 34 of its 39 references that are in the map. First posted on arXiv 12 Sep 2026.

Builds on

34 of 39 references.

Closest ancestors · 1

Same direction, newest first

  1. 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb

Other references · 33

  1. 2020Scaling Laws for Neural Language Modelscited by 6,586
  2. 2019EfficientNet: Rethinking Model Scaling for Convolutional Neural Networkscited by 6,442
  3. 2022Scalable Diffusion Models with Transformerscited by 6,054
  4. 2022Flow Matching for Generative Modelingcited by 5,702
  5. 2024Qwen2.5 Technical Reportcited by 4,942
  6. 2017MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applicationscited by 3,845
  7. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  8. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  9. 2022Training Compute-Optimal Large Language Modelscited by 3,019
  10. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  11. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  12. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
21 more
  1. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  2. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  3. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  4. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  5. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  6. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,188
  7. 2018MnasNet: Platform-Aware Neural Architecture Search for Mobilecited by 943
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  9. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  10. 2022Fine-Tuning can Distort Pretrained Features and Underperform Out-of-Distributioncited by 739
  11. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 665
  12. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
  13. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  14. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  15. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  16. 2022Surgical Fine-Tuning Improves Adaptation to Distribution Shiftscited by 205
  17. 2024Data Scaling Laws in Imitation Learning for Robotic Manipulationcited by 145
  18. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
  19. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  20. 2026StarVLA-α: Reducing Complexity in Vision-Language-Action Systemscited by 31
  21. 2026Hardware Co-Design Scaling Laws via Roofline Modelling for On-Device LLMscited by 5

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026The Layer Mystery of VLA: An Information-Theoretical Analysis of VLA Latent Interface
  2. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models
  3. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
  4. 2026Observing and Controlling Features in Vision-Language-Action Models
  5. 2026ActionCodec: What Makes for Good Action Tokenizers
  6. 2026Not All Layers Need Tuning: Diagnosing and Directing Adaptation in Vision-Language-Action Models
  7. 2026TurboVLA: Real-Time Vision-Language-Action Model at 32 Hz on an RTX 4090 with <1 GB VRAM
  8. 2026FocusVLA: Focused Visual Utilization for Vision-Language-Action Models