mlsanityData to 7 Oct 2026

FocusVLA: Focused Visual Utilization for Vision-Language-Action Models

arXiv 2603.28740 ↗First posted 30 Mar 2026cs.ROcited by 5

On the map: Vision-language-action models → VLA architectures and generalization

Abstract (arXiv)

Vision-Language-Action (VLA) models improve action generation by conditioning policies on rich vision-language information. However, current auto-regressive policies are constrained by three bottlenecks: (1) architectural bias drives models to overlook visual details, (2) an excessive number of visual tokens makes attention difficult to focus on the correct regions, and (3) task-irrelevant visual information introduces substantial noise - together severely impairing the quality of action. In this paper, we investigate how to effectively utilize different visual representations for action generation. To this end, we first empirically validate the above issues and show that VLA performance is primarily limited by how visual information is utilized, rather than by the quality of visual representations. Based on these insights, we introduce FocusVLA, a novel paradigm that directs the model's attention to task-relevant visual regions to effectively bridge vision to action. Specifically, we first propose Modality Cascaded Attention to eliminate shortcut pathways, thereby compelling VLA models to rely on task-relevant visual details for action generation. Furthermore, we propose Focus Attention, which dynamically selects task-relevant visual patches to control information quantity while explicitly modulating their influence to suppress task-irrelevant noise. Extensive experiments on both simulated and real-world robotic benchmarks demonstrate that FocusVLA not only effectively leverages visual details to perform dexterous manipulations, but also substantially improves performance and accelerates convergence across a variety of tasks.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. Builds on 39 of its 40 references that are in the map. First posted on arXiv 30 Mar 2026.

Builds on

39 of 40 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewards18 Nov

Other references · 38

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
  2. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2024Qwen2 Technical Reportcited by 2,076
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  10. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  11. 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
26 more
  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  3. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  4. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  5. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
  6. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  7. 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
  8. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
  9. 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
  10. 2024RT-H: Action Hierarchies Using Languagecited by 204
  11. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  12. 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
  13. 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
  14. 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 101
  15. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
  16. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
  17. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  18. 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Modelscited by 50
  19. 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 44
  20. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 39
  21. 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignmentcited by 35
  22. 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruningcited by 34
  23. 2025From Spatial to Actions: Grounding Vision-Language-Action Model in Spatial Foundation Priorscited by 25
  24. 2025QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Modelscited by 19
  25. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inferencecited by 14
  26. 2026ST4VLA: Spatially Guided Training for Vision-Language-Action Modelscited by 8

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
  2. 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models
  3. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  4. 2026FabriMAE I Trust Myself? Self-Evaluating VLA Action Generation with Markov Attention Entropy
  5. 2025Seeing to Act, Prompting to Specify: A Bayesian Factorization of Vision Language Action Policy
  6. 2026VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing
  7. 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization
  8. 2026Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models