FocusVLA: Focused Visual Utilization for Vision-Language-Action Models
On the map: Vision-language-action models → VLA architectures and generalization
Abstract (arXiv)
Vision-Language-Action (VLA) models improve action generation by conditioning policies on rich vision-language information. However, current auto-regressive policies are constrained by three bottlenecks: (1) architectural bias drives models to overlook visual details, (2) an excessive number of visual tokens makes attention difficult to focus on the correct regions, and (3) task-irrelevant visual information introduces substantial noise - together severely impairing the quality of action. In this paper, we investigate how to effectively utilize different visual representations for action generation. To this end, we first empirically validate the above issues and show that VLA performance is primarily limited by how visual information is utilized, rather than by the quality of visual representations. Based on these insights, we introduce FocusVLA, a novel paradigm that directs the model's attention to task-relevant visual regions to effectively bridge vision to action. Specifically, we first propose Modality Cascaded Attention to eliminate shortcut pathways, thereby compelling VLA models to rely on task-relevant visual details for action generation. Furthermore, we propose Focus Attention, which dynamically selects task-relevant visual patches to control information quantity while explicitly modulating their influence to suppress task-irrelevant noise. Extensive experiments on both simulated and real-world robotic benchmarks demonstrate that FocusVLA not only effectively leverages visual details to perform dexterous manipulations, but also substantially improves performance and accelerates convergence across a variety of tasks.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in VLA architectures and generalization, one of 13 directions in Vision-language-action models. Builds on 39 of its 40 references that are in the map. First posted on arXiv 30 Mar 2026.
Builds on
39 of 40 references.
Closest ancestors · 1
Same direction, newest first
Other references · 38
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Qwen2 Technical Reportcited by 2,076
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025VGGT: Visual Geometry Grounded Transformercited by 1,475
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
26 more
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 20243D-VLA: A 3D Vision-Language-Action Generative World Modelcited by 320
- 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 285
- 2025Gated Attention for Large Language Models: Non-linearity, Sparsity, and Attention-Sink-Freecited by 266
- 2024RT-H: Action Hierarchies Using Languagecited by 204
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2025Spatial Forcing: Implicit Spatial Representation Alignment for Vision-language-action Modelcited by 125
- 2023RoboCat: A Self-Improving Generalist Agent for Robotic Manipulationcited by 108
- 2025PointVLA: Injecting the 3D World into Vision-Language-Action Modelscited by 101
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
- 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 83
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Modelscited by 50
- 2025DepthVLA: Enhancing Vision-Language-Action Models with Depth-Aware Spatial Reasoningcited by 44
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruningcited by 39
- 2025Evo-1: Lightweight Vision-Language-Action Model with Preserved Semantic Alignmentcited by 35
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruningcited by 34
- 2025From Spatial to Actions: Grounding Vision-Language-Action Model in Spatial Foundation Priorscited by 25
- 2025QDepth-VLA: Quantized Depth Prediction as Auxiliary Supervision for Vision-Language-Action Modelscited by 19
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inferencecited by 14
- 2026ST4VLA: Spatially Guided Training for Vision-Language-Action Modelscited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Modelscited by 4
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policiescited by 0
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAMcited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuningcited by 0
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning28 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026An Action Is Worth One Patch: Unified World-Action Modeling with PatchWAM22 Sep 2026
- 2026Sensing Which Modality Matters: Evidence-Gated Regularization for Robust VLA Policies2 Sep 2026
- 2026UniTacVLA: Unified Tactile Understanding and Prediction in Vision Language Action Models30 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalization
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
- 2026FabriMAE I Trust Myself? Self-Evaluating VLA Action Generation with Markov Attention Entropy
- 2025Seeing to Act, Prompting to Specify: A Bayesian Factorization of Vision Language Action Policy
- 2026VLA-Trace: Diagnosing Vision-Language-Action Models through Representation and Behavior Tracing
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization
- 2026Not All Features Are Created Equal: A Mechanistic Study of Vision-Language-Action Models