mlsanityData to 14 Oct 2026

AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention

arXiv 2511.18960 ↗First posted 24 Nov 2025cs.LG cs.CV cs.ROcited by 25

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov Decision Process, even though real-world robotic control is inherently partially observable and requires reasoning over past interactions. To address this mismatch, we reformulate VLA policy learning from a Partially Observable Markov Decision Process perspective and propose AVA-VLA, a framework that conditions action generation on a recurrent state that serves as a neural approximation to the agent's belief over task history. Built on this recurrent state, we introduce Active Visual Attention (AVA), which dynamically reweights visual tokens in the current observation to focus on regions most relevant given both the instruction and execution history. Extensive experiments show that AVA-VLA achieves state-of-the-art performance on standard robotic benchmarks, including LIBERO and CALVIN, and transfers effectively to real-world dual-arm manipulation tasks. These results demonstrate the effectiveness of temporally grounded active visual processing for improving VLA performance in robotic sequential decision-making. The project page is available at https://liauto-dsr.github.io/AVA-VLA-Page.

Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 56 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.

Builds on

56 of 66 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning16 Sep
  2. 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
  3. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
  4. 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
  5. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan

Other references · 50

  1. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
  2. 2023Visual Instruction Tuningcited by 7,869
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  6. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  7. 2024Qwen2 Technical Reportcited by 2,120
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  9. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  10. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  12. 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
38 more
  1. 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
  2. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  3. 2025Continuous 3D Perception Model with Persistent Statecited by 548
  4. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  5. 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 465
  6. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  7. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  8. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  9. 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
  10. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  11. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
  12. 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
  13. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
  14. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  15. 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
  16. 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
  17. 2024RT-H: Action Hierarchies Using Languagecited by 210
  18. 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
  19. 2024Streaming Long Video Understanding with Large Language Modelscited by 167
  20. 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
  21. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
  22. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
  23. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
  24. 2025Unified Vision-Language-Action Modelcited by 134
  25. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  26. 2023PaLI-3 Vision Language Models: Smaller, Faster, Strongercited by 126
  27. 2021Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPscited by 122
  28. 2025GR-3 Technical Reportcited by 111
  29. 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 86
  30. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 81
  31. 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
  32. 2018Reviving and Improving Recurrent Back-Propagationcited by 69
  33. 2025FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policiescited by 57
  34. 2022EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruningcited by 56
  35. 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
  36. 2025IRL-VLA: Training an Vision-Language-Action Policy via Reward World Modelcited by 31
  37. 2025LVPruning: An Effective yet Simple Language-Guided Vision Token Pruning Approach for Multi-modal Large Language Modelscited by 23
  38. 2023PETformer: Long-term Time Series Forecasting via Placeholder-enhanced Transformercited by 22

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 24.

25 papers.

Sort:

By area:

  1. 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 29
  2. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 28
  3. 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policiescited by 22
  4. 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 17
  5. 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
  6. 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 8
  7. 2026SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Modelscited by 4
  8. 2026Recursive Belief Vision Language Action Modelscited by 4
  9. 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoningcited by 4
  10. 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 4
  11. 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Controlcited by 2
  12. 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policiescited by 2
13 more
  1. 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agentscited by 1
  2. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
  3. 2026MemBodied: Recurrent Associative Memory for Vision-Language-Action Modelscited by 1
  4. 2026MPCoT: Reward-Guided Multi-Path Latent Reasoning for Test-Time Scalable Vision-Language-Actioncited by 0
  5. 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
  6. 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
  7. 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapsecited by 0
  8. 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuningcited by 0
  9. 2026eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routingcited by 0
  10. 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injectioncited by 0
  11. 2026PermVLA: Factorization Order as a Regularizer for VLA Learningcited by 0
  12. 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
  13. 2026DIVA: Dual-Space Intent-Aware Visual Attenuation for Vision-Language-Action Policiescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
  2. 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
  3. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
  4. 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
  5. 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
  6. 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
  7. 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
  8. 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review