AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models have shown remarkable progress in embodied tasks recently, but most methods process visual observations independently at each timestep. This history-agnostic design treats robot manipulation as a Markov Decision Process, even though real-world robotic control is inherently partially observable and requires reasoning over past interactions. To address this mismatch, we reformulate VLA policy learning from a Partially Observable Markov Decision Process perspective and propose AVA-VLA, a framework that conditions action generation on a recurrent state that serves as a neural approximation to the agent's belief over task history. Built on this recurrent state, we introduce Active Visual Attention (AVA), which dynamically reweights visual tokens in the current observation to focus on regions most relevant given both the instruction and execution history. Extensive experiments show that AVA-VLA achieves state-of-the-art performance on standard robotic benchmarks, including LIBERO and CALVIN, and transfers effectively to real-world dual-arm manipulation tasks. These results demonstrate the effectiveness of temporally grounded active visual processing for improving VLA performance in robotic sequential decision-making. The project page is available at https://liauto-dsr.github.io/AVA-VLA-Page.
Key facts. Cited by 25 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 56 of its 66 references that are in the map. First posted on arXiv 24 Nov 2025.
Builds on
56 of 66 references.
Closest ancestors · 6
Same direction, newest first
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning16 Sep
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning6 Sep
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 50
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 13,028
- 2023Visual Instruction Tuningcited by 7,869
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2024Qwen2 Technical Reportcited by 2,120
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2021DynamicViT: Efficient Vision Transformers with Dynamic Token Sparsificationcited by 864
38 more
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 642
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
- 2025Continuous 3D Perception Model with Persistent Statecited by 548
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2015Deep Recurrent Q-Learning for Partially Observable MDPscited by 465
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 391
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 339
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 339
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 304
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
- 2020A Recurrent Vision-and-Language BERT for Navigationcited by 302
- 2024NaVid: Video-based VLM Plans the Next Step for Vision-and-Language Navigationcited by 233
- 2024RT-H: Action Hierarchies Using Languagecited by 210
- 2025MemoryVLA: Perceptual-Cognitive Memory in Vision-Language-Action Models for Robotic Manipulationcited by 192
- 2024Streaming Long Video Understanding with Large Language Modelscited by 167
- 2025VLM-3R: Vision-Language Models Augmented with Instruction-Aligned 3D Reconstructioncited by 166
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 161
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 145
- 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
- 2025Unified Vision-Language-Action Modelcited by 134
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
- 2023PaLI-3 Vision Language Models: Smaller, Faster, Strongercited by 126
- 2021Recurrent Model-Free RL Can Be a Strong Baseline for Many POMDPscited by 122
- 2025GR-3 Technical Reportcited by 111
- 2022Partially Observable Markov Decision Processes in Robotics: A Surveycited by 86
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 81
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learningcited by 72
- 2018Reviving and Improving Recurrent Back-Propagationcited by 69
- 2025FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policiescited by 57
- 2022EfficientVLM: Fast and Accurate Vision-Language Models via Knowledge Distillation and Modal-adaptive Pruningcited by 56
- 2024MoME: Mixture of Multimodal Experts for Generalist Multimodal Large Language Modelscited by 46
- 2025IRL-VLA: Training an Vision-Language-Action Policy via Reward World Modelcited by 31
- 2025LVPruning: An Effective yet Simple Language-Guided Vision Token Pruning Approach for Multi-modal Large Language Modelscited by 23
- 2023PETformer: Long-term Time Series Forecasting via Placeholder-enhanced Transformercited by 22
Built on by
Citing papers per year: 2025: 1; 2026: 24.
25 papers.
Sort:
By area:
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 29
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulationcited by 28
- 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policiescited by 22
- 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 17
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 8
- 2026SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Modelscited by 4
- 2026Recursive Belief Vision Language Action Modelscited by 4
- 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoningcited by 4
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 4
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Controlcited by 2
- 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policiescited by 2
13 more
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agentscited by 1
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026MemBodied: Recurrent Associative Memory for Vision-Language-Action Modelscited by 1
- 2026MPCoT: Reward-Guided Multi-Path Latent Reasoning for Test-Time Scalable Vision-Language-Actioncited by 0
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapsecited by 0
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuningcited by 0
- 2026eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routingcited by 0
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injectioncited by 0
- 2026PermVLA: Factorization Order as a Regularizer for VLA Learningcited by 0
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLAcited by 0
- 2026DIVA: Dual-Space Intent-Aware Visual Attenuation for Vision-Language-Action Policiescited by 0
- 2026DIVA: Dual-Space Intent-Aware Visual Attenuation for Vision-Language-Action Policies6 Oct 2026
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026PermVLA: Factorization Order as a Regularizer for VLA Learning3 Oct 2026
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection1 Oct 2026
- 2026eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routing1 Oct 2026
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning28 Sep 2026
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026MemBodied: Recurrent Associative Memory for Vision-Language-Action Models23 Sep 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policies5 Sep 2026
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
13 more
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models10 Jul 2026
- 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies18 Jun 2026
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models10 Jun 2026
- 2026MPCoT: Reward-Guided Multi-Path Latent Reasoning for Test-Time Scalable Vision-Language-Action4 Jun 2026
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Control21 May 2026
- 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May 2026
- 2026Mini-BEHAVIOR-Gran: Revealing U-Shaped Effects of Instruction Granularity on Language-Guided Embodied Agents18 Apr 2026
- 2026See, Remember, Explore: A Benchmark and Baselines for Streaming Spatial Reasoning25 Mar 2026
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queries13 Mar 2026
- 2026Recursive Belief Vision Language Action Models24 Feb 2026
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
- 2026SCALE: Self-uncertainty Conditioned Adaptive Looking and Execution for Vision-Language-Action Models4 Feb 2026
- 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulation18 Dec 2025
- 2026ReMem-VLA: Empowering Vision-Language-Action Model with Memory via Dual-Level Recurrent Queriescited by 29
- 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policiescited by 22
- 2025GeoPredict: Leveraging Predictive Kinematics and 3D Gaussian Geometry for Precise VLA Manipulationcited by 17
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Modelscited by 8
- 2026Recursive Belief Vision Language Action Modelscited by 4
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 4
- 2026EvoScene-VLA: Evolving Scene Beliefs Inside the Action Decoder for Chunked Robot Controlcited by 2
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026MemBodied: Recurrent Associative Memory for Vision-Language-Action Modelscited by 1
- 2026MPCoT: Reward-Guided Multi-Path Latent Reasoning for Test-Time Scalable Vision-Language-Actioncited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuningcited by 0
12 most cited of 17 All 17 (JSON)
- 2026DIVA: Dual-Space Intent-Aware Visual Attenuation for Vision-Language-Action Policies6 Oct 2026
- 2026Triggering Generalist Reasoning via Predictive Uncertainty for Dual-System VLA4 Oct 2026
- 2026PermVLA: Factorization Order as a Regularizer for VLA Learning3 Oct 2026
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection1 Oct 2026
- 2026eRLT: Efficient VLA Reinforcement Learning via Action-Relevant Token Routing1 Oct 2026
- 2026Gaze Prompts: Temporally Dense Human Attention for Vision-Language-Action Fine-Tuning28 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026MemBodied: Recurrent Associative Memory for Vision-Language-Action Models23 Sep 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
- 2026EventVLA: Event-Driven Visual Evidence Memory for Long-Horizon Vision-Language-Action Policies18 Jun 2026
- 2026μVLA: On Recurrent Memory for Partially Observable Manipulation in VLA Models10 Jun 2026
12 newest of 17 All 17 (JSON)
- 2026VLANeXt: Recipes for Building Strong VLA Modelscited by 12
- 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policiescited by 2
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Modelscited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapsecited by 0
- 2026Does Adversarial Training Improve Generalization in Multi-View VLAs? Revealing and Mitigating View Collapse27 Sep 2026
- 2026LayerRoute: Action-Conditioned Mixture-of-Layers Routing for Vision-Language-Action Policies5 Sep 2026
- 2026MOSAIC: Adaptive Inter-layer Composition for Efficient Heterogeneous Vision-Language Models10 Jul 2026
- 2026VLANeXt: Recipes for Building Strong VLA Models20 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching
- 2026Restoring Linguistic Grounding in VLA Models via Train-Free Attention Recalibration
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2025Vision Language Action Models in Robotic Manipulation: A Systematic Review