Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulation
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Robotic manipulation with Vision-Language-Action models requires efficient inference over long-horizon multi-modal context, where attention to dense visual tokens dominates computational cost. Existing methods optimize inference speed by reducing visual redundancy within VLA models, but they overlook the varying redundancy across robotic manipulation stages. We observe that the visual token redundancy is higher in coarse manipulation phase than in fine-grained operations, and is strongly correlated with the action dynamic. Motivated by this observation, we propose Action-aware Dynamic Pruning (ADP), a multi-modal pruning framework that integrates text-driven token selection with action-aware trajectory gating. Our method introduces a gating mechanism that conditions the pruning signal on recent action trajectories, using past motion windows to adaptively adjust token retention ratios in accordance with dynamics, thereby balancing computational efficiency and perceptual precision across different manipulation stages. Extensive experiments on the LIBERO suites and diverse real-world scenarios demonstrate that our method significantly reduces FLOPs and action inference latency (textite.g. 1.35 × speed up on OpenVLA-OFT) while maintaining competitive success rates (textite.g. 25.8% improvements with OpenVLA) compared to baselines, thereby providing a simple plug-in path to efficient robot policies that advances the efficiency and performance frontier of robotic manipulation. Our project website is: hrefhttps://vla-adp.github.io/ADP.com.
Key facts. Cited by 32 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 25 of its 30 references that are in the map. First posted on arXiv 26 Sep 2025.
Builds on
25 of 30 references.
Closest ancestors · 5
Same direction, newest first
- 2025SP-VLA: A Joint Model Scheduling and Token Pruning Approach for VLA Model Acceleration15 Jun
- 2025EfficientVLA: Training-Free Acceleration and Compression for Vision-Language-Action Models11 Jun
- 2025Think Twice, Act Once: Token-Aware Compression and Action Reuse for Efficient Inference in Vision-Language-Action Models27 May
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Caching4 Feb
Other references · 20
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,764
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,048
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024An Image is Worth 1/2 Tokens After Layer 2: Plug-and-Play Inference Acceleration for Large Vision-Language Modelscited by 629
- 2023OpenFlamingo: An Open-Source Framework for Training Large Autoregressive Vision-Language Modelscited by 560
8 more
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2024Cross-Self KV Cache Pruning for Efficient Vision-Language Inferencecited by 11
Built on by
Citing papers per year: 2025: 4; 2026: 28.
32 papers.
Sort:
By area:
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Modelscited by 8
- 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Modelscited by 6
- 2025TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Accelerationcited by 6
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
- 2026SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulationcited by 4
- 2026AttenA+: Rectifying Action Inequality in Robotic Foundation Modelscited by 3
- 2026TAG: Target-Agnostic Guidance for Stable Object-Centric Inference in Vision-Language-Action Modelscited by 2
- 2026Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentationcited by 2
20 more
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Modelscited by 2
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptationcited by 2
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulationcited by 1
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Thinkcited by 1
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 1
- 2026Premover: Fast Vision-Language-Action Control by Acting Before Instructions Are Completecited by 0
- 2026Differentiable Efficient Operator Searchcited by 0
- 2026Role-Conditioned Sub-Token Routing for Efficient Vision-Language-Action Policiescited by 0
- 2026Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Modelscited by 0
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Roboticscited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inferencecited by 0
- 2026The Decision Value of Perception Computecited by 0
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inferencecited by 0
- 2026Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Controlcited by 0
- 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imaginationcited by 0
- 2026When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLAcited by 0
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Modelscited by 0
- 2026REACT: Rolling Denoising and Dual Decoupling for Reactive Robot Control with VLA Models8 Oct 2026
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models6 Oct 2026
- 2026When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLA4 Oct 2026
- 2026Sparse-WAM: Accelerating World Action Models via Action-Guided Sparse Imagination30 Sep 2026
- 2026Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control29 Sep 2026
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference29 Sep 2026
- 2026The Decision Value of Perception Compute28 Sep 2026
- 2026SlackDrive: Reclaiming Runtime Slack for Adaptive Driving Inference23 Sep 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics7 Sep 2026
- 2026Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models21 Aug 2026
- 2026Role-Conditioned Sub-Token Routing for Efficient Vision-Language-Action Policies19 Aug 2026
20 more
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation30 Jun 2026
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think18 Jun 2026
- 2026Differentiable Efficient Operator Search3 Jun 2026
- 2026GeoSem-WAM: Geometry- and Semantic-Aware World Action Models2 Jun 2026
- 2026SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation28 May 2026
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models28 May 2026
- 2026AttenA+: Rectifying Action Inequality in Robotic Foundation Models13 May 2026
- 2026Premover: Fast Vision-Language-Action Control by Acting Before Instructions Are Complete12 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentation4 May 2026
- 2026Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulation26 Apr 2026
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performance26 Mar 2026
- 2026TAG: Target-Agnostic Guidance for Stable Object-Centric Inference in Vision-Language-Action Models25 Mar 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inference11 Mar 2026
- 2025TS-DP: Reinforcement Speculative Decoding For Temporal Adaptive Diffusion Policy Acceleration13 Dec 2025
- 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Models10 Dec 2025
- 2025A Survey on Efficient Vision-Language-Action Models27 Oct 2025
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
- 2025A Survey on Efficient Vision-Language-Action Modelscited by 34
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 20
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 2025Token Expand-Merge: Training-Free Token Compression for Vision-Language-Action Modelscited by 6
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
- 2026SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulationcited by 4
- 2026TAG: Target-Agnostic Guidance for Stable Object-Centric Inference in Vision-Language-Action Modelscited by 2
- 2026Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentationcited by 2
- 2026DepthCache: Depth-Guided Training-Free Visual Token Merging for Vision-Language-Action Model Inferencecited by 1
- 2026Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulationcited by 1
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Thinkcited by 1
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Modelscited by 1
12 most cited of 18 All 18 (JSON)
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models6 Oct 2026
- 2026Urgent Actions Go First: Urgency-Aware Denoising for Real-Time VLA Control29 Sep 2026
- 2026Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference29 Sep 2026
- 2026ComVLA: Communication-Aware Split Inference for VLA Models in 6G-Connected Robotics7 Sep 2026
- 2026Role-Conditioned Sub-Token Routing for Efficient Vision-Language-Action Policies19 Aug 2026
- 2026StellaVLA: In-Context Structured Demonstration for Generalizable Vision-Language-Action Models12 Aug 2026
- 2026Finetuning Vision-Language-Action Models Requires Fewer Layers Than You Think18 Jun 2026
- 2026SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation28 May 2026
- 2026Premover: Fast Vision-Language-Action Control by Acting Before Instructions Are Complete12 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026Seeing Realism from Simulation: Efficient Video Transfer for Vision-Language-Action Data Augmentation4 May 2026
- 2026Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulation26 Apr 2026
12 newest of 18 All 18 (JSON)
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptationcited by 2
- 2026Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Modelscited by 0
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAscited by 0
- 2026When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLAcited by 0
- 2026When and What to Prune? Stage-Aware Visual Token Pruning for Efficient VLA4 Oct 2026
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs17 Sep 2026
- 2026Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models21 Aug 2026
- 2026Revisiting Parameter Redundancy in Vision-Language-Action Models: Insights from VLM-to-VLA Adaptation30 Jun 2026
- 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Survey20 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
- 2026Reducing Temporal Redundancy for Efficient Vision-Language-Action Inference
- 2025The Better You Learn, The Smarter You Prune: Towards Efficient Vision-language-action Models via Differentiable Token Pruning
- 2026Learning to Accelerate Vision-Language-Action Models through Adaptive Visual Token Caching
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- 2025SpecPrune-VLA: Accelerating Vision-Language-Action Models via Action-Aware Self-Speculative Pruning