SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-Language-Action (VLA) models have advanced in robotic manipulation, yet practical deployment remains hindered by two key limitations: 1) perceptual redundancy, where irrelevant visual inputs are processed inefficiently, and 2) superficial instruction-vision alignment, which hampers semantic grounding of actions. In this paper, we propose SemanticVLA, a novel VLA framework that performs Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation. Specifically: 1) To sparsify redundant perception while preserving semantic alignment, Semantic-guided Dual Visual Pruner (SD-Pruner) performs: Instruction-driven Pruner (ID-Pruner) extracts global action cues and local semantic anchors in SigLIP; Spatial-aggregation Pruner (SA-Pruner) compacts geometry-rich features into task-adaptive tokens in DINOv2. 2) To exploit sparsified features and integrate semantics with spatial geometry, Semantic-complementary Hierarchical Fuser (SH-Fuser) fuses dense patches and sparse tokens across SigLIP and DINOv2 for coherent representation. 3) To enhance the transformation from perception to action, Semantic-conditioned Action Coupler (SA-Coupler) replaces the conventional observation-to-DoF approach, yielding more efficient and interpretable behavior modeling for manipulation tasks. Extensive experiments on simulation and real-world tasks show that SemanticVLA sets a new SOTA in both performance and efficiency. SemanticVLA surpasses OpenVLA on LIBERO benchmark by 21.1% in success rate, while reducing training cost and inference latency by 3.0-fold and 2.7-fold.SemanticVLA is open-sourced and publicly available at https://github.com/JiuTian-VL/SemanticVLA
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 39 of its 56 references that are in the map. First posted on arXiv 13 Nov 2025.
Builds on
39 of 56 references.
Closest ancestors · 6
Same direction, newest first
- 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
- 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation9 Jun
- 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 33
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2025Qwen3 Technical Reportcited by 8,820
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
21 more
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
- 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 103
- 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
- 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
- 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
- 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
- 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
- 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 53
- 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
- 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
- 2025Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulationcited by 24
- 2023SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Imagescited by 23
- 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
- 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11
Built on by
Citing papers per year: 2025: 2; 2026: 19.
21 papers.
Sort:
By area:
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
- 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learningcited by 17
- 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
- 2026The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Managementcited by 6
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 4
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
9 more
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
- 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoningcited by 1
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulationcited by 0
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflectioncited by 0
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Modelscited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026FailPatch: Failure Residual Patching for Vision-Language-Action Modelscited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Modelscited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models1 Oct 2026
- 2026FailPatch: Failure Residual Patching for Vision-Language-Action Models28 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models6 Sep 2026
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflection10 Aug 2026
- 2026The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management21 May 2026
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model21 May 2026
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action21 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulation7 May 2026
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality7 May 2026
9 more
- 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulation6 May 2026
- 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learning21 Apr 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoning18 Mar 2026
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation9 Mar 2026
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulation9 Mar 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2025HiconAgent: History Context-aware Policy Optimization for GUI Agents1 Dec 2025
- 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 4
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
- 2026TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulationcited by 0
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
- 2026FailPatch: Failure Residual Patching for Vision-Language-Action Modelscited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Modelscited by 0
- 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Models1 Oct 2026
- 2026FailPatch: Failure Residual Patching for Vision-Language-Action Models28 Sep 2026
- 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulation24 Sep 2026
- 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modeling10 Sep 2026
- 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Model21 May 2026
- 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Action21 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
- 2026TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulation7 May 2026
- 2026FASTER: Rethinking Real-Time Flow VLAs19 Mar 2026
- 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation9 Mar 2026
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulation9 Mar 2026
- 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challenges12 Dec 2025
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
- 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agents12 Mar 2026
- 2026The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Managementcited by 6
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
- 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoningcited by 1
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflectioncited by 0
- 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflection10 Aug 2026
- 2026The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Management21 May 2026
- 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality7 May 2026
- 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoning18 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model
- 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
- 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
- 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
- 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
- 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
- 2025IA-VLA: Input Augmentation for Vision-Language-Action models in settings with semantically complex tasks
- 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulation