mlsanityData to 14 Oct 2026

SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation

arXiv 2511.10518 ↗First posted 13 Nov 2025cs.CV cs.ROcited by 21

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Vision-Language-Action (VLA) models have advanced in robotic manipulation, yet practical deployment remains hindered by two key limitations: 1) perceptual redundancy, where irrelevant visual inputs are processed inefficiently, and 2) superficial instruction-vision alignment, which hampers semantic grounding of actions. In this paper, we propose SemanticVLA, a novel VLA framework that performs Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulation. Specifically: 1) To sparsify redundant perception while preserving semantic alignment, Semantic-guided Dual Visual Pruner (SD-Pruner) performs: Instruction-driven Pruner (ID-Pruner) extracts global action cues and local semantic anchors in SigLIP; Spatial-aggregation Pruner (SA-Pruner) compacts geometry-rich features into task-adaptive tokens in DINOv2. 2) To exploit sparsified features and integrate semantics with spatial geometry, Semantic-complementary Hierarchical Fuser (SH-Fuser) fuses dense patches and sparse tokens across SigLIP and DINOv2 for coherent representation. 3) To enhance the transformation from perception to action, Semantic-conditioned Action Coupler (SA-Coupler) replaces the conventional observation-to-DoF approach, yielding more efficient and interpretable behavior modeling for manipulation tasks. Extensive experiments on simulation and real-world tasks show that SemanticVLA sets a new SOTA in both performance and efficiency. SemanticVLA surpasses OpenVLA on LIBERO benchmark by 21.1% in success rate, while reducing training cost and inference latency by 3.0-fold and 2.7-fold.SemanticVLA is open-sourced and publicly available at https://github.com/JiuTian-VL/SemanticVLA

Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 39 of its 56 references that are in the map. First posted on arXiv 13 Nov 2025.

Builds on

39 of 56 references.

Closest ancestors · 6

Same direction, newest first

  1. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
  2. 2025BitVLA: 1-bit Vision-Language-Action Models for Robotics Manipulation9 Jun
  3. 2025MoLe-VLA: Dynamic Layer-skipping Vision Language Action Model via Mixture-of-Layers for Efficient Robot Manipulation26 Mar
  4. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model13 Mar
  5. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan

Other references · 33

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  5. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  6. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  7. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  8. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  9. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  10. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
21 more
  1. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  3. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 530
  4. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  5. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 451
  6. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  7. 2024Mobile ALOHA: Learning Bimanual Mobile Manipulation with Low-Cost Whole-Body Teleoperationcited by 391
  8. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 117
  9. 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 103
  10. 2023Detecting and Grounding Multi-Modal Media Manipulationcited by 99
  11. 2023LION : Empowering Multimodal Large Language Model with Dual-Level Visual Knowledgecited by 81
  12. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 69
  13. 2025LION-FS: Fast & Slow Video-Language Thinker as Online Video Assistantcited by 58
  14. 2023Detecting and Grounding Multi-Modal Media Manipulation and Beyondcited by 56
  15. 2024QueST: Self-Supervised Skill Abstractions for Learning Continuous Controlcited by 53
  16. 2025VLAS: Vision-Language-Action Model With Speech Instructions For Customized Robot Manipulationcited by 51
  17. 2025Optimus-2: Multimodal Minecraft Agent with Goal-Observation-Action Conditioned Policycited by 25
  18. 2025Spatial-Temporal Graph Diffusion Policy with Kinematic Modeling for Bimanual Robotic Manipulationcited by 24
  19. 2023SyreaNet: A Physically Guided Underwater Image Enhancement Framework Integrating Synthetic and Real Imagescited by 23
  20. 2025FALCON: Resolving Visual Redundancy and Fragmentation in High-resolution Multimodal Large Language Models via Visual Registerscited by 20
  21. 2025PUMA: Layer-Pruned Language Model for Efficient Unified Multimodal Retrieval with Modality-Adaptive Learningcited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 2; 2026: 19.

21 papers.

Sort:

By area:

  1. 2026FASTER: Rethinking Real-Time Flow VLAscited by 21
  2. 2026Mask World Model: Predicting What Matters for Robust Robot Policy Learningcited by 17
  3. 2025HiconAgent: History Context-aware Policy Optimization for GUI Agentscited by 13
  4. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variationcited by 10
  5. 2026HATS: Hardness-Aware Trajectory Synthesis for GUI Agentscited by 9
  6. 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
  7. 2026ConsisVLA-4D: Advancing Spatiotemporal Consistency in Efficient 3D-Perception and 4D-Reasoning for Robotic Manipulationcited by 6
  8. 2026From Abstraction to Instantiation: Learning Behavioral Representation for Vision-Language-Action Modelcited by 6
  9. 2026The Efficiency Frontier: A Unified Framework for Cost-Performance Optimization in LLM Context Managementcited by 6
  10. 2025An Anatomy of Vision-Language-Action Models: From Modules to Milestones and Challengescited by 4
  11. 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 4
  12. 2026Spatial Memory for Out-of-Vision Manipulation in Vision-Language-Actioncited by 4
9 more
  1. 2026MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonalitycited by 3
  2. 2026Interpretable Traffic Responsibility from Dashcam Video via Legal Multi Agent Reasoningcited by 1
  3. 2026UniMPA: A Unified Memory-Prediction-Action Model via Action-Grounded Transition Modelingcited by 1
  4. 2026TriRelVLA: Triadic Relational Structure for Generalizable Embodied Manipulationcited by 0
  5. 2026LookAgain: Closed-Loop GUI Grounding with Visually Grounded Reflectioncited by 0
  6. 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Modelscited by 0
  7. 2026ActGaze: Learning Action-Grounded Gaze through Counterfactual Visual Interventions for High-Precision Manipulationcited by 0
  8. 2026FailPatch: Failure Residual Patching for Vision-Language-Action Modelscited by 0
  9. 2026World-Calibrated Proposal-to-Action Flow for Vision-Language-Action Modelscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Model
  2. 2026DTP: A Simple yet Effective Distracting Token Pruning Framework for Vision-Language Action Models
  3. 2026VLA-ACL: Action-Consistent Visual Token Pruning for Efficient Vision-Language-Action Models
  4. 2026V-Link: Recovering Lost Visual Representations in Action DiT for Vision-Language-Action Models
  5. 2025Bridging the Semantic-Action Gap in Visual Token Pruning for Efficient VLA Inference
  6. 2026Look Before Acting: Enhancing Vision Foundation Representations for Vision-Language-Action Models
  7. 2025IA-VLA: Input Augmentation for Vision-Language-Action models in settings with semantically complex tasks
  8. 2025Action-aware Dynamic Pruning for Efficient Vision-Language-Action Manipulation