VLA-Hijack: A Transferable Patch Attack against Vision-Language-Action Models via Visual Proprioception Hijacking
On the map: Vision-language-action models → Safety and adversarial attacks
Abstract (arXiv)
While Vision-Language-Action (VLA) models have emerged as powerful generalist policies, their severe vulnerability to adversarial patches significantly hinders their deployment in safety-critical domains. Moreover, existing patch attacks primarily focus on white-box settings, heavily overfitting to the specific action output space of the target model, which results in poor cross-architecture transferability. To overcome this limitation, we propose VLA-Hijack, a unified adversarial framework that breaks the transferability bottleneck by exploiting a fundamental vulnerability identified in this work: before planning any motion, a VLA model must first use visual information to locate its own robotic arm within the environment. Targeting this shared visual self-localization process, our approach concurrently optimizes Attention-Guided Proprioceptive Suppression to inhibit the real robotic arm's features, and Multimodal Proprioceptive Injection to establish the patch as a surrogate "phantom embodiment". By alternating between semantic concept anchoring and visual prototype projection, VLA-Hijack effectively severs the semantic relationship between the agent's true embodiment and its control policy. Extensive experiments across diverse architectures (OpenVLA, UniVLA, and CronusVLA) demonstrate that VLA-Hijack achieves superior optimization efficiency in white-box settings and sets a new SOTA for cross-architecture and cross-domain black-box transferability.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 34 of its 37 references that are in the map. First posted on arXiv 27 May 2026.
Builds on
34 of 37 references.
Closest ancestors · 12
Same direction, newest first
- 2026When Attention Betrays: Erasing Backdoor Attacks in Robotic Policies by Reconstructing Visual Tokens3 Feb
- 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning31 Jan
- 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Models20 Jan
- 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space7 Jan
- 2025Attention-Guided Patch-Wise Sparse Adversarial Attacks on Vision-Language-Action Models26 Nov
- 2025When Robots Obey the Patch: Universal Transferable Patch Attacks on Vision-Language-Action Models26 Nov
- 2025Phantom Menace: Exploring and Enhancing the Robustness of VLA Models Against Physical Sensor Attacks13 Nov
- 2025Model-agnostic Adversarial Attack and Defense for Vision-Language-Action Models15 Oct
- 2025Goal-oriented Backdoor Attack against Vision-Language-Action Models via Physical Objects10 Oct
- 2025BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization22 May
- 2025SafeVLA: Towards Safety Alignment of Vision-Language-Action Model via Constrained Learning5 Mar
- 2024Exploring the Adversarial Vulnerabilities of Vision-Language-Action Models in Robotics18 Nov
Other references · 22
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025SAM 3: Segment Anything with Conceptscited by 835
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024TinyVLA: Towards Fast, Data-Efficient Vision-Language-Action Models for Robotic Manipulationcited by 331
- 2023On Evaluating Adversarial Robustness of Large Vision-Language Modelscited by 281
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
10 more
- 2025InstructVLA: Vision-Language-Action Instruction Tuning from Understanding to Manipulationcited by 71
- 2020PatchAttack: A Black-box Texture-based Attack with Reinforcement Learningcited by 67
- 2021Evaluating the Robustness of Semantic Segmentation for Autonomous Driving against Real-World Adversarial Patch Attackscited by 55
- 2023Efficient Decision-based Black-box Patch Attacks on Video Recognitioncited by 21
- 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstrationcited by 20
- 2023Query-Efficient Decision-based Black-Box Patch Attackcited by 19
- 2025ADVEDM:Fine-grained Adversarial Attack against VLM-based Embodied Agentscited by 19
- 2025LingoLoop Attack: Trapping MLLMs via Linguistic Context and State Entrapment into Endless Loopscited by 9
- 2024Improving Adversarial Transferability of Vision-Language Pre-training Models through Collaborative Multimodal Interactioncited by 7
- 2024PG-Attack: A Precision-Guided Adversarial Attack Framework Against Vision Foundation Models for Autonomous Drivingcited by 4
Built on by
Citing papers per year: 2026: 3.
3 papers.
- 2026Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Modelscited by 0
- 2026UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Modelscited by 0
- 2026Beyond Patch Removal: Persistent Adversarial Effects in Vision-Language-Action Policiescited by 0
- 2026Beyond Patch Removal: Persistent Adversarial Effects in Vision-Language-Action Policies17 Sep 2026
- 2026UniTexture: Cross-Task Universal Adversarial Textures for Vision-Language-Action Models13 Aug 2026
- 2026Hidden in Plain Sight: Diffusion-Based Unrestricted Robotic Attacks on Vision-Language-Action Models11 Aug 2026
Similar, not cited
Close in wording, no citation either way
- 2026Partially Observable Adversarial Patch Attacks on Vision-Language-Action Models in Robotics
- 2026Structure-Aware Robust Fine-Tuning: Defending Vision-Language-Action Robots Against Physical Attention Hijacking
- 2025AttackVLA: Benchmarking Adversarial and Backdoor Attacks on Vision-Language-Action Models
- 2025Adversarial Attacks on Robotic Vision Language Action Models
- 2025FreezeVLA: Action-Freezing Attacks against Vision-Language-Action Models
- 2026ReViP: Mitigating False Completion in Vision-Language-Action Models with Vision-Proprioception Rebalance
- 2026SABER: A Stealthy Agentic Black-Box Attack Framework for Vision-Language-Action Models
- 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models