mlsanityData to 7 Oct 2026

When Attention Betrays: Erasing Backdoor Attacks in Robotic Policies by Reconstructing Visual Tokens

arXiv 2602.03153 ↗First posted 3 Feb 2026cs.ROcited by 4

On the map: Vision-language-action models → Safety and adversarial attacks

Abstract (arXiv)

Downstream fine-tuning of vision-language-action (VLA) models enhances robotics, yet exposes the pipeline to backdoor risks. Attackers can pretrain VLAs on poisoned data to implant backdoors that remain stealthy but can trigger harmful behavior during inference. However, existing defenses either lack mechanistic insight into multimodal backdoors or impose prohibitive computational costs via full-model retraining. To this end, we uncover a deep-layer attention grabbing mechanism: backdoors redirect late-stage attention and form compact embedding clusters near the clean manifold. Leveraging this insight, we introduce Bera, a test-time backdoor erasure framework that detects tokens with anomalous attention via latent-space localization, masks suspicious regions using deep-layer cues, and reconstructs a trigger-free image to break the trigger-unsafe-action mapping while restoring correct behavior. Unlike prior defenses, Bera requires neither retraining of VLAs nor any changes to the training pipeline. Extensive experiments across multiple embodied platforms and tasks show that Bera effectively maintains nominal performance, significantly reduces attack success rates, and consistently restores benign behavior from backdoored outputs, thereby offering a robust and practical defense mechanism for securing robotic systems.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 32 of its 38 references that are in the map. First posted on arXiv 3 Feb 2026.

Builds on

32 of 38 references.

References · 32

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  2. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,219
  5. 2017BadNets: Identifying Vulnerabilities in the Machine Learning Model Supply Chaincited by 1,052
  6. 2017Targeted Backdoor Attacks on Deep Learning Systems Using Data Poisoningcited by 1,012
  7. 2024SparseVLM: Visual Token Sparsification for Efficient Vision-Language Model Inferencecited by 378
  8. 2020Reflection Backdoor: A Natural Backdoor Attack on Deep Neural Networkscited by 341
  9. 2020Input-Aware Dynamic Backdoor Attackcited by 304
  10. 2022Backdoor Defense via Decoupling the Training Processcited by 149
  11. 2020Backdoor Attacks Against Deep Learning Systems in the Physical Worldcited by 129
  12. 2025DexGraspVLA: A Vision-Language-Action Framework Towards General Dexterous Graspingcited by 87
20 more
  1. 2024VL-Trojan: Multimodal Instruction Backdoor Attacks against Autoregressive Visual Language Modelscited by 83
  2. 2025A Survey of Safety on Large Vision-Language Models: Attacks, Defenses and Evaluationscited by 66
  3. 2023Black-box Backdoor Defense via Zero-shot Image Purificationcited by 44
  4. 2023UNICORN: A Unified Backdoor Trigger Inversion Frameworkcited by 44
  5. 2025Backdoor Cleaning without External Guidance in MLLM Fine-tuningcited by 34
  6. 2024CROW: Eliminating Backdoors from Large Language Models via Internal Consistency Regularizationcited by 29
  7. 2023Robust and Versatile Bipedal Jumping Control through Reinforcement Learningcited by 27
  8. 2022Hardly Perceptible Trojan Attack against Neural Networks with Bit Flipscited by 21
  9. 2024Unlearning Backdoor Attacks for LLMs with Weak-to-Strong Knowledge Distillationcited by 21
  10. 2025REFINE: Inversion-Free Backdoor Defense via Model Reprogrammingcited by 20
  11. 2025Keeping Yourself is Important in Downstream Tuning Multimodal Large Language Modelcited by 15
  12. 2025BadToken: Token-level Backdoor Attacks to Multi-modal Large Language Modelscited by 15
  13. 2023Beating Backdoor Attack at Its Own Gamecited by 11
  14. 2025LoRASculpt: Sculpting LoRA for Harmonizing General and Specialized Knowledge in Multimodal Large Language Modelscited by 11
  15. 2023Activation Gradient based Poisoned Sample Detection Against Backdoor Attackscited by 9
  16. 2025SRD: Reinforcement-Learned Semantic Perturbation for Backdoor Defense in VLMscited by 9
  17. 2024DeDe: Detecting Backdoor Samples for SSL Encoders via Decoderscited by 6
  18. 2024Guided Self-attention: Find the Generalized Necessarily Distinct Vectors for Grain Size Gradingcited by 1
  19. 2024PBP: Post-training Backdoor Purification for Malware Classifierscited by 1
  20. 2025RGMP: Recurrent Geometric-prior Multimodal Policy for Generalizable Humanoid Robot Manipulationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Test-Time Attention Purification for Backdoored Large Vision Language Models
  2. 2026Inject Once Survive Later: Backdooring Vision-Language-Action Models to Persist Through Downstream Fine-tuning
  3. 2025DropVLA: An Action-Level Backdoor Attack on Vision-Language-Action Models
  4. 2026TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks
  5. 2026State Backdoor: Towards Stealthy Real-world Poisoning Attack on Vision-Language-Action Model in State Space
  6. 2025BadVLA: Towards Backdoor Attacks on Vision-Language-Action Models via Objective-Decoupled Optimization
  7. 2026SilentDrift: Exploiting Action Chunking for Stealthy Backdoor Attacks on Vision-Language-Action Models
  8. 2026EntropyScan: Towards Model-level Backdoor Detection in LVLMs via Visual Attention Entropy