mlsanityData to 7 Oct 2026

Multi-Link Safety Filtering for VLA Policies Around Moving Hazards

arXiv 2609.40007 ↗First posted 30 Sep 2026cs.RO cs.CVcited by 0

On the map: Vision-language-action models → Safety and adversarial attacks

Abstract (arXiv)

A vision-language-action (VLA) policy can finish a manipulation task while knocking over objects unrelated to it, so task success alone does not show that the policy is safe to deploy in clutter. We study how to keep a pretrained VLA policy clear of such hazards at run time without retraining it, which requires guarding more of the arm than the end effector, following the hazard as it moves, and sharing onboard compute with the policy. Our training-free shield covers the gripper, wrist, and forearm with five ellipsoids and filters every commanded motion through one barrier program against a keep-out ellipsoid fitted from RGB-D perception at reset. Sparse optical flow then carries that ellipsoid's center along with the hazard, with no repeated detection or refitting. Over six simulated hazard-motion conditions, the shield lowers collision from 65.62% to 27.27% and raises safe-success, task completion without collision, from 29.35% to 50.43%. Ablations show that guarding the arm links protects beyond end-effector shielding, and that tracking recovers most of the protection lost when the hazard estimate is frozen at reset. On heterogeneous edge hardware, the five-ellipsoid barrier runs on the CPU in 2.2~ms at the 99th percentile, and trimming the vision--language prefix and taking fewer flow-matching steps shortens each π0.5 policy call on the integrated GPU from 343 to 177.3~ms. On a physical SO-101 arm across four tasks, the arm touched the hazard in 3 of 16 shielded episodes versus 11 of 16 unshielded ones. Project page: https://yathag.github.io/multilink-safety-filter/

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Safety and adversarial attacks, one of 13 directions in Vision-language-action models. Builds on 24 of its 27 references that are in the map. First posted on arXiv 30 Sep 2026.

Builds on

24 of 27 references.

Closest ancestors · 5

Same direction, newest first

  1. 2026Safe Vision Language Action Models via Barrier Enhanced Flow Matching31 Jul
  2. 2026Neuro-Symbolic Safety Guidance for Vision-Language-Action Models via Constrained Flow Matching1 Jul
  3. 2026LIBERO-Safety: A Comprehensive Benchmark for Physical and Semantic Safety in Vision-Language-Action Models22 Jun
  4. 2026Your Model Already Knows: Attention-Guided Safety Filter for Vision-Language-Action Models8 Jun
  5. 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layer9 Dec

Other references · 19

  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024SAM 2: Segment Anything in Images and Videoscited by 2,784
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  8. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  9. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  10. 2019Control Barrier Functions: Theory and Applicationscited by 332
  11. 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
  12. 2020Guaranteeing Safety of Learned Perception Modules via Measurement-Robust Control Barrier Functionscited by 32
7 more
  1. 2026QuantVLA: Scale-Calibrated Post-Training Quantization for Vision-Language-Action Modelscited by 25
  2. 2025EdgeVLA: Efficient Vision-Language-Action Modelscited by 19
  3. 2025Safe, Task-Consistent Manipulation with Operational Space Control Barrier Functionscited by 10
  4. 2026Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deploymentcited by 6
  5. 2026BFA++: Hierarchical Best-Feature-Aware Token Prune for Multi-View Vision Language Action Modelcited by 3
  6. 2023Collision Avoidance for Ellipsoidal Rigid Bodies with Control Barrier Functions Designed from Rotating Supporting Hyperplanescited by 2
  7. 2026Any-Body Guard: Universal Safeguarding for Manipulation Policies via Action Maskingcited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policies
  2. 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency
  3. 2026ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Models
  4. 2026SafeVLA-Bench: A Benchmark for the Success-Safety Gap in Vision-Language-Action Models
  5. 2026ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
  6. 2026SafeLoop: Risk-Aware Rollback for Vision-Language-Action Manipulation
  7. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models
  8. 2026HazardArena: Evaluating Semantic Safety in Vision-Language-Action Models