mlsanityData to 7 Oct 2026

GUARD: Grounding Uncertainty and Ablation-Based Risk Detection for Diffusion-Based VLAs

arXiv 2608.04510 ↗First posted 5 Aug 2026cs.RO cs.AIcited by 1

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Diffusion-based vision-language-action (VLA) policies can generate plausible actions even when their predictions are weakly grounded in the visual and language evidence defining the task. We introduce GUARD, a test-time failure detection method that measures this grounding without modifying the pretrained policy. GUARD estimates the influence of token-indexed entries in the final vision-language model key-value (KV) cache, constructs counterfactual caches by ablating salient KV entries, and compares their denoising responses with the original conditioning. Based on the comparison, we derive GUARD diagnostic stream including sensitivity, attention entropy, modality bias, and grounding efficiency, which are calibrated online and processed by a lightweight temporal classifier. We evaluate GUARD under task-held-out splits across five policy-benchmark settings, using Pi0, SmolVLA, and Alpamayo-1.5 on LIBERO, SimplerEnv, MetaWorld, and PhysicalAI-AV. GUARD achieves the best ROC-AUC on four of five unseen-task settings and ranks second on the remaining setting, improving the average unseen-task ROC-AUC by 5.73 percentage points over the strongest competing runtime monitor while remaining within 0.19 points of the best seen-task average. These results show that directly probing action-head dependence on multimodal evidence provides a transferable failure signal across policies, tasks, embodiments, and domains.

Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 27 of its 35 references that are in the map. First posted on arXiv 5 Aug 2026.

Builds on

27 of 35 references.

References · 27

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  2. 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  6. 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  10. 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
  11. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  12. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
15 more
  1. 2019Attention is not Explanationcited by 916
  2. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  3. 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
  4. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  5. 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
  6. 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
  7. 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
  8. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  9. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  10. 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 203
  11. 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
  12. 2013A Conformal Prediction Approach to Explore Functional Datacited by 85
  13. 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
  14. 2024Multi-Task Interactive Robot Fleet Learning with Visual World Modelscited by 33
  15. 2022Failure Prediction with Statistical Guarantees for Vision-Based Robot Controlcited by 21

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026CARE: Certifying Acceleration for Vision-Language-Action Inference
  2. 2026From Routing Signals to Selective Review: Visual regrounding in MoE VLMs
  3. 2026VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
  4. 2026Your Vision-Language-Action Model Already Has Attention Heads For Path Deviation Detection
  5. 2026TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks
  6. 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approach
  7. 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
  8. 2026GuardAlign: Test-time Safety Alignment in Multimodal Large Language Models