GUARD: Grounding Uncertainty and Ablation-Based Risk Detection for Diffusion-Based VLAs
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Diffusion-based vision-language-action (VLA) policies can generate plausible actions even when their predictions are weakly grounded in the visual and language evidence defining the task. We introduce GUARD, a test-time failure detection method that measures this grounding without modifying the pretrained policy. GUARD estimates the influence of token-indexed entries in the final vision-language model key-value (KV) cache, constructs counterfactual caches by ablating salient KV entries, and compares their denoising responses with the original conditioning. Based on the comparison, we derive GUARD diagnostic stream including sensitivity, attention entropy, modality bias, and grounding efficiency, which are calibrated online and processed by a lightweight temporal classifier. We evaluate GUARD under task-held-out splits across five policy-benchmark settings, using Pi0, SmolVLA, and Alpamayo-1.5 on LIBERO, SimplerEnv, MetaWorld, and PhysicalAI-AV. GUARD achieves the best ROC-AUC on four of five unseen-task settings and ranks second on the remaining setting, improving the average unseen-task ROC-AUC by 5.73 percentage points over the strongest competing runtime monitor while remaining within 0.19 points of the best seen-task average. These results show that directly probing action-head dependence on multimodal evidence provides a transferable failure signal across policies, tasks, embodiments, and domains.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 27 of its 35 references that are in the map. First posted on arXiv 5 Aug 2026.
Builds on
27 of 35 references.
References · 27
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2018A Simple Unified Framework for Detecting Out-of-Distribution Samples and Adversarial Attackscited by 1,472
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
15 more
- 2019Attention is not Explanationcited by 916
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2021A Gentle Introduction to Conformal Prediction and Distribution-Free Uncertainty Quantificationcited by 777
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2023BridgeData V2: A Dataset for Robot Learning at Scalecited by 634
- 2017Interpretable Explanations of Black Boxes by Meaningful Perturbationcited by 611
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 203
- 2025Alpamayo-R1: Bridging Reasoning and Action Prediction for Generalizable Autonomous Driving in the Long Tailcited by 136
- 2013A Conformal Prediction Approach to Explore Functional Datacited by 85
- 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 63
- 2024Multi-Task Interactive Robot Fleet Learning with Visual World Modelscited by 33
- 2022Failure Prediction with Statistical Guarantees for Vision-Based Robot Controlcited by 21
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026CARE: Certifying Acceleration for Vision-Language-Action Inference
- 2026From Routing Signals to Selective Review: Visual regrounding in MoE VLMs
- 2026VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
- 2026Your Vision-Language-Action Model Already Has Attention Heads For Path Deviation Detection
- 2026TMT: Runtime Backdoor Detection for Vision-Language-Action Policies on Unseen Tasks
- 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approach
- 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
- 2026GuardAlign: Test-time Safety Alignment in Multimodal Large Language Models