mlsanityData to 7 Oct 2026

Shifting Uncertainty to Critical Moments: Towards Reliable Uncertainty Quantification for VLA Model

arXiv 2603.18342 ↗First posted 18 Mar 2026cs.RO cs.AI cs.LGcited by 6

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-Language-Action (VLA) models enable general-purpose robotic policies by mapping visual observations and language instructions to low-level actions, but they often lack reliable introspection. A common practice is to compute a token-level uncertainty signal and take its mean over a rollout. However, mean aggregation can dilute short-lived but safety-critical uncertainty spikes in continuous control. In particular, successful rollouts may contain localized high-entropy segments due to benign noise or non-critical micro-adjustments, while failure rollouts can appear low-entropy for most timesteps and only exhibit brief spikes near the onset of failure. We propose a unified uncertainty quantification approach for predicting rollout success versus failure that (1) uses max-based sliding window pooling to preserve transient risk signals, (2) applies motion-aware stability weighting to emphasize high-frequency action oscillations associated with unstable behaviors, and (3) performs DoF-adaptive calibration via Bayesian Optimization to prioritize kinematically critical axes. Experiments on the LIBERO benchmark show that our method substantially improves failure prediction accuracy and yields more reliable signals for failure detection, which can support downstream human-in-the-loop interventions.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 18 of its 23 references that are in the map. First posted on arXiv 18 Mar 2026.

Builds on

18 of 23 references.

References · 18

  1. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  2. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  3. 2016A Baseline for Detecting Misclassified and Out-of-Distribution Examples in Neural Networkscited by 2,362
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  5. 2022Language Models (Mostly) Know What They Knowcited by 1,783
  6. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  7. 2023A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questionscited by 1,582
  8. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  9. 2023Semantic Uncertainty: Linguistic Invariances for Uncertainty Estimation in Natural Language Generationcited by 795
  10. 2018Deep Reinforcement Learning in a Handful of Trials using Probabilistic Dynamics Modelscited by 748
  11. 2023TD-MPC2: Scalable, Robust World Models for Continuous Controlcited by 482
  12. 2023Robots That Ask For Help: Uncertainty Alignment for Large Language Model Plannerscited by 298
6 more
  1. 2023Generating with Confidence: Uncertainty Quantification for Black-box Large Language Modelscited by 286
  2. 2025Frequency-Aligned Knowledge Distillation for Lightweight Spatiotemporal Forecastingcited by 53
  3. 2024Uncertainty Quantification for In-Context Learning of Large Language Modelscited by 45
  4. 2025Rethinking Jailbreak Detection of Large Vision Language Models with Representational Contrastive Scoringcited by 9
  5. 2025Discovering Knowledge Deficiencies of Language Models on Massive Knowledge Basecited by 6
  6. 2025Multi-Cache Enhanced Prototype Learning for Test-Time Generalization of Vision-Language Modelscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Perturbation-Based Epistemic Uncertainty for Failure Detection in Vision-Language-Action Models
  2. 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control
  3. 2026Uncertainty Quantification for Flow-Based Vision-Language-Action Models
  4. 2025Confidence Calibration in Vision-Language-Action Models
  5. 2026Reshaping Action Error Distributions for Reliable Vision-Language-Action Models
  6. 2026Temporal Difference Calibration in Sequential Tasks: Application to Vision-Language-Action Models
  7. 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Models
  8. 2026Taming VLAs under Robot Execution Errors: Self-Compensation and Stress Testing