mlsanityData to 14 Oct 2026

Tri-Info: Generalizable, Interpretable Failure Prediction for VLA Models via Information Theory

arXiv 2606.19998 ↗First posted 18 Jun 2026cs.RO cs.AI cs.CVcited by 3

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-Language-Action (VLA) models are increasingly deployed across diverse tasks, yet they remain black boxes whose physical interactions can cause irreversible harm, making generalizable and interpretable failure detection essential. We observe that successful and failed rollouts carry systematically different information-theoretic signatures. Building on this, we formalize VLA control as a closed-loop information pipeline and derive the Triple Information-theoretic (Tri-Info) signals that capture whether actions remain diverse, temporally consistent, and coupled to state transitions. Across six VLA models and three benchmark environments, Tri-Info matches the strongest baselines in-domain. Moreover, Tri-Info transfers across architectures, environments, and the sim-to-real gap without retraining with labeled data, reaching 70% accuracy on real-world tasks. This establishes Tri-Info as a simple yet powerful method that not only detects failures with strong cross-domain generalization, but also delivers interpretable diagnostics of the underlying failure modes.

Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 40 of its 55 references that are in the map. First posted on arXiv 18 Jun 2026.

Builds on

40 of 55 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun

Other references · 39

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,568
  10. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
  11. 2017Constrained Policy Optimizationcited by 983
  12. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
27 more
  1. 2018Diversity is All You Need: Learning Skills without a Reward Functioncited by 752
  2. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 584
  3. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 410
  4. 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
  5. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 364
  6. 2019Dynamics-Aware Unsupervised Discovery of Skillscited by 313
  7. 2020Recovery RL: Safe Reinforcement Learning with Learned Recovery Zonescited by 175
  8. 2015Variational Information Maximisation for Intrinsically Motivated Reinforcement Learningcited by 144
  9. 2017Trial without Error: Towards Safe Reinforcement Learning via Human Interventioncited by 103
  10. 2023Decomposing the Generalization Gap in Imitation Learning for Visual Robotic Manipulationcited by 82
  11. 2019InfoBot: Transfer and Exploration via the Information Bottleneckcited by 78
  12. 2024Unpacking Failure Modes of Generative Policies: Runtime Monitoring of Consistency and Progresscited by 69
  13. 2025FLOWER: Democratizing Generalist Robot Policies with Efficient Vision-Language-Action Flow Policiescited by 57
  14. 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policiescited by 52
  15. 2025Failure Prediction at Runtime for Generative Robot Policiescited by 42
  16. 2025Robot Data Curation with Mutual Information Estimatorscited by 37
  17. 2025Towards Robust and Secure Embodied AI: A Survey on Vulnerabilities and Attackscited by 34
  18. 2025Exploring the Limits of Vision-Language-Action Manipulations in Cross-task Generalizationcited by 33
  19. 2025ObjectVLA: End-to-End Open-World Object Manipulation Without Demonstrationcited by 20
  20. 2021The Importance of Being a Band: Finite-Sample Exact Distribution-Free Prediction Sets for Functional Datacited by 16
  21. 2025Rethinking Latent Redundancy in Behavior Cloning: An Information Bottleneck Approach for Robot Manipulationcited by 10
  22. 2026Interpretability Can Be Actionablecited by 7
  23. 2024MaxMI: A Maximal Mutual Information Criterion for Manipulation Concept Discoverycited by 5
  24. 2025Physically-based Lighting Generation for Robotic Manipulationcited by 5
  25. 2024Multimodal Information Bottleneck for Deep Reinforcement Learning with Multiple Sensorscited by 4
  26. 2025Behavior Synthesis via Contact-Aware Fisher Information Maximizationcited by 2
  27. 2025Information-Theoretic Graph Fusion with Vision-Language-Action Model for Policy Reasoning and Dual Robotic Controlcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring
  2. 2026How VLAs Fail Differently: Black-Box Action Monitoring Reveals Architecture-Specific Failure Signatures
  3. 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
  4. 2026FATE-VLA:Failue-aware test generation for vision-language-action models
  5. 2026CycleVLA: Proactive Self-Correcting Vision-Language-Action Models via Subtask Backtracking and Minimum Bayes Risk Decoding
  6. 2026VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
  7. 2026FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models
  8. 2026Revealing Interpretable Failure Modes of VLMs