mlsanityData to 13 Oct 2026

Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models

arXiv 2605.08434 ↗First posted 8 May 2026cs.ROcited by 3

On the map: Vision-language-action models → Failure recovery and robustness

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors rapidly compound into unrecoverable, out-of-distribution failures. To address this limitation, we propose Adaptive Failure-Informed Learning (AFIL), an end-to-end framework that leverages failure trajectories as adaptive negative guidance for diffusion- and flow-based VLA policies. AFIL uses a pretrained VLA to generate failure rollouts online, avoiding the need for handcrafted failure-mode design or human-in-the-loop recovery. It then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone, enabling efficient failure-aware policy learning with limited parameter overhead. During sampling, the failure generator adaptively steers action generation away from failure-prone regions and toward more reliable success modes, with guidance strength determined by the per-diffusion-step distance between success and failure distributions. Experiments across in-domain and out-of-domain robotic manipulation tasks, covering both short- and long-horizon settings, show that AFIL consistently improves task success rates and robustness over existing VLA baselines, demonstrating its effectiveness, efficiency, and generality.

Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 43 of its 49 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

43 of 49 references.

Closest ancestors · 3

Same direction, newest first

  1. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct
  2. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun
  3. 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction18 May

Other references · 40

  1. 2020Denoising Diffusion Probabilistic Modelscited by 20,952
  2. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
  3. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,213
  4. 2022Classifier-Free Diffusion Guidancecited by 5,785
  5. 2022Flow Matching for Generative Modelingcited by 5,542
  6. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,022
  7. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
  8. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,760
  9. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,344
  10. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,052
  11. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,699
  12. 2024Octo: An Open-Source Generalist Robot Policycited by 1,450
28 more
  1. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,368
  2. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
  3. 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 704
  4. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
  5. 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 676
  6. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 656
  7. 2023Erasing Concepts from Diffusion Modelscited by 535
  8. 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 509
  9. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 446
  10. 2021Implicit Behavioral Cloningcited by 442
  11. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 343
  12. 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 316
  13. 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 286
  14. 2025π*0.6: a VLA That Learns From Experiencecited by 286
  15. 2023Imitating Human Behaviour with Diffusion Modelscited by 261
  16. 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 230
  17. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 220
  18. 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 155
  19. 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 145
  20. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 124
  21. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 121
  22. 2019Self-Supervised Correspondence in Visuomotor Policy Learningcited by 106
  23. 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 51
  24. 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 31
  25. 2019Exponential Family Estimation via Adversarial Dynamics Embeddingcited by 30
  26. 2024Dynamic Negative Guidance of Diffusion Modelscited by 28
  27. 2025LaVA-Man: Learning Visual Action Representations for Robot Manipulationcited by 3
  28. 2024Don't Yell at Your Robot: Physical Correction as the Collaborative Interface for Language Model Powered Robotscited by 1

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models
  2. 2025FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correction
  3. 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control
  4. 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
  5. 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
  6. 2026FATE-VLA:Failue-aware test generation for vision-language-action models
  7. 2026FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models
  8. 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Models