Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-language-action (VLA) models provide a promising paradigm for scalable robotic manipulation, yet their reliance on success-only behavioral cloning leaves them brittle; lacking corrective training signals, minor execution errors rapidly compound into unrecoverable, out-of-distribution failures. To address this limitation, we propose Adaptive Failure-Informed Learning (AFIL), an end-to-end framework that leverages failure trajectories as adaptive negative guidance for diffusion- and flow-based VLA policies. AFIL uses a pretrained VLA to generate failure rollouts online, avoiding the need for handcrafted failure-mode design or human-in-the-loop recovery. It then jointly trains Dual Action Generators (DAGs) for successful and failed behaviors while sharing a common vision-language backbone, enabling efficient failure-aware policy learning with limited parameter overhead. During sampling, the failure generator adaptively steers action generation away from failure-prone regions and toward more reliable success modes, with guidance strength determined by the per-diffusion-step distance between success and failure distributions. Experiments across in-domain and out-of-domain robotic manipulation tasks, covering both short- and long-horizon settings, show that AFIL consistently improves task success rates and robustness over existing VLA baselines, demonstrating its effectiveness, efficiency, and generality.
Key facts. Cited by 3 papers in the map (data through 13 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 43 of its 49 references that are in the map. First posted on arXiv 8 May 2026.
Builds on
43 of 49 references.
Closest ancestors · 3
Same direction, newest first
- 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct
- 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun
- 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction18 May
Other references · 40
- 2020Denoising Diffusion Probabilistic Modelscited by 20,952
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,777
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,213
- 2022Classifier-Free Diffusion Guidancecited by 5,785
- 2022Flow Matching for Generative Modelingcited by 5,542
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,022
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,823
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,760
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,344
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,052
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,699
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,450
28 more
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,368
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 857
- 2021What Matters in Learning from Offline Human Demonstrations for Robot Manipulationcited by 704
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 678
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 676
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 656
- 2023Erasing Concepts from Diffusion Modelscited by 535
- 2022Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Modelscited by 509
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 446
- 2021Implicit Behavioral Cloningcited by 442
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 343
- 2023ManiSkill2: A Unified Benchmark for Generalizable Manipulation Skillscited by 316
- 2017Deep Imitation Learning for Complex Manipulation Tasks from Virtual Reality Teleoperationcited by 286
- 2025π*0.6: a VLA That Learns From Experiencecited by 286
- 2023Imitating Human Behaviour with Diffusion Modelscited by 261
- 2023Goal-Conditioned Imitation Learning using Score-based Diffusion Policiescited by 230
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 220
- 2024Deep Reinforcement Learning for Robotics: A Survey of Real-World Successescited by 155
- 2024CFG++: Manifold-constrained Classifier Free Guidance for Diffusion Modelscited by 145
- 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 124
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 121
- 2019Self-Supervised Correspondence in Visuomotor Policy Learningcited by 106
- 2022SpeedFolding: Learning Efficient Bimanual Folding of Garmentscited by 51
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 31
- 2019Exponential Family Estimation via Adversarial Dynamics Embeddingcited by 30
- 2024Dynamic Negative Guidance of Diffusion Modelscited by 28
- 2025LaVA-Man: Learning Visual Action Representations for Robot Manipulationcited by 3
- 2024Don't Yell at Your Robot: Physical Correction as the Collaborative Interface for Language Model Powered Robotscited by 1
Built on by
Citing papers per year: 2026: 3.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models
- 2025FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correction
- 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control
- 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
- 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
- 2026FATE-VLA:Failue-aware test generation for vision-language-action models
- 2026FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models
- 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Models