mlsanityData to 14 Oct 2026

Where Success Breaks: Failure-Boundary Learning for Robust Vision-Language-Action Models

arXiv 2609.06114 ↗First posted 5 Sep 2026cs.ROcited by 0

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-language-action (VLA) models adapted through supervised fine-tuning (SFT) inherit a structural asymmetry: expert demonstrations teach the policy where success behavior lies, but provide no signal about where it ceases to be reliable. We argue that robust VLA adaptation should therefore be viewed not as further demonstration fitting, but as Failure-Boundary Learning -- the problem of Discovering, Localizing, and Shaping the boundary between recoverable deviations and task failure. To instantiate this view, we propose DLS: built on a real-grounded behavioral prior from few real demonstrations and simulated co-training, DLS discovers failure boundaries at scale through on-policy digital twin rollouts. Rather than reducing each rollout to a binary label, semantic progress localization uses privileged simulator states to assign progress-aware signals that capture where the failure boundary is crossed, not merely whether. These signals drive directional boundary shaping in the flow dynamics -- reinforcing success-producing denoising directions and suppressing failure-producing ones, without action likelihoods or auxiliary critics. Across real-robot manipulation tasks, DLS improves robustness over SFT and online RL baselines, especially under randomized initial states and unseen visual conditions.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 58 of its 64 references that are in the map. First posted on arXiv 5 Sep 2026.

Builds on

58 of 64 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct

Other references · 57

  1. 2023Direct Preference Optimization: Your Language Model is Secretly a Reward Modelcited by 8,065
  2. 2022Flow Matching for Generative Modelingcited by 5,702
  3. 2016Overcoming catastrophic forgetting in neural networkscited by 4,787
  4. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 3,080
  5. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  7. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,061
  8. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
  9. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,484
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
38 more
  1. 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
  2. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 422
  3. 2020Sim-to-Real Transfer in Deep Reinforcement Learning for Robotics: a Surveycited by 413
  4. 2024RoboCasa: Large-Scale Simulation of Everyday Tasks for Generalist Robotscited by 407
  5. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  6. 2023MimicGen: A Data Generation System for Scalable Robot Learning using Human Demonstrationscited by 327
  7. 2025π*0.6: a VLA That Learns From Experiencecited by 303
  8. 2023Aligning Text-to-Image Diffusion Models with Reward Backpropagationcited by 288
  9. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 230
  10. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 229
  11. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 213
  12. 2025SimpleVLA-RL: Scaling VLA Training via Reinforcement Learningcited by 151
  13. 2024SERL: A Software Suite for Sample-Efficient Robotic Reinforcement Learningcited by 136
  14. 2024GRAPE: Generalizing Robot Policy via Preference Alignmentcited by 109
  15. 2025What Can RL Bring to VLA Generalization? An Empirical Studycited by 108
  16. 2025ReinFlow: Fine-tuning Flow Matching Policy with Online Reinforcement Learningcited by 97
  17. 2024TRANSIC: Sim-to-Real Policy Transfer by Learning from Online Correctioncited by 59
  18. 2024Plan-Seq-Learn: Language Model Guided RL for Solving Long Horizon Robotics Taskscited by 52
  19. 2025Can We Detect Failures Without Failure Data? Uncertainty-Aware Runtime Failure Detection for Imitation Learning Policiescited by 52
  20. 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learningcited by 47
  21. 2025Sim-and-Real Co-Training: A Simple Recipe for Vision-Based Robotic Manipulationcited by 46
  22. 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulationcited by 45
  23. 2025SARM: Stage-Aware Reward Modeling for Long Horizon Robot Manipulationcited by 42
  24. 2025Failure Prediction at Runtime for Generative Robot Policiescited by 42
  25. 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 41
  26. 2025Much Ado About Noising: Dispelling the Myths of Generative Robotic Controlcited by 36
  27. 2025Don't Blind Your VLA: Aligning Visual Representations for OOD Generalizationcited by 35
  28. 2025STARE-VLA: Progressive Stage-Aware Reinforcement for Fine-Tuning Vision-Language-Action Modelscited by 24
  29. 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedbackcited by 20
  30. 2025RoboHorizon: An LLM-Assisted Multi-View World Model for Long-Horizon Robotic Manipulationcited by 19
  31. 2025GSWorld: Closed-Loop Photo-Realistic Simulation Suite for Robotic Manipulationcited by 19
  32. 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Modelscited by 18
  33. 2025Parallels Between VLA Model Post-Training and Human Motor Learning: Progress, Challenges, and Trendscited by 17
  34. 2025Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correctioncited by 16
  35. 2024Stage-Wise Reward Shaping for Acrobatic Robots: A Constrained Multi-Objective Reinforcement Learning Approachcited by 13
  36. 2025I-FailSense: Towards General Robotic Failure Detection with Vision-Language Modelscited by 12
  37. 2025Multi-Stage Manipulation with Demonstration-Augmented Reward, Policy, and World Model Learningcited by 11
  38. 2025Guardian: Detecting Robotic Planning and Execution Errors with Vision-Language Modelscited by 9

50 most cited of 57 All 57 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models
  2. 2026FailPatch: Failure Residual Patching for Vision-Language-Action Models
  3. 2026WorldGuide: Learning Success-Failure Boundaries in Latent World Models for Vision-Language-Action Policies
  4. 2026RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models
  5. 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models
  6. 2026VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
  7. 2026FATE-VLA:Failue-aware test generation for vision-language-action models
  8. 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models