FailPatch: Failure Residual Patching for Vision-Language-Action Models
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-Language-Action (VLA) policies are typically adapted using successful demonstrations, which provide direct action supervision but rarely cover failure-prone states. Deployment failures expose these states, yet lack the corrective actions needed for conventional supervised learning. We propose FailPatch, a failure-driven residual patching framework that decouples action supervision from execution-reliability supervision. Successful demonstrations ground how the policy should act, while deployment trajectories indicate when its behavior becomes unreliable. We further observe that action hidden representations exhibit clear linear separability between reliable and failure-associated states while directly conditioning action generation. Building on these insights, FailPatch introduces a Null-gated Residual Expert Bank into the action hidden space of a frozen VLA policy. A unified Preserve--Redirect--Trust objective retains the original policy in reliable states, selects residual experts in failure-associated states and redirects representations from failure regions toward success-associated regions under bounded intervention. With only 0.52% trainable parameters, FailPatch improves success rates by 11.0 percentage points on four long-horizon RoboTwin tasks under clean evaluation, 9.5 percentage points under clean-to-random generalization, and 16.7 percentage points over the baseline across three real-world tasks. Project and code: https://github.com/yupeng-2003/FailPatch.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 40 of its 51 references that are in the map. First posted on arXiv 28 Sep 2026.
Builds on
40 of 51 references.
Closest ancestors · 6
Same direction, newest first
- 2026FLARE: A Failure-Aware Framework for Autonomous Correction and Recovery in Visual-Language Robotic Manipulation27 Aug
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring29 May
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models8 May
- 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct
- 2025FPC-VLA: A Vision-Language-Action Framework with a Supervisor for Failure Prediction and Correction4 Sep
- 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun
Other references · 34
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
22 more
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2025SmolVLA: A Vision-Language-Action Model for Affordable and Efficient Roboticscited by 507
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 477
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2025π*0.6: a VLA That Learns From Experiencecited by 280
- 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 245
- 2025DexVLA: Vision-Language Model with Plug-In Diffusion Expert for General Robot Controlcited by 191
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2024RoboMamba: Efficient Vision-Language-Action Model for Robotic Reasoning and Manipulationcited by 102
- 2022Robot Learning on the Job: Human-in-the-Loop Autonomy and Learning During Deploymentcited by 101
- 2025VLA-Cache: Efficient Vision-Language-Action Manipulation via Adaptive Token Cachingcited by 83
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2025OTTER: A Vision-Language-Action Model with Text-Aware Visual Feature Extractioncited by 54
- 2025Long-VLA: Unleashing Long-Horizon Capability of Vision Language Action Model for Robot Manipulationcited by 48
- 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learningcited by 44
- 2026ACoT-VLA: Action Chain-of-Thought for Vision-Language-Action Modelscited by 30
- 2025SemanticVLA: Semantic-Aligned Sparsification and Enhancement for Efficient Robotic Manipulationcited by 20
- 2026SOP: A Scalable Online Post-Training System for Vision-Language-Action Modelscited by 19
- 2026VLA-Corrector: Lightweight Detect-and-Correct Inference for Adaptive Action Horizoncited by 14
- 2025TTF-VLA: Temporal Token Fusion via Pixel-Attention Integration for Vision-Language-Action Modelscited by 12
- 2026Learning While Deploying: Fleet-Scale Reinforcement Learning for Generalist Robot Policiescited by 12
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models
- 2026Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models
- 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
- 2026RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models
- 2026VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis
- 2026FATE-VLA:Failue-aware test generation for vision-language-action models
- 2026Where Success Breaks: Failure-Boundary Learning for Robust Vision-Language-Action Models
- 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control