mlsanityData to 7 Oct 2026

VLAMotor: Test-Guided Enhancement of Vision-Language-Action Models via Agent-BasedData Synthesis

arXiv 2606.00053 ↗First posted 16 May 2026cs.ROcited by 0

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-Language-Action (VLA) models follow a data-driven paradigm and are constrained by the coverage of training data, making them prone to failure on edge-case configurations after deployment. To mitigate such risks, it is essential to expose high-quality failure modes and convert the resulting failures into supervisory data for model enhancement. Existing studies largely stop at failure detection and lack a mechanism for leveraging discovered failures for model repair. We propose VLAMotor, the first analysis framework for VLA enhancement, which integrates distance-aware model testing for failure exposure and agent-based data synthesis for model finetunning. First, VLAMotor estimates input uncertainty based on the distance to training samples, and combines uncertainty ranking with redundancy elimination to build compact test sets that expose diverse failures. Then, VLAMotor abstracts failure trajectories into structured semantic representations, and plans parameterized repair-skill sequences, which are then realized as executable trajectories through inverse kinematics and motion execution. The resulting successful trajectories are automatically labeled and used to fine-tune the original VLA model, yielding an enhanced VLA model. Evaluation on four representative robotic manipulation tasks shows that 92.33% of the in-simulation test cases generated by VLAMotor trigger VLA failures, and VLAMotor improves test coverage over the state-of-the-art tool by 18.93%. By fine-tuning VLA models with synthetic data derived from failed test cases, VLAMotor further enhances the overall success rate of VLA models by 49.25%. When deployed on real hardware, the simulation-enhanced models improve the success rate over the original VLA models by 57.50%, demonstrating an effective and low-cost direction for VLA enhancement.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 29 of its 43 references that are in the map. First posted on arXiv 16 May 2026.

Builds on

29 of 43 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025VLA-Arena: An Open-Source Framework for Benchmarking Vision-Language-Action Models27 Dec
  2. 2025Diagnose, Correct, and Learn from Manipulation Failures via Visual Symbols2 Dec
  3. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models15 Oct
  4. 2025Evaluating Uncertainty and Quality of Vision-Language-Action-enabled Robots22 Jul

Other references · 25

  1. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  2. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  3. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  4. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  5. 2024A Survey on Vision-Language-Action Models for Embodied AIcited by 274
  6. 2018To Trust Or Not To Trust A Classifiercited by 205
  7. 2018Deep k-Nearest Neighbors: Towards Confident, Interpretable and Robust Deep Learningcited by 203
  8. 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
  9. 2025From Human Memory to AI Memory: A Survey on Memory Mechanisms in the Era of LLMscited by 119
  10. 2019Analyzing and Improving Representations with the Soft Nearest Neighbor Losscited by 95
  11. 2019Detecting Adversarial Samples Using Influence Functions and Nearest Neighborscited by 72
  12. 2025Large VLM-based Vision-Language-Action Models for Robotic Manipulation: A Surveycited by 66
13 more
  1. 2024VLM Agents Generate Their Own Memories: Distilling Experience into Embodied Programs of Thoughtcited by 55
  2. 2024A Survey on Robotics with Foundation Models: toward Embodied AIcited by 53
  3. 2024VLATest: Testing and Evaluating Vision-Language-Action Models for Robotic Manipulationcited by 43
  4. 2021RobOT: Robustness-Oriented Testing for Deep Learning Systemscited by 27
  5. 2025Efficient Vision-Language-Action Models for Embodied Manipulation: A Systematic Surveycited by 25
  6. 2025Eva-VLA: Evaluating Vision-Language-Action Models' Robustness Under Real-World Physical Variationscited by 24
  7. 2025Generative Artificial Intelligence in Robotic Manipulation: A Surveycited by 16
  8. 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Modelscited by 16
  9. 2019There is Limited Correlation between Coverage and Robustness for Deep Neural Networkscited by 8
  10. 2022Black-box Safety Analysis and Retraining of DNNs based on Feature Extraction and Clusteringcited by 8
  11. 2024Search-based DNN Testing and Retraining with GAN-enhanced Simulationscited by 7
  12. 2020Calibrated neighborhood aware confidence measure for deep metric learningcited by 3
  13. 2024In-Simulation Testing of Deep Learning Vision Models in Autonomous Robotic Manipulatorscited by 2

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026FATE-VLA:Failue-aware test generation for vision-language-action models
  2. 2026VLA-FAIL: Efficient Task Failure Detection for Finetuned Vision-Language-Action Models
  3. 2026FailPatch: Failure Residual Patching for Vision-Language-Action Models
  4. 2026Look Before You Leap: Distilling Tree Search into Action Evaluation for Frozen VLA Models
  5. 2025Steering Vision-Language-Action Models as Anti-Exploration: A Test-Time Scaling Approach
  6. 2026Training-Free Action Correction for VLA Model Failures via Language Feedback
  7. 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models
  8. 2026FailureSpot: Label-Efficient Timestamp-Level Failure Detection for Vision-Language-Action Models