DreamAvoid: Critical-Phase Test-Time Dreaming to Avoid Failures in VLA Policies
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-Language-Action (VLA) models are often brittle in fine-grained manipulation, where minor action errors during the critical phases can rapidly escalate into irrecoverable failures. Since existing VLA models rely predominantly on successful demonstrations for training, they lack an explicit awareness of failure during these critical phases. To address this, we propose DreamAvoid, a critical-phase test-time dreaming framework that enables VLA models to anticipate and avoid failures. We also introduce an autonomous boundary learning paradigm to refine the system's understanding of the subtle boundary between success and failure. Specifically, we (1) utilize a Dream Trigger to determine whether the execution has entered a critical phase, (2) sample multiple candidate action chunks from the VLA via an Action Proposer, and (3) employ a Dream Evaluator, jointly trained on mixed data (success, failure, and boundary cases), to "dream" the short-horizon futures corresponding to the candidate actions, evaluate their values, and select the optimal action. We conduct extensive evaluations on real-world manipulation tasks and simulation benchmarks. The results demonstrate that DreamAvoid can effectively avoid failures, thereby improving the overall task success rate. Across four real-world tasks, DreamAvoid achieves 72.5% success, compared with 48.8% for the base policy and 54.4% for GPC-RANK. Our code is available at https://github.com/XianzheFan/DreamAvoid.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 35 of its 39 references that are in the map. First posted on arXiv 12 May 2026.
Builds on
35 of 39 references.
Closest ancestors · 1
Same direction, newest first
Other references · 34
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,887
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,838
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,761
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,410
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
- 2025Flow-GRPO: Training Flow Matching Models via Online RLcited by 661
- 2025Self Forcing: Bridging the Train-Test Gap in Autoregressive Video Diffusioncited by 625
- 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 495
22 more
- 2026World Action Models are Zero-shot Policiescited by 465
- 2016Deep Visual Foresight for Planning Robot Motioncited by 285
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 175
- 2026DreamDojo: A Generalist Robot World Model from Large-Scale Human Videoscited by 135
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 125
- 2025RoboMonkey: Scaling Test-Time Sampling and Verification for Vision-Language-Action Modelscited by 61
- 2026Robometer: Scaling General-Purpose Robotic Reward Models via Trajectory Comparisonscited by 60
- 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Modelscited by 49
- 2025Reflective Planning: Vision-Language Models for Multi-Stage Long-Horizon Robotic Manipulationcited by 42
- 2026VLAW: Iterative Co-Improvement of Vision-Language-Action Policy and World Modelcited by 41
- 2025VLSA: Vision-Language-Action Models with Plug-and-Play Safety Constraint Layercited by 34
- 2025Inference-Time Enhancement of Generative Robot Policies via Predictive World Modelingcited by 24
- 2025EVOLVE-VLA: Test-Time Training from Environment Feedback for Vision-Language-Action Modelscited by 22
- 2026Recurrent-Depth VLA: Implicit Test-Time Compute Scaling of Vision-Language-Action Models via Latent Iterative Reasoningcited by 18
- 2026PlayWorld: Learning Robot World Models from Autonomous Playcited by 18
- 2024Learning from Imperfect Demonstrations with Self-Supervision for Robotic Manipulationcited by 14
- 2026On-the-Fly VLA Adaptation via Test-Time Reinforcement Learningcited by 14
- 2025VLA-Reasoner: Empowering Vision-Language-Action Models with Reasoning via Online Monte Carlo Tree Searchcited by 13
- 2026Failure-Aware RL: Reliable Offline-to-Online Reinforcement Learning with Self-Recovery for Real-World Manipulationcited by 11
- 2025Safe Learning for Contact-Rich Robot Tasks: A Survey from Classical Learning-Based Methods to Safe Foundation Modelscited by 7
- 2026Seeing Farther and Smarter: Value-Guided Multi-Path Reflection for VLM Policy Optimizationcited by 4
- 2026Exploration-assisted Bottleneck Transition Toward Robust and Data-efficient Deformable Object Manipulationcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
- 2026World Action Models: A Surveycited by 12
- 2026World Action Models: A Survey18 Jun 2026
Similar, not cited
Close in wording, no citation either way
- 2026FATE-VLA:Failue-aware test generation for vision-language-action models
- 2026DREAMSTEER: Latent World Models Can Steer VLA Policies During Deployment Without Any Finetuning
- 2026Learning from Runtime Feedback through Failure-Bank Self-Evolution for Vision-Language-Action Models
- 2026SEES: A Self-Evolving Embodied System via Failure-Guided VLA Policy Adaptation
- 2026Retrieve-then-Steer: Online Success Memory for Test-Time Adaptation of Generative VLAs
- 2026Failing Forward: Adaptive Failure-Informed Learning for Vision-Language-Action Models
- 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
- 2026DREAM-Chunk: Reactive Action Chunking with Latent World Model