mlsanityData to 7 Oct 2026

Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection

arXiv 2606.09258 ↗First posted 8 Jun 2026cs.ROcited by 3

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Vision-language-action (VLA) policies can deviate from nominal trajectories during manipulation, even when tasks remain physically feasible. Recovering from these deviations is challenging, as they push the policy into unfamiliar state spaces where direct re-planning frequently destabilizes action sequences. We propose Back to the Familiar Future (B2FF), a recovery framework for foresight-driven VLAs that leverages future visual conditioning as a recovery interface. Before execution, the VLA generates a milestone bank of familiar future states conditioned on the clean initial observation. At recovery time, a recoverability-aware selector selects a recovery milestone from this bank and enforces it as a fixed visual goal. This enables the VLA to robustly map off-trajectory observations back to a familiar future. On failure-injected LIBERO, under controlled recovery timing aligned with the injected failure, B2FF increases the average success rate of a baseline VLA from 56.3% to 74.0%, demonstrating that pre-imagined milestones can guide recovery without fine-tuning the low-level action generator.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 30 of its 32 references that are in the map. First posted on arXiv 8 Jun 2026.

Builds on

30 of 32 references.

Closest ancestors · 2

Same direction, newest first

  1. 2026See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation10 Mar
  2. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct

Other references · 28

  1. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  7. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  8. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  9. 2021Perceiver: General Perception with Iterative Attentioncited by 1,089
  10. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  11. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  12. 2017Time-Contrastive Networks: Self-Supervised Learning from Videocited by 453
16 more
  1. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  2. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  3. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  4. 2019Soft Actor-Critic for Discrete Action Settingscited by 161
  5. 2023Video Language Planningcited by 160
  6. 2025FlowVLA: Visual Chain of Thought-based Motion Reasoning for Vision-Language-Action Modelscited by 50
  7. 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
  8. 2025Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Processcited by 37
  9. 2025Failure Prediction at Runtime for Generative Robot Policiescited by 36
  10. 2024Automating Robot Failure Recovery Using Vision-Language Models With Optimized Promptscited by 16
  11. 2025Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correctioncited by 16
  12. 2024Incorporating Task Progress Knowledge for Subgoal Generation in Robotic Manipulation through Image Editscited by 15
  13. 2025Efficient Robotic Policy Learning via Latent Space Backward Planningcited by 14
  14. 2026ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulationcited by 8
  15. 2026Learning Actionable Manipulation Recovery via Counterfactual Failure Synthesiscited by 7
  16. 2026Closed-Loop Action Chunks with Dynamic Corrections for Training-Free Diffusion Policycited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 3.

3 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models
  2. 2026ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies
  3. 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies
  4. 2026Long-Horizon Manipulation via Trace-Conditioned VLA Planning
  5. 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
  6. 2026ActFovea: Runtime Safeguarding for VLA Policies via Spatiotemporal Visual-Action Consistency
  7. 2026Foresight Residual RL for Long-Horizon Robot Manipulation with Vision-Language-Action Models
  8. 2026Revision, Not Restart: Revisable Visual Plans for Closed-Loop World-Action Models