mlsanityData to 7 Oct 2026

See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation

arXiv 2603.09292 ↗First posted 10 Mar 2026cs.RO cs.CVcited by 6

On the map: Vision-language-action models → Failure recovery and robustness

Abstract (arXiv)

Measurement of task progress through explicit, actionable milestones is critical for robust robotic manipulation. This progress awareness enables a model to ground its current task status, anticipate verifiable intermediate states, and detect and recover from failures when progress stalls. To embody this capability, we introduce See, Plan, Rewind (SPR), a progress-aware vision-language-action framework that dynamically grounds language instructions into a sequence of spatial subgoals. SPR operates through a continuous core cycle, Seeing the current state and upcoming milestone, Planning a trajectory towards the next 2D waypoint, and Rewinding to a recoverable state upon failure by monitoring progress against the expected sequence. This closed-loop approach enables robust error correction without requiring additional training data or auxiliary models. Extensive experiments demonstrate the framework's effectiveness, generalization and robustness: SPR outperforms the MolmoAct baseline by 5% on the LIBERO benchmark. On the challenging LIBERO-Plus benchmark with unseen instructions and initial states, SPR achieves state-of-the-art robustness with the smallest performance drop, surpassing OpenVLA-OFT and UniVLA, demonstrating superior out-of-distribution robustness.

Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 40 of its 44 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

40 of 44 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models15 Oct
  2. 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct
  3. 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun
  4. 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction18 May

Other references · 36

  1. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  4. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  7. 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
  8. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  9. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  10. 2025DINOv3cited by 1,297
  11. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
  12. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
24 more
  1. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
  2. 2024PaliGemma: A versatile 3B VLM for transfercited by 679
  3. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  4. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  5. 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
  6. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  7. 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
  8. 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
  9. 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
  10. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  11. 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
  12. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  13. 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
  14. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
  15. 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
  16. 2024GRAPE: Generalizing Robot Policy via Preference Alignmentcited by 106
  17. 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
  18. 2024Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4Vcited by 40
  19. 2023Interactive Robot Learning from Verbal Correctioncited by 28
  20. 2024Automating Robot Failure Recovery Using Vision-Language Models With Optimized Promptscited by 16
  21. 2025Learning Robust Spectral Dynamics for Temporal Domain Generalizationcited by 13
  22. 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Modelcited by 10
  23. 2025Walking the Tightrope: Disentangling Beneficial and Detrimental Drifts in Non-Stationary Custom-Tuningcited by 4
  24. 2025STAR: A Foundation Model-driven Framework for Robust Task Planning and Failure Recovery in Robotic Systemscited by 2

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 6.

6 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulation
  2. 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation
  3. 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies
  4. 2026RoboProcessBench: Benchmarking Process-Aware Understanding in Vision-Language Robotic Manipulation
  5. 2024Incorporating Task Progress Knowledge for Subgoal Generation in Robotic Manipulation through Image Edits
  6. 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
  7. 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
  8. 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control