See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Measurement of task progress through explicit, actionable milestones is critical for robust robotic manipulation. This progress awareness enables a model to ground its current task status, anticipate verifiable intermediate states, and detect and recover from failures when progress stalls. To embody this capability, we introduce See, Plan, Rewind (SPR), a progress-aware vision-language-action framework that dynamically grounds language instructions into a sequence of spatial subgoals. SPR operates through a continuous core cycle, Seeing the current state and upcoming milestone, Planning a trajectory towards the next 2D waypoint, and Rewinding to a recoverable state upon failure by monitoring progress against the expected sequence. This closed-loop approach enables robust error correction without requiring additional training data or auxiliary models. Extensive experiments demonstrate the framework's effectiveness, generalization and robustness: SPR outperforms the MolmoAct baseline by 5% on the LIBERO benchmark. On the challenging LIBERO-Plus benchmark with unseen instructions and initial states, SPR achieves state-of-the-art robustness with the smallest performance drop, surpassing OpenVLA-OFT and UniVLA, demonstrating superior out-of-distribution robustness.
Key facts. Cited by 6 papers in the map (data through 7 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 40 of its 44 references that are in the map. First posted on arXiv 10 Mar 2026.
Builds on
40 of 44 references.
Closest ancestors · 4
Same direction, newest first
- 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Models15 Oct
- 2025FailSafe: Reasoning and Recovery from Failures in Vision-Language-Action Models2 Oct
- 2025SAFE: Multitask Failure Detection for Vision-Language-Action Models11 Jun
- 2025RoboFAC: A Comprehensive Framework for Robotic Failure Analysis and Correction18 May
Other references · 36
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,337
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025DINOv3cited by 1,297
- 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 849
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
24 more
- 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 801
- 2024PaliGemma: A versatile 3B VLM for transfercited by 679
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2025UniVLA: Learning to Act Anywhere with Task-centric Latent Actionscited by 386
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024Prismatic VLMs: Investigating the Design Space of Visually-Conditioned Language Modelscited by 336
- 2021Bridge Data: Boosting Generalization of Robotic Skills with Cross-Domain Datasetscited by 248
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2023REFLECT: Summarizing Robot Experiences for Failure Explanation and Correctioncited by 171
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2024Yell At Your Robot: Improving On-the-Fly from Language Correctionscited by 123
- 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 119
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2024GRAPE: Generalizing Robot Policy via Preference Alignmentcited by 106
- 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
- 2024Closed-Loop Open-Vocabulary Mobile Manipulation with GPT-4Vcited by 40
- 2023Interactive Robot Learning from Verbal Correctioncited by 28
- 2024Automating Robot Failure Recovery Using Vision-Language Models With Optimized Promptscited by 16
- 2025Learning Robust Spectral Dynamics for Temporal Domain Generalizationcited by 13
- 2025SeqVLA: Sequential Task Execution for Long-Horizon Manipulation with Completion-Aware Vision-Language-Action Modelcited by 10
- 2025Walking the Tightrope: Disentangling Beneficial and Detrimental Drifts in Non-Stationary Custom-Tuningcited by 4
- 2025STAR: A Foundation Model-driven Framework for Robust Task Planning and Failure Recovery in Robotic Systemscited by 2
Built on by
Citing papers per year: 2026: 6.
6 papers.
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoringcited by 6
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selectioncited by 3
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planningcited by 3
- 2026Action with Visual Primitivescited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Modelscited by 0
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Learning to Use Imagination: Progress-Conditioned Future Utilization for World Action Models6 Sep 2026
- 2026MEMORA: Embodied Action Memory from Egocentric Videos for Reasoning and Planning15 Jul 2026
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection8 Jun 2026
- 2026Hide-and-Seek in Trajectories: Discovering Failure Signals for VLA Runtime Monitoring29 May 2026
- 2026Action with Visual Primitives21 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026ProgressVLA: Progress-Guided Diffusion Policy for Vision-Language Robotic Manipulation
- 2026ProcVLM: Learning Procedure-Grounded Progress Rewards for Robotic Manipulation
- 2026VLA-Corrector: Stage-Aware Observable State Understanding for Prompt-Based Closed-Loop Recovery of Vision-Language-Action Policies
- 2026RoboProcessBench: Benchmarking Process-Aware Understanding in Vision-Language Robotic Manipulation
- 2024Incorporating Task Progress Knowledge for Subgoal Generation in Robotic Manipulation through Image Edits
- 2026ChainVLA: Chaining Vision-Language-Action Queries through a Unified Execution State for Long-Horizon Manipulation
- 2026Benchmarking Vision-Language-Action Models on SO-101: Failure and Recovery Analysis
- 2026ReconVLA: An Uncertainty-Guided and Failure-Aware Vision-Language-Action Framework for Robotic Control