ReCAPA: Hierarchical Predictive Correction to Mitigate Cascading Failures
On the map: Vision-language-action models → Failure recovery and robustness
Abstract (arXiv)
Vision-Language-Action systems follow instructions to execute multi-step tasks in multimodal environments. Recent VLA approaches typically rely on post-hoc correction mechanisms or operate under fixed task decompositions and alignment schemes. However, once an intermediate step is mis-specified, local errors propagate through subsequent steps and eventually accumulate into cascading failures. To mitigate this compounding effect, we propose Predictive Alignment and Planning Architecture, a framework that uses prediction and contrast to adjust deviations across three levels: actions, subgoals, and trajectories. Semantic alignment is enforced at all levels using a Sinkhorn-based module and a Score-field module. The predictive correction and alignment jointly update the action generator during training, enabling it to adjust fine-grained steps to remain aligned with the overall intent. We further introduce two new metrics to quantify error propagation and recovery processes in tasks, capturing how mistakes spread and fade over long-horizon execution. Experiments show that ReCAPA achieves competitive results on embodied agent benchmarks such as VisualAgentBench, MineDojo, and AI2-THOR, outperforming strong proprietary and open-source Large Language Model baselines.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Failure recovery and robustness, one of 13 directions in Vision-language-action models. Builds on 39 of its 59 references that are in the map. First posted on arXiv 23 Apr 2026.
Builds on
39 of 59 references.
References · 39
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 9,122
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2024GPT-4o System Cardcited by 4,588
- 2023Reflexion: Language Agents with Verbal Reinforcement Learningcited by 4,276
- 2025Gemini 2.5: Pushing the Frontier with Advanced Reasoning, Multimodality, Long Context, and Next Generation Agentic Capabilitiescited by 3,796
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,224
- 2023Mistral 7Bcited by 3,164
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2023Qwen-VL: A Versatile Vision-Language Model for Understanding, Localization, Text Reading, and Beyondcited by 2,224
27 more
- 2024Expanding Performance Boundaries of Open-Source Multimodal Models with Model, Data, and Test-Time Scalingcited by 1,599
- 2024OpenAI o1 System Cardcited by 1,244
- 2020ALFWorld: Aligning Text and Embodied Environments for Interactive Learningcited by 1,205
- 2024ChatGLM: A Family of Large Language Models from GLM-130B to GLM-4 All Toolscited by 1,121
- 2017AI2-THOR: An Interactive 3D Environment for Visual AIcited by 869
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 584
- 2022ProcTHOR: Large-Scale Embodied AI Using Procedural Generationcited by 380
- 2024What matters when building vision-language models?cited by 326
- 2023Building Cooperative Embodied Agents Modularly with Large Language Modelscited by 237
- 2024CogVLM2: Visual Language Models for Image and Video Understandingcited by 217
- 2024BEHAVIOR-1K: A Human-Centered, Embodied AI Benchmark with 1,000 Everyday Activities and Realistic Simulationcited by 148
- 2024Evaluation of OpenAI o1: Opportunities and Challenges of AGIcited by 127
- 2023Compositional Foundation Models for Hierarchical Planningcited by 95
- 2020Hierarchical Planning for Long-Horizon Manipulation with Geometric and Symbolic Scene Graphscited by 83
- 2024Vision-Language Models Can Self-Improve Reasoning via Reflectioncited by 69
- 2023LLM-Based Agent Society Investigation: Collaboration and Confrontation in Avalon Gameplaycited by 63
- 2023Skill Reinforcement Learning and Planning for Open-World Long-Horizon Taskscited by 36
- 2024RL-GPT: Integrating Reinforcement Learning and Code-as-policycited by 32
- 2024Re-ReST: Reflection-Reinforced Self-Training for Language Agentscited by 29
- 2024EPO: Hierarchical LLM Agents with Environment Preference Optimizationcited by 28
- 2024WALL-E: World Alignment by Rule Learning Improves World Model-based LLM Agentscited by 26
- 2025MultiMind: Enhancing Werewolf Agents with Multimodal Reasoning and Theory of Mindcited by 12
- 2025CausalMACE: Causality Empowered Multi-Agents in Minecraft Cooperative Taskscited by 8
- 2024PRET: Planning with Directed Fidelity Trajectory for Vision and Language Navigationcited by 7
- 2024MineAgent: Towards Remote-Sensing Mineral Exploration with Multimodal Large Language Modelscited by 7
- 2025The Stackelberg Speaker: Optimizing Persuasive Communication in Social Deduction Gamescited by 3
- 2026CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answeringcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Training-Free Action Correction for VLA Model Failures via Language Feedback
- 2026When Instructions Retrieve Trajectories: Diagnosing and Mitigating Generalization Failures in VLA Models
- 2025Do What You Say: Steering Vision-Language-Action Models via Runtime Reasoning-Action Alignment Verification
- 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
- 2026RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models
- 2026Nipping the Drift in the Bud: Retrospective Rectification for Robust Vision-Language Navigation
- 2026Scaling Verification Can Be More Effective than Scaling Policy Learning for Vision-Language-Action Alignment
- 2026RoVLA: Multi-Consistency Constraints for Robust Vision-Language-Action Models