Sentinel-VLA: A Metacognitive VLA Model with Active Status Monitoring for Dynamic Reasoning and Error Recovery
On the map: Vision-language-action models → Efficient VLA inference and adaptation
Abstract (arXiv)
Vision-language-action (VLA) models have advanced the field of embodied manipulation by harnessing broad world knowledge and strong generalization. However, current VLA models still face several key challenges, including limited reasoning capability, lack of status monitoring, and difficulty in self-correction. In this paper, we introduce Sentinel-VLA, a metacognitive VLA model equipped with an active ``sentinel'' module to monitor real-time execution status. Only when necessary, such as during initial planning or upon detecting an error, the model triggers a dynamic reasoning or formulate error recovery solutions. This on-demand reasoning mechanism ensures robust decision-making while minimizing computational overhead. Notably, all training data (spanning 44 tasks and over 2.6 million transitions) is automatically generated and annotated through our designed pipeline. We also propose the Self-Evolving Continual Learning (SECL) algorithm, which allows Sentinel-VLA to identify its capability boundaries and automatically collect data for expansion, paired with Orthogonal Continual Adapter (OC-Adapter) to constrain parameter updates to an orthogonal space, thereby preventing catastrophic forgetting. Real-world experiments demonstrate that Sentinel-VLA boosts the task success rate by over 30% compared to the SOTA model, PI0. We will open-source all the code, weights, and data generation pipeline.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 44 of its 54 references that are in the map. First posted on arXiv 2 May 2026.
Builds on
44 of 54 references.
Closest ancestors · 1
Same direction, newest first
Other references · 43
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,151
- 2023Qwen Technical Reportcited by 3,273
- 2024Gemini 1.5: Unlocking multimodal understanding across millions of tokens of contextcited by 3,175
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2024Qwen2 Technical Reportcited by 2,076
- 2025π0.5: a Vision-Language-Action Model with Open-World Generalizationcited by 1,653
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
31 more
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2019RLBench: The Robot Learning Benchmark & Learning Environmentcited by 669
- 2024TinyLlama: An Open-Source Small Language Modelcited by 604
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
- 2024Robotic Control via Embodied Chain-of-Thought Reasoningcited by 340
- 2024PaliGemma 2: A Family of Versatile VLMs for Transfercited by 204
- 2024Aligning Cyber Space with Physical World: A Comprehensive Survey on Embodied AIcited by 175
- 2024AHA: A Vision-Language-Model for Detecting and Reasoning Over Failures in Robotic Manipulationcited by 118
- 2025ChatVLA: Unified Multimodal Understanding and Robot Control with Vision-Language-Action Modelcited by 112
- 2025OneTwoVLA: A Unified Vision-Language-Action Model with Adaptive Reasoningcited by 105
- 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 94
- 2024Code-as-Monitor: Constraint-aware Visual Programming for Reactive and Proactive Robotic Failure Detectioncited by 59
- 2025Embodied AI Agents: Modeling the Worldcited by 57
- 2025Hume: Introducing System-2 Thinking in Visual-Language-Action Modelcited by 56
- 2025ChatVLA-2: Vision-Language-Action Model with Open-World Embodied Reasoning from Pretrained Knowledgecited by 49
- 2024RACER: Rich Language-Guided Failure Recovery Policies for Imitation Learningcited by 46
- 2025Multi-agent Embodied AI: Advances and Future Directionscited by 36
- 2025CAST: Counterfactual Labels Improve Instruction Following in Vision-Language-Action Modelscited by 28
- 2020Self-supervised Geometric Features Discovery via Interpretable Attention for Vehicle Re-Identification and Beyondcited by 25
- 2024A Self-Correcting Vision-Language-Action Model for Fast and Slow System Manipulationcited by 20
- 2025Phoenix: A Motion-based Self-Reflection Framework for Fine-grained Robotic Action Correctioncited by 16
- 2025Circle-RoPE: Cone-like Decoupled Rotary Positional Embedding for Large Vision-Language Modelscited by 14
- 2025AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Modelscited by 13
- 2025Affordance Field Intervention: Enabling VLAs to Escape Memory Traps in Robotic Manipulationcited by 12
- 2025Toward Embodied AGI: A Review of Embodied AI and the Road Aheadcited by 7
- 2025Do You Have Freestyle? Expressive Humanoid Locomotion via Audio Controlcited by 7
- 2025RoboMirror: Understand Before You Imitate for Video to Humanoid Locomotioncited by 6
- 2026RoboRouter: Training-Free Policy Routing for Robotic Manipulationcited by 6
- 2025Identify, Isolate, and Purge: Mitigating Hallucinations in LVLMs via Self-Evolving Distillationcited by 4
- 2026HiCI: Hierarchical Construction-Integration for Long-Context Attentioncited by 2
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Modelcited by 5
- 2026CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Modelscited by 0
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignmentcited by 0
- 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videoscited by 0
- 2026StateTrace: An Object-Centric Framework for Hidden-State Spatiotemporal Reasoning in Long Videos19 Aug 2026
- 2026MOSAIC: Orchestrating Collaborative Knowledge Tracing with Hierarchical Semantic Alignment27 Jun 2026
- 2026CrossVLA: Cross-Paradigm Post-Training and Inference Optimization for Vision-Language-Action Models21 May 2026
- 2026See What Matters: Differentiable Grid Sample Pruning for Generalizable Vision-Language-Action Model12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026VLA-ATTC: Adaptive Test-Time Compute for VLA Models with Relative Action Critic Model
- 2026VLA-Thinker: Boosting Vision-Language-Action Models through Thinking-with-Image Reasoning
- 2026From Knowing to Doing Precisely: A General Self-Correction and Termination Framework for VLA models
- 2025AVA-VLA: Improving Vision-Language-Action models with Active Visual Attention
- 2026ElegantVLA: Learning When to Think for Efficient Vision-Language-Action Models
- 2026EmbodiedSkills: A Unified Framework for Orchestrating, Training, and Deploying VLA Agents
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models
- 2026AC^2-VLA: Action-Context-Aware Adaptive Computation in Vision-Language-Action Models for Efficient Robotic Manipulation