Self-Correcting VLA: Online Action Refinement via Sparse World Imagination
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning enhances physical grounding through exploration yet typically relies on external reward signals that remain isolated from the agent's internal states. World action models have emerged as a promising paradigm that integrates imagination and control to enable predictive planning. However, they rely on implicit context modeling, lacking explicit mechanisms for self-improvement. To solve these problems, we propose Self-Correcting VLA (SC-VLA), which achieve self-improvement by intrinsically guiding action refinement through sparse imagination. We first design sparse world imagination by integrating auxiliary predictive heads to forecast current task progress and future trajectory trends, thereby constraining the policy to encode short-term physical evolution. Then we introduce the online action refinement module to reshape progress-dependent dense rewards, adjusting trajectory orientation based on the predicted sparse future states. Evaluations on challenging robot manipulation tasks from simulation benchmarks and real-world settings demonstrate that SC-VLA achieve state-of-the-art performance, yielding the highest task throughput with 16% fewer steps and a 9% higher success rate than the best-performing baselines, alongside a 14% gain in real-world experiments. Code is available at https://github.com/Kisaragi0/SC-VLA.
Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 41 of its 42 references that are in the map. First posted on arXiv 25 Feb 2026.
Builds on
41 of 42 references.
Closest ancestors · 10
Same direction, newest first
- 2025π*0.6: a VLA That Learns From Experience18 Nov
- 2025Reflection-Based Task Adaptation for Self-Improving VLA14 Oct
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
- 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
- 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning19 Sep
- 2025What Can RL Bring to VLA Generalization? An Empirical Study26 May
- 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback26 May
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
- 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learning12 May
- 2024Octo: An Open-Source Generalist Robot Policy20 May
Other references · 31
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
- 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
19 more
- 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
- 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
- 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
- 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
- 2023Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functionscited by 129
- 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
- 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 60
- 2024GR-MG: Leveraging Partially Annotated Data via Multi-Modal Goal-Conditioned Policycited by 39
- 2025Self-Improving Embodied Foundation Modelscited by 28
- 2025NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewardscited by 26
- 2025Physical Autoregressive Model for Robotic Manipulation without Action Pretrainingcited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026Beyond Imitation: Self-Improving Robot Policies via Off-Policy Q-Planningcited by 4
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Modelscited by 1
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionablecited by 1
- 2026Sparse Feature Policy Unlearning Mitigates State Hallucination in Vision-Language-Action Modelscited by 0
- 2026Sparse Feature Policy Unlearning Mitigates State Hallucination in Vision-Language-Action Models7 Oct 2026
- 2026World Models for Embodied Intelligence: From Plausible to Controllable to Actionable15 Sep 2026
- 2026Beyond Imitation: Self-Improving Robot Policies via Off-Policy Q-Planning21 Aug 2026
- 2026Overcoming Dynamics-Blindness: Training-Free Pace-and-Path Correction for VLA Models12 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026Find Something You Can't Do: Agentic Real-World Reinforcement Learning for Self-Improving VLA Models
- 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL
- 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning
- 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Models
- 2025Towards Deploying VLA without Fine-Tuning: Plug-and-Play Inference-Time VLA Policy Steering via Embodied Evolutionary Diffusion
- 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models
- 2026Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents