mlsanityData to 7 Oct 2026

Self-Correcting VLA: Online Action Refinement via Sparse World Imagination

arXiv 2602.21633 ↗First posted 25 Feb 2026cs.RO cs.AI cs.CVcited by 4

On the map: Vision-language-action models → Reinforcement learning and post-training

Abstract (arXiv)

Standard vision-language-action (VLA) models rely on fitting statistical data priors, limiting their robust understanding of underlying physical dynamics. Reinforcement learning enhances physical grounding through exploration yet typically relies on external reward signals that remain isolated from the agent's internal states. World action models have emerged as a promising paradigm that integrates imagination and control to enable predictive planning. However, they rely on implicit context modeling, lacking explicit mechanisms for self-improvement. To solve these problems, we propose Self-Correcting VLA (SC-VLA), which achieve self-improvement by intrinsically guiding action refinement through sparse imagination. We first design sparse world imagination by integrating auxiliary predictive heads to forecast current task progress and future trajectory trends, thereby constraining the policy to encode short-term physical evolution. Then we introduce the online action refinement module to reshape progress-dependent dense rewards, adjusting trajectory orientation based on the predicted sparse future states. Evaluations on challenging robot manipulation tasks from simulation benchmarks and real-world settings demonstrate that SC-VLA achieve state-of-the-art performance, yielding the highest task throughput with 16% fewer steps and a 9% higher success rate than the best-performing baselines, alongside a 14% gain in real-world experiments. Code is available at https://github.com/Kisaragi0/SC-VLA.

Key facts. Cited by 4 papers in the map (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 41 of its 42 references that are in the map. First posted on arXiv 25 Feb 2026.

Builds on

41 of 42 references.

Closest ancestors · 10

Same direction, newest first

  1. 2025π*0.6: a VLA That Learns From Experience18 Nov
  2. 2025Reflection-Based Task Adaptation for Self-Improving VLA14 Oct
  3. 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators1 Oct
  4. 2025World-Env: Leveraging World Model as a Virtual Environment for VLA Post-Training29 Sep
  5. 2025A Vision-Language-Action-Critic Model for Robotic Real-World Reinforcement Learning19 Sep
  6. 2025What Can RL Bring to VLA Generalization? An Empirical Study26 May
  7. 2025RFTF: Reinforcement Fine-tuning for Embodied Agents with Temporal Feedback26 May
  8. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
  9. 2025ReinboT: Amplifying Robot Visual-Language Manipulation with Reinforcement Learning12 May
  10. 2024Octo: An Open-Source Generalist Robot Policy20 May

Other references · 31

  1. 2017Proximal Policy Optimization Algorithmscited by 14,441
  2. 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
  3. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  4. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusioncited by 2,730
  6. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  7. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,037
  8. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  9. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  10. 2023Learning Fine-Grained Bimanual Manipulation with Low-Cost Hardwarecited by 1,490
  11. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  12. 2025SigLIP 2: Multilingual Vision-Language Encoders with Improved Semantic Understanding, Localization, and Dense Featurescited by 1,127
19 more
  1. 2024RDT-1B: a Diffusion Foundation Model for Bimanual Manipulationcited by 670
  2. 2020SAPIEN: A SimulAted Part-based Interactive ENvironmentcited by 584
  3. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  4. 2024EAGLE-2: Faster Inference of Language Models with Dynamic Draft Treescited by 362
  5. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  6. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  7. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  8. 2024TraceVLA: Visual Trace Prompting Enhances Spatial-Temporal Awareness for Generalist Robotic Policiescited by 298
  9. 2023Zero-Shot Robotic Manipulation with Pretrained Image-Editing Diffusion Modelscited by 264
  10. 2024ManiSkill3: GPU Parallelized Robotics Simulation and Rendering for Generalizable Embodied AIcited by 216
  11. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  12. 2025PhysBench: Benchmarking and Enhancing Vision-Language Models for Physical World Understandingcited by 147
  13. 2023Q-Transformer: Scalable Offline Reinforcement Learning via Autoregressive Q-Functionscited by 129
  14. 2025FLARE: Robot Learning with Implicit World Modelingcited by 105
  15. 2024Policy Decorator: Model-Agnostic Online Refinement for Large Policy Modelcited by 60
  16. 2024GR-MG: Leveraging Partially Annotated Data via Multi-Modal Goal-Conditioned Policycited by 39
  17. 2025Self-Improving Embodied Foundation Modelscited by 28
  18. 2025NORA-1.5: A Vision-Language-Action Model Trained using World Model- and Action-based Preference Rewardscited by 26
  19. 2025Physical Autoregressive Model for Robotic Manipulation without Action Pretrainingcited by 11

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Find Something You Can't Do: Agentic Real-World Reinforcement Learning for Self-Improving VLA Models
  2. 2026SLIP-VLA: Single-Step Latent Imagination for Policy Learning in Vision-Language-Action Models
  3. 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL
  4. 2026GigaBrain-0.5M*: a VLA That Learns From World Model-Based Reinforcement Learning
  5. 2025SRPO: Self-Referential Policy Optimization for Vision-Language-Action Models
  6. 2025Towards Deploying VLA without Fine-Tuning: Plug-and-Play Inference-Time VLA Policy Steering via Embodied Evolutionary Diffusion
  7. 2026WISE: World-model-guided Imagination Scheduling for Efficient Post-training of Vision-Language-Action Models
  8. 2026Vision-Language-Action Jump-Starting for Reinforcement Learning Robotic Agents