VLA-Precision: Asymmetric Co-Bootstrapping for Efficient Real-World Online RL of Vision-Language-Action Models
On the map: Vision-language-action models → Reinforcement learning and post-training
Abstract (arXiv)
Pretrained vision-language-action (VLA) models enable broad manipulation but remain unreliable in tasks demanding precision and repeatability. Applying real-world online reinforcement learning (RL) to VLA post-training enables autonomous trial-and-error improvement beyond demonstrations alone, but exposes two bottlenecks: 1) unreliable value signals can induce policy drift; 2) large-VLA overhead constrains throughput and sample efficiency. To address these challenges, we present VLA-Precision, an efficient real-world online RL framework featuring the Asymmetric Co-Bootstrapping (ACoB) algorithm and the ACoB-Stream architecture. Specifically, ACoB establishes asymmetric co-bootstrapping across timescales: early intervention-guided behavioral learning rapidly improves policy performance while enhancing online experience quality. As autonomous experience accumulates, global return propagation and local preference ranking progressively calibrate value estimates, yielding relative action advantages for reference-regularized policy improvement while suppressing drift. To enable ACoB on large VLAs, we develop ACoB-Stream, a closed-loop experience--policy architecture that establishes invariant-state decoupling and on-demand streaming as design principles, delivering up to 10.9× improvements in throughput and computational efficiency. Extensive evaluations on nine high-precision chemistry tasks across four categories and four robot embodiments show that VLA-Precision achieves 98.3% mean success rate in 45.8 min/task, with 27.6 s episodes running at 1.2× and 1.8× the speeds of VLA and RL baselines. Resources are available at https://vla-precision.github.io.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Reinforcement learning and post-training, one of 13 directions in Vision-language-action models. Builds on 9 of its 39 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
9 of 39 references.
Closest ancestors · 7
Same direction, newest first
- 2026EXPO-FT: Sample-Efficient Reinforcement Learning Finetuning for Vision-Language-Action Models25 May
- 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Models24 Apr
- 2026WoVR: World Models as Reliable Simulators for Post-Training VLA Policies with RL15 Feb
- 2026Beyond Imitation: Reinforcement Learning-Based Sim-Real Co-Training for VLA Models13 Feb
- 2026SOP: A Scalable Online Post-Training System for Vision-Language-Action Models6 Jan
- 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learning24 May
- 2025Interactive Post-Training for Vision-Language-Action Models22 May
Other references · 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Trust Your Instincts: Confidence-Driven Test-Time RL for Vision-Language-Action Models
- 2025RLinf-VLA: A Unified and Efficient Framework for Reinforcement Learning of Vision-Language-Action Models
- 2026Stable and Efficient Real-World Online VLA Post-Training via Asynchronous Replay-Anchored Policy Improvement
- 2026RL-VLA3: A Flexible and Asynchronous Reinforcement Learning Framework for VLA Training
- 2026VLA-OPD: Bridging Offline SFT and Online RL for Vision-Language-Action Models via On-Policy Distillation
- 2025VLA-RFT: Vision-Language-Action Reinforcement Fine-tuning with Verified Rewards in World Simulators
- 2025Improving Vision-Language-Action Model with Online Reinforcement Learning
- 2025RobustVLA: Robustness-Aware Reinforcement Post-Training for Vision-Language-Action Models