mlsanityData to 14 Oct 2026

HALO-WA: Hybrid-Attention Latent-Guided Online Reinforcement Learning for World-Action Models

arXiv 2607.04265 ↗First posted 5 Jul 2026cs.RO cs.AIcited by 1

On the map: World models → Embodied and robot world models

also in 1 more
Abstract (arXiv)

World-action (WA) models can generate long-horizon action chunks for general-purpose robotic manipulation, but they remain vulnerable to calibration, perception, and contact-dynamics errors in real-world precision tasks, often failing in the final few millimeters of alignment or insertion. We propose HALO-WA, a hybrid-attention latent-guided online reinforcement learning (RL) framework for WA models, which leverages latent features and action priors from the WA generation process through a lightweight actor-critic adapter to enable fast online adaptation to real deployment errors. HALO-WA introduces a hybrid-attention structure that preserves the temporal consistency of action chunks while reading task-relevant information from WA latents conditioned on visual context and end-stage correction requirements, thereby producing refined action chunks. We validate HALO-WA on four real-world precision manipulation tasks, where it improves the average success rate from 26.4% for WA-base to 87.1%, outperforming the strongest baseline by 19.2 percentage points while requiring only 45--75 minutes of online training per task. To facilitate reproducibility, we further conduct supplementary simulation experiments in RoboTwin and release the code at https://github.com/YeanRoot/HALO-WA.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 28 of its 32 references that are in the map. First posted on arXiv 5 Jul 2026.

Builds on

28 of 32 references.

Closest ancestors · 12

Same direction, newest first

  1. 2026World Action Models: The Next Frontier in Embodied AI12 May
  2. 2026HarmoWAM: Harmonizing Generalizable and Precise Manipulation via Adaptive World Action Models11 May
  3. 2026OA-WAM: Object-Addressable World Action Model for Robust Robot Manipulation7 May
  4. 2026Reconstruction or Semantics? What Makes a Latent Space Useful for Robotic World Models7 May
  5. 2026GigaWorld-Policy: An Efficient Action-Centered World--Action Model18 Mar
  6. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?17 Mar
  7. 2026World Action Models are Zero-shot Policies17 Feb
  8. 2026Causal World Modeling for Robot Control29 Jan
  9. 2025Motus: A Unified Latent Action World Model15 Dec
  10. 2025GigaWorld-0: World Models as Data Engine to Empower Embodied AI25 Nov
  11. 2025GigaBrain-0: A World Model-Powered Vision-Language-Action Model22 Oct
  12. 2025EmbodieDreamer: Advancing Real2Sim2Real Transfer for Policy Training via Embodied World Modeling7 Jul

Other references · 16

  1. 2017Attention Is All You Needcited by 60,361
  2. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,548
  3. 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
  4. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  5. 2025RoboTwin 2.0: A Scalable Data Generator and Benchmark with Strong Domain Randomization for Robust Bimanual Robotic Manipulationcited by 518
  6. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  7. 2018HG-DAgger: Interactive Imitation Learning with Human Expertscited by 266
  8. 2024Precise and Dexterous Robotic Manipulation via Human-in-the-Loop Reinforcement Learningcited by 189
  9. 2025VLA-RL: Towards Masterful and General Robotic Manipulation with Scalable Reinforcement Learningcited by 176
  10. 2025Self-Improving Vision-Language-Action Models with Data Generation via Residual RLcited by 78
  11. 2025RL-100: Performant Robotic Manipulation with Real-World Reinforcement Learningcited by 59
  12. 2026RL Token: Bootstrapping Online RL with Vision-Language-Action Modelscited by 49
4 more
  1. 2026World Model for Robot Learning: A Comprehensive Surveycited by 46
  2. 2025GR-RL: Going Dexterous and Precise for Long-Horizon Robotic Manipulationcited by 45
  3. 2024Learning to Manipulate Anywhere: A Visual Generalizable Framework For Reinforcement Learningcited by 41
  4. 2025VLA-R1: Enhancing Reasoning in Vision-Language-Action Modelscited by 38

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.

Similar, not cited

Close in wording, no citation either way

  1. 2026WAM-RL: World-Action Model Reinforcement Learning with Reconstruction Rewards and Online Video SFT
  2. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models
  3. 2026AdaWorldPolicy: World-Model-Driven Diffusion Policy with Online Adaptive Learning for Robotic Manipulation
  4. 2026LaST-R1: Reinforcing Robotic Manipulation via Adaptive Physical Latent Reasoning
  5. 2026Enhancing Policy Learning with World-Action Model
  6. 2026What Matters for Latent Actions in Robot Learning
  7. 2026World Models for Robotic Manipulation: A Survey
  8. 2025WMPO: World Model-based Policy Optimization for Vision-Language-Action Models