mlsanityData to 7 Oct 2026

DIAL: Decoupling Intent and Action via Latent World Modeling for End-to-End VLA

arXiv 2603.29844 ↗First posted 31 Mar 2026cs.RO cs.AI cs.CVcited by 17

On the map: World models → Embodied and robot world models

also in 2 more
Abstract (arXiv)

The development of Vision-Language-Action (VLA) models has been significantly accelerated by pre-trained Vision-Language Models (VLMs). However, most existing end-to-end VLAs treat the VLM primarily as a multimodal encoder, directly mapping vision-language features to low-level actions. This paradigm underutilizes the VLM's potential in high-level decision making and introduces training instability, frequently degrading its rich semantic representations. To address these limitations, we introduce DIAL, a framework bridging high-level decision making and low-level motor execution through a differentiable latent intent bottleneck. Specifically, a VLM-based System-2 performs latent world modeling by synthesizing latent visual foresight within the VLM's native feature space; this foresight explicitly encodes intent and serves as the structural bottleneck. A lightweight System-1 policy then decodes this predicted intent together with the current observation into precise robot actions via latent inverse dynamics. To ensure optimization stability, we employ a two-stage training paradigm: a decoupled warmup phase where System-2 learns to predict latent futures while System-1 learns motor control under ground-truth future guidance within a unified feature space, followed by seamless end-to-end joint optimization. This enables action-aware gradients to refine the VLM backbone in a controlled manner, preserving pre-trained knowledge. Extensive experiments on the RoboCasa GR1 Tabletop benchmark show that DIAL establishes a new state-of-the-art, achieving superior performance with 10x fewer demonstrations than prior methods. Furthermore, by leveraging heterogeneous human demonstrations, DIAL learns physically grounded manipulation priors and exhibits robust zero-shot generalization to unseen objects and novel configurations during real-world deployment on a humanoid robot.

Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Placed in Embodied and robot world models, one of 11 directions in World models. Builds on 23 of its 30 references that are in the map. First posted on arXiv 31 Mar 2026.

Builds on

23 of 30 references.

Closest ancestors · 5

Same direction, newest first

  1. 2025villa-X: Enhancing Latent Action Modeling in Vision-Language-Action Models31 Jul
  2. 2025FLARE: Robot Learning with Implicit World Modeling21 May
  3. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulation19 Dec
  4. 2024Robotic Control via Embodied Chain-of-Thought Reasoning11 Jul
  5. 2023Diffusion Policy: Visuomotor Policy Learning via Action Diffusion7 Mar

Other references · 18

  1. 2025Qwen2.5-VL Technical Reportcited by 5,418
  2. 2023RT-2: Vision-Language-Action Models Transfer Web Knowledge to Robotic Controlcited by 2,993
  3. 2025Qwen3-VL Technical Reportcited by 2,534
  4. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  5. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  6. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
  7. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  8. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Modelscited by 643
  9. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  10. 2024CogACT: A Foundational Vision-Language-Action Model for Synergizing Cognition and Action in Robotic Manipulationcited by 411
  11. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  12. 2024Latent Action Pretraining from Videoscited by 302
6 more
  1. 2024GR-2: A Generative Video-Language-Action Model with Web-Scale Knowledge for Robot Manipulationcited by 290
  2. 2025Unified Video Action Modelcited by 195
  3. 2025EgoDex: Learning Dexterous Manipulation from Large-Scale Egocentric Videocited by 191
  4. 2025Unified Vision-Language-Action Modelcited by 128
  5. 2023EgoPlan-Bench: Benchmarking Multimodal Large Language Models for Human-Level Planningcited by 66
  6. 2024Moto: Latent Motion Token as the Bridging Language for Learning Robot Manipulation from Videoscited by 65

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 17.

17 papers.

Sort:

By area:

  1. 2026LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policiescited by 46
  2. 2026World Model for Robot Learning: A Comprehensive Surveycited by 42
  3. 2026Making Foresight Actionable: Repurposing Representation Alignment in World Action Modelscited by 8
  4. 2026ACE-Ego-0: Unifying Egocentric Human and Robotic Data for VLA Pretrainingcited by 8
  5. 2026IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulationcited by 7
  6. 2026Jetson-PI: Towards Onboard Real-Time Robot Control via Foresight-Aligned Asynchronous Inferencecited by 3
  7. 2026SG-WAM: Self-Guided World Modeling in Geometry-Aware Policy Spacecited by 3
  8. 2026AnyWorld: Factorized Egocentric World Models for Cross-Embodiment Generalizationcited by 3
  9. 2026Latent Action as Intention Enables Efficient Future Imagination for World Action Modelscited by 2
  10. 2026GIFT: Guided Intermediate Feature Training via Action-Oriented Structural Supervision for Robotic Manipulationcited by 2
  11. 2026CometVLA: Co-Training on an Embodied Data Pyramid towards Physical Understandingcited by 1
  12. 2026DynaWM: A Base-VLA-Guided World Foundation Model for Moving-Object Manipulationcited by 0
5 more
  1. 2026Act with Intent: Distilling Behavior Intent for Vision-Language-Action Modelscited by 0
  2. 2026Physico-Geospatial Grounded Scene Interpretation for Mobile Roboticscited by 0
  3. 2026Beyond Future Prediction: Denoising as Generative Adaptation for Robot Controlcited by 0
  4. 2026From World Models to World Action Models: Rethinking Next-State Predictioncited by 0
  5. 2026Token-World: World Modeling in Vision-Language Model Token Space for Robot Manipulationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Model
  2. 2026QuoVLA: Quotient Space for Vision-Language-Action Models
  3. 2026ATI-VLA: Action-Centric Predictive Vision-Language-Action Models via Actionable Alignment Then Adaptive Injection
  4. 2026PearlVLA: Progressive Embodied Action-Plan Refinement in Latent Space
  5. 2025From Intention to Execution: Probing the Generalization Boundaries of Vision-Language-Action Models
  6. 2026LEEVLA: Seeing What Matters in Latent Environment Evolution for Vision-Language-Action
  7. 2026DeltaVLA: Prior-Guided Vision-Language-Action Models via World Knowledge Variation
  8. 2025Actions as Language: Fine-Tuning VLMs into VLAs Without Catastrophic Forgetting