mlsanityData to 7 Oct 2026

Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Process

arXiv 2511.01718 ↗First posted 3 Nov 2025cs.RO cs.CVcited by 37

On the map: Vision-language-action models → Efficient VLA inference and adaptation

also in 1 more
Abstract (arXiv)

Vision-language-action (VLA) models aim to understand natural language instructions and visual observations and to execute corresponding actions as an embodied agent. Recent work integrates future images into the understanding-acting loop, yielding unified VLAs that jointly understand, generate, and act -- reading text and images and producing future images and actions. However, these models either rely on external experts for modality unification or treat image generation and action prediction as separate processes, limiting the benefits of direct synergy between these tasks. Our core philosophy is to optimize generation and action jointly through a synchronous denoising process, where the iterative refinement enables actions to evolve from initialization, under constant and sufficient visual guidance. We ground this philosophy in our proposed Unified Diffusion VLA and Joint Discrete Denoising Diffusion Process (JD3P), which is a joint diffusion process that integrates multiple modalities into a single denoising trajectory to serve as the key mechanism enabling understanding, generation, and acting to be intrinsically synergistic. Our model and theory are built on a unified tokenized space of all modalities and a hybrid attention mechanism. We further propose a two-stage training pipeline and several inference-time techniques that optimize performance and efficiency. Our approach achieves state-of-the-art performance on benchmarks such as CALVIN, LIBERO, and SimplerEnv with 4× faster inference than autoregressive methods, and we demonstrate its effectiveness through in-depth analysis and real-world evaluations. Our project page is available at https://irpn-eai.github.io/UD-VLA.github.io/.

Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 57 of its 61 references that are in the map. First posted on arXiv 3 Nov 2025.

Builds on

57 of 61 references.

Closest ancestors · 4

Same direction, newest first

  1. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies27 Aug
  2. 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decoding16 Jun
  3. 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
  4. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan

Other references · 53

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  4. 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
  5. 2017Neural Discrete Representation Learningcited by 4,650
  6. 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
  7. 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
  8. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
  9. 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
  10. 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
  11. 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
  12. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
38 more
  1. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  2. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
  3. 2024Emu3: Next-Token Prediction is All You Needcited by 761
  4. 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
  5. 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
  7. 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
  8. 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
  9. 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
  10. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
  11. 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
  12. 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
  13. 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
  14. 2020Language Conditioned Imitation Learning over Unstructured Datacited by 208
  15. 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
  16. 2025Unified Video Action Modelcited by 195
  17. 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
  18. 2023Video Language Planningcited by 160
  19. 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
  20. 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
  21. 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
  22. 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
  23. 2025Unified Vision-Language-Action Modelcited by 128
  24. 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
  25. 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
  26. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
  27. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
  28. 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
  29. 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
  30. 2018Learning Plannable Representations with Causal InfoGANcited by 56
  31. 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 55
  32. 2024Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learningcited by 46
  33. 2019Learning Robotic Manipulation through Visual Planning and Actingcited by 39
  34. 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
  35. 2025LLaDA-VLA: Vision Language Diffusion Action Modelscited by 30
  36. 2024GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robotcited by 28
  37. 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 28
  38. 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27

50 most cited of 53 All 53 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 35.

37 papers.

Sort:

By area:

  1. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
  2. 2026World Action Models: The Next Frontier in Embodied AIcited by 46
  3. 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41
  4. 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
  5. 2026Interactive World Simulator for Robot Policy Training and Evaluationcited by 27
  6. 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Modelscited by 21
  7. 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Modelscited by 19
  8. 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignmentcited by 19
  9. 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Modelscited by 16
  10. 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 13
  11. 2025MM-ACT: Learn from Multimodal Parallel Generation to Actcited by 12
  12. 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generationcited by 10
25 more
  1. 2026World Action Models: A Surveycited by 10
  2. 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
  3. 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
  4. 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fieldscited by 9
  5. 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 8
  6. 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 7
  7. 2026Point Tracking Improves World Action Modelscited by 7
  8. 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matchingcited by 5
  9. 2026Foresight Without Seeing: Latent Futures for World Action Modelscited by 4
  10. 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
  11. 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuningcited by 3
  12. 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Modelscited by 3
  13. 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selectioncited by 3
  14. 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
  15. 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulationcited by 2
  16. 2026TBD-VLA: Temporal Block Diffusion Vision Language Action Modelcited by 1
  17. 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Modelscited by 1
  18. 2026Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processescited by 1
  19. 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulationcited by 1
  20. 2026WorldDiT: A Unified Diffusion Architecture for World and Action Modelingcited by 0
  21. 2026SMILE: Smooth Motion for Improved Long-Horizon VLA Executioncited by 0
  22. 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Modelcited by 0
  23. 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
  24. 2026SCULPT-VLA: Learning Structured Control through Staged Action Groundingcited by 0
  25. 2026Discrete Forcing: Infusing Discrete Guidance into Continuous Denoising for Few-Step Action Expertscited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows
  2. 2026StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models
  3. 2024Dual Diffusion for Unified Image Generation and Understanding
  4. 2025E0: Enhancing Generalization and Fine-Grained Control in VLA Models via Tweedie Discrete Diffusion
  5. 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
  6. 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model
  7. 2025Dynamic VLM-Guided Negative Prompting for Diffusion Models
  8. 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs