Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Process
On the map: Vision-language-action models → Efficient VLA inference and adaptation
also in 1 more
Abstract (arXiv)
Vision-language-action (VLA) models aim to understand natural language instructions and visual observations and to execute corresponding actions as an embodied agent. Recent work integrates future images into the understanding-acting loop, yielding unified VLAs that jointly understand, generate, and act -- reading text and images and producing future images and actions. However, these models either rely on external experts for modality unification or treat image generation and action prediction as separate processes, limiting the benefits of direct synergy between these tasks. Our core philosophy is to optimize generation and action jointly through a synchronous denoising process, where the iterative refinement enables actions to evolve from initialization, under constant and sufficient visual guidance. We ground this philosophy in our proposed Unified Diffusion VLA and Joint Discrete Denoising Diffusion Process (JD3P), which is a joint diffusion process that integrates multiple modalities into a single denoising trajectory to serve as the key mechanism enabling understanding, generation, and acting to be intrinsically synergistic. Our model and theory are built on a unified tokenized space of all modalities and a hybrid attention mechanism. We further propose a two-stage training pipeline and several inference-time techniques that optimize performance and efficiency. Our approach achieves state-of-the-art performance on benchmarks such as CALVIN, LIBERO, and SimplerEnv with 4× faster inference than autoregressive methods, and we demonstrate its effectiveness through in-depth analysis and real-world evaluations. Our project page is available at https://irpn-eai.github.io/UD-VLA.github.io/.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 57 of its 61 references that are in the map. First posted on arXiv 3 Nov 2025.
Builds on
57 of 61 references.
Closest ancestors · 4
Same direction, newest first
- 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies27 Aug
- 2025CEED-VLA: Consistency Vision-Language-Action Model with Early-Exit Decoding16 Jun
- 2025PD-VLA: Accelerating Vision-Language-Action Model Integrated with Action Chunking via Parallel Decoding4 Mar
- 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan
Other references · 53
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2019BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehensioncited by 5,874
- 2017Neural Discrete Representation Learningcited by 4,650
- 2024OpenVLA: An Open-Source Vision-Language-Action Modelcited by 2,777
- 2022Do As I Can, Not As I Say: Grounding Language in Robotic Affordancescited by 2,302
- 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,297
- 2022RT-1: Robotics Transformer for Real-World Control at Scalecited by 2,007
- 2024Octo: An Open-Source Generalist Robot Policycited by 1,427
- 2023LIBERO: Benchmarking Knowledge Transfer for Lifelong Robot Learningcited by 1,338
- 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,167
38 more
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 844
- 2024Emu3: Next-Token Prediction is All You Needcited by 761
- 2021CALVIN: A Benchmark for Language-Conditioned Policy Learning for Long-Horizon Robot Manipulation Taskscited by 564
- 2023Learning Universal Policies via Text-Guided Video Generationcited by 506
- 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 502
- 2024Evaluating Real-World Robot Manipulation Policies in Simulationcited by 484
- 2025CoT-VLA: Visual Chain-of-Thought Reasoning for Vision-Language-Action Modelscited by 440
- 2023Unleashing Large-Scale Video Generative Pre-training for Visual Robot Manipulationcited by 353
- 2025WorldVLA: Towards Autoregressive Action World Modelcited by 351
- 2023Vision-Language Foundation Models as Effective Robot Imitatorscited by 344
- 2024Scaling Diffusion Language Models via Adaptation from Autoregressive Modelscited by 268
- 2025MMaDA: Multimodal Large Diffusion Language Modelscited by 241
- 2020Language Conditioned Imitation Learning over Unstructured Datacited by 208
- 2025DreamVLA: A Vision-Language-Action Model Dreamed with Comprehensive World Knowledgecited by 203
- 2025Unified Video Action Modelcited by 195
- 2025MolmoAct: Action Reasoning Models that can Reason in Spacecited by 189
- 2023Video Language Planningcited by 160
- 2024Predictive Inverse Dynamics Models are Scalable Learners for Robotic Manipulationcited by 159
- 2025ThinkAct: Vision-Language-Action Reasoning via Reinforced Visual Latent Planningcited by 152
- 2025VLA-Adapter: An Effective Paradigm for Tiny-Scale Vision-Language-Action Modelcited by 140
- 2024Multimodal Diffusion Transformer: Learning Versatile Behavior from Multimodal Goalscited by 131
- 2025Unified Vision-Language-Action Modelcited by 128
- 2022MoVQ: Modulating Quantized Vectors for High-Fidelity Image Generationcited by 125
- 2024DeeR-VLA: Dynamic Inference of Multimodal Large Language Models for Efficient Robot Executioncited by 116
- 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 99
- 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 85
- 2025ReconVLA: Reconstructive Vision-Language-Action Model as Effective Robot Perceivercited by 80
- 2024Prediction with Action: Visual Policy Learning via Joint Denoising Processcited by 64
- 2018Learning Plannable Representations with Causal InfoGANcited by 56
- 2023QUAR-VLA: Vision-Language-Action Model for Quadruped Robotscited by 55
- 2024Efficient Diffusion Transformer Policies with Mixture of Expert Denoisers for Multitask Learningcited by 46
- 2019Learning Robotic Manipulation through Visual Planning and Actingcited by 39
- 2025Towards a Unified Understanding of Robot Manipulation: A Comprehensive Surveycited by 32
- 2025LLaDA-VLA: Vision Language Diffusion Action Modelscited by 30
- 2024GeRM: A Generalist Robotic Model with Mixture-of-experts for Quadruped Robotcited by 28
- 2025Learning Long-Context Diffusion Policies via Past-Token Predictioncited by 28
- 2025MoRE: Unlocking Scalability in Reinforcement Learning for Quadruped Vision-Language-Action Modelscited by 27
50 most cited of 53 All 53 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 35.
37 papers.
Sort:
By area:
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
- 2026Interactive World Simulator for Robot Policy Training and Evaluationcited by 27
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Modelscited by 21
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Modelscited by 19
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignmentcited by 19
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Modelscited by 16
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 13
- 2025MM-ACT: Learn from Multimodal Parallel Generation to Actcited by 12
- 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generationcited by 10
25 more
- 2026World Action Models: A Surveycited by 10
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fieldscited by 9
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 8
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specializationcited by 7
- 2026Point Tracking Improves World Action Modelscited by 7
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matchingcited by 5
- 2026Foresight Without Seeing: Latent Futures for World Action Modelscited by 4
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executorscited by 3
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuningcited by 3
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Modelscited by 3
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selectioncited by 3
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Controlcited by 3
- 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulationcited by 2
- 2026TBD-VLA: Temporal Block Diffusion Vision Language Action Modelcited by 1
- 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Modelscited by 1
- 2026Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processescited by 1
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulationcited by 1
- 2026WorldDiT: A Unified Diffusion Architecture for World and Action Modelingcited by 0
- 2026SMILE: Smooth Motion for Improved Long-Horizon VLA Executioncited by 0
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Modelcited by 0
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Modelscited by 0
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Groundingcited by 0
- 2026Discrete Forcing: Infusing Discrete Guidance into Continuous Denoising for Few-Step Action Expertscited by 0
- 2026Discrete Forcing: Infusing Discrete Guidance into Continuous Denoising for Few-Step Action Experts30 Sep 2026
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Grounding20 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026SMILE: Smooth Motion for Improved Long-Horizon VLA Execution29 Aug 2026
- 2026Foresight Without Seeing: Latent Futures for World Action Models12 Aug 2026
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug 2026
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation6 Aug 2026
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control29 Jul 2026
- 2026WorldDiT: A Unified Diffusion Architecture for World and Action Modeling27 Jul 2026
- 2026Concurrent Image Understanding and Generation: Self-Correcting Coupled Markov Jump Processes14 Jul 2026
- 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Models22 Jun 2026
25 more
- 2026World Action Models: A Survey18 Jun 2026
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun 2026
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AI15 Jun 2026
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun 2026
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection8 Jun 2026
- 2026TBD-VLA: Temporal Block Diffusion Vision Language Action Model5 Jun 2026
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models5 Jun 2026
- 2026Point Tracking Improves World Action Models22 May 2026
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning13 May 2026
- 2026GuidedVLA: Specifying Task-Relevant Factors via Plug-and-Play Action Attention Specialization12 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation1 May 2026
- 2026DiscreteRTC: Discrete Diffusion Policies are Natural Asynchronous Executors27 Apr 2026
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr 2026
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching27 Mar 2026
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performance26 Mar 2026
- 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation26 Mar 2026
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar 2026
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar 2026
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baseline26 Feb 2026
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment19 Feb 2026
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Model10 Feb 2026
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models1 Feb 2026
- 2025MM-ACT: Learn from Multimodal Parallel Generation to Act30 Nov 2025
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Models18 Nov 2025
- 2025AsyncVLA: Asynchronous Flow Matching for Vision-Language-Action Modelscited by 16
- 2025MM-ACT: Learn from Multimodal Parallel Generation to Actcited by 12
- 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generationcited by 10
- 2026Rethinking the Practicality of Vision-language-action Model: A Comprehensive Benchmark and An Improved Baselinecited by 9
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performancecited by 9
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matchingcited by 5
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Modelscited by 3
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selectioncited by 3
- 2026TBD-VLA: Temporal Block Diffusion Vision Language Action Modelcited by 1
- 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Modelscited by 1
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulationcited by 1
- 2026SMILE: Smooth Motion for Improved Long-Horizon VLA Executioncited by 0
12 most cited of 16 All 16 (JSON)
- 2026Discrete Forcing: Infusing Discrete Guidance into Continuous Denoising for Few-Step Action Experts30 Sep 2026
- 2026SCULPT-VLA: Learning Structured Control through Staged Action Grounding20 Sep 2026
- 2026KerColle: Unlocking Fine-Grained GPU Concurrency in Vision-Language-Action Models16 Sep 2026
- 2026Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model11 Sep 2026
- 2026SMILE: Smooth Motion for Improved Long-Horizon VLA Execution29 Aug 2026
- 2026DyPES-VLA: Learning Shared Dynamics Priors and Embodiment-Specific Control for Cross-Embodiment Manipulation6 Aug 2026
- 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Models22 Jun 2026
- 2026Back to the Familiar Future: Failure Recovery for VLA Policies via Pre-Imagined Milestone Selection8 Jun 2026
- 2026TBD-VLA: Temporal Block Diffusion Vision Language Action Model5 Jun 2026
- 2026Coarse-to-Control: Action-Token Planning for Vision-Language-Action Models5 Jun 2026
- 2026DFM-VLA: Iterative Action Refinement for Robot Manipulation via Discrete Flow Matching27 Mar 2026
- 2026Fast-dVLA: Accelerating Discrete Diffusion VLA to Real-Time Performance26 Mar 2026
12 newest of 16 All 16 (JSON)
- 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 104
- 2026World Action Models: The Next Frontier in Embodied AIcited by 46
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routingcited by 41
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?cited by 33
- 2026Interactive World Simulator for Robot Policy Training and Evaluationcited by 27
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Modelscited by 21
- 2026FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignmentcited by 19
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systemscited by 13
- 2026World Action Models: A Surveycited by 10
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fieldscited by 9
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AIcited by 8
- 2026Point Tracking Improves World Action Modelscited by 7
12 most cited of 14 All 14 (JSON)
- 2026Foresight Without Seeing: Latent Futures for World Action Models12 Aug 2026
- 20264D-WAM: Infusing Spatiotemporal Awareness into World Action Models through Trajectory Fields8 Aug 2026
- 2026Enfold: Folding World Model Imagination into Predictive Representations for Ultra-Efficient Embodied Control29 Jul 2026
- 2026World Action Models: A Survey18 Jun 2026
- 2026ImageWAM: Do World Action Models Really Need Video Generation, or Just Image Editing?17 Jun 2026
- 2026Kairos: A Regret-Aware Native World-Action Model Stack for Physical AI15 Jun 2026
- 2026AHA-WAM:Asynchronous Horizon-Adaptive World-Action Modeling with Observation-Guided Context Routing8 Jun 2026
- 2026Point Tracking Improves World Action Models22 May 2026
- 2026World Action Models: The Next Frontier in Embodied AI12 May 2026
- 2026World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems16 Apr 2026
- 2026Interactive World Simulator for Robot Policy Training and Evaluation9 Mar 2026
- 2026AtomVLA: Scalable Post-Training for Robotic Manipulation via Predictive Latent World Models9 Mar 2026
12 newest of 14 All 14 (JSON)
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Modelscited by 19
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuningcited by 3
- 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulationcited by 2
- 2026BlockVLA: Accelerating Autoregressive VLA via Block Diffusion Finetuning13 May 2026
- 2026Thinking in Text and Images: Interleaved Vision--Language Reasoning Traces for Long-Horizon Robot Manipulation1 May 2026
- 2026Latent Reasoning VLA: Latent Thinking and Prediction for Vision-Language-Action Models1 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025NinA: Normalizing Flows in Action. Training VLA Models with Normalizing Flows
- 2026StairVLA: Stage-Aware Hierarchical Action Generation for Vision-Language-Action Models
- 2024Dual Diffusion for Unified Image Generation and Understanding
- 2025E0: Enhancing Generalization and Fine-Grained Control in VLA Models via Tweedie Discrete Diffusion
- 2025Dita: Scaling Diffusion Transformer for Generalist Vision-Language-Action Policy
- 2025HybridVLA: Collaborative Diffusion and Autoregression in a Unified Vision-Language-Action Model
- 2025Dynamic VLM-Guided Negative Prompting for Diffusion Models
- 2026Catch Me If You Can: Real-Time Feedback Denoising for Responsive VLAs