mlsanityData to 14 Oct 2026

Dynin-Robotics: Omnimodal Unified Diffusion Vision-Language-Action Model

arXiv 2609.13053 ↗First posted 11 Sep 2026cs.RO cs.AI cs.LGcited by 0

On the map: Vision-language-action models → Efficient VLA inference and adaptation

Abstract (arXiv)

Visual goal and dynamics prediction can provide language-conditioned robot policies with both a target outcome and a representation of action-dependent scene changes. We bring these predictions into action generation and selection through a shared trajectory model. Dynin-Robotics implements this formulation on Dynin-Omni, an omnimodal masked-diffusion backbone, representing language, visual observations, goals, and actions as discrete tokens. By varying conditioning and target spans, the same model learns action prediction, action-conditioned next-observation prediction, terminal goal-state prediction, and trajectory-to-instruction reconstruction. These interfaces support test-time scaling through goal prediction, action-candidate evaluation, and joint refinement of action and future-state predictions. We continually pretrain the model on approximately 1.33 million trajectories from 48 Open X-Embodiment datasets and adapt it separately to downstream domains. On two VLABench tasks, robot pretraining improves adaptation within a fixed Stage-2 step budget, and the full objective mixture improves shifted-instruction success over Policy-only post-training under the same coupled decoder. Combining goal guidance with joint action-next-state denoising further improves shifted-instruction success over action-only decoding; the benefit depends on how the predictions are composed. Dynin-Robotics achieves competitive performance on LIBERO and zero-shot LIBERO-Plus, together with a 78.4% average success rate across four manipulation conditions on a Franka Research 3 robot. An optimized block-parallel implementation accelerates model-side action decoding by up to 29.2x relative to the base implementation under the reported profiling setup. These results support shared trajectory modeling as a common interface for learning complementary robot objectives and composing their predictions during control.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Efficient VLA inference and adaptation, one of 13 directions in Vision-language-action models. Builds on 58 of its 89 references that are in the map. First posted on arXiv 11 Sep 2026.

Builds on

58 of 89 references.

Closest ancestors · 7

Same direction, newest first

  1. 2026dVLA-RL: Reinforcement Learning over Denoising Trajectories for Discrete Diffusion Vision-Language-Action Models22 Jun
  2. 2026MMaDA-VLA: Large Diffusion Vision-Language-Action Model with Unified Multi-Modal Instruction and Generation26 Mar
  3. 2025Unified Diffusion VLA: Vision-Language-Action Model via Joint Discrete Denoising Diffusion Process3 Nov
  4. 2025dVLA: Diffusion Vision-Language-Action Model with Multimodal Chain-of-Thought30 Sep
  5. 2025CogVLA: Cognition-Aligned Vision-Language-Action Model via Instruction-Driven Routing & Sparsification28 Aug
  6. 2025Discrete Diffusion VLA: Bringing Discrete Diffusion to Action Decoding in Vision-Language-Action Policies27 Aug
  7. 2025FAST: Efficient Action Tokenization for Vision-Language-Action Models16 Jan

Other references · 51

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2023GPT-4 Technical Reportcited by 18,396
  3. 2017Proximal Policy Optimization Algorithmscited by 15,215
  4. 2024The Llama 3 Herd of Modelscited by 14,715
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2024Qwen2.5 Technical Reportcited by 4,942
  7. 2024π0: A Vision-Language-Action Flow Model for General Robot Controlcited by 2,407
  8. 2025GR00T N1: An Open Foundation Model for Generalist Humanoid Robotscited by 1,225
  9. 2025Large Language Diffusion Modelscited by 912
  10. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 897
  11. 2025Fine-Tuning Vision-Language-Action Models: Optimizing Speed and Successcited by 883
  12. 2023Open X-Embodiment: Robotic Learning Datasets and RT-X Modelscited by 862
38 more
  1. 2024DROID: A Large-Scale In-The-Wild Robot Manipulation Datasetcited by 852
  2. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
  3. 2024DeepSeek-V3 Technical Reportcited by 811
  4. 2024Emu3: Next-Token Prediction is All You Needcited by 781
  5. 2025Dream 7B: Diffusion Large Language Modelscited by 544
  6. 2025SpatialVLA: Exploring Spatial Representations for Visual-Language-Action Modelcited by 519
  7. 2025WorldVLA: Towards Autoregressive Action World Modelcited by 367
  8. 2026Fast-WAM: Do World Action Models Need Test-time Future Imagination?cited by 349
  9. 2024SEED-X: Multimodal Models with Unified Multi-granularity Comprehension and Generationcited by 331
  10. 2026Causal World Modeling for Robot Controlcited by 321
  11. 2025X-VLA: Soft-Prompted Transformer as Scalable Cross-Embodiment Vision-Language-Action Modelcited by 303
  12. 2025LIBERO-Plus: In-depth Robustness Analysis of Vision-Language-Action Modelscited by 303
  13. 2026Cosmos Policy: Fine-Tuning Video Models for Visuomotor Control and Planningcited by 300
  14. 2023DreamLLM: Synergistic Multimodal Comprehension and Creationcited by 297
  15. 2025Show-o2: Improved Native Unified Multimodal Modelscited by 250
  16. 2025Unified World Models: Coupling Video and Action Diffusion for Pretraining on Large Robotic Datasetscited by 240
  17. 2025mimic-video: Video-Action Models for Generalizable Robot Control Beyond VLAscited by 142
  18. 2025Interactive Post-Training for Vision-Language-Action Modelscited by 135
  19. 2025Unified Vision-Language-Action Modelcited by 134
  20. 2025NORA: A Small Open-Sourced Generalist Vision Language Action Model for Embodied Taskscited by 127
  21. 2026VLA-JEPA: Enhancing Vision-Language-Action Model with Latent World Modelcited by 118
  22. 2026ABot-M0: VLA Foundation Model for Robotic Manipulation with Action Manifold Learningcited by 103
  23. 2025UP-VLA: A Unified Understanding and Prediction Model for Embodied Agentcited by 102
  24. 2025Video Generators are Robot Policiescited by 92
  25. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understandingcited by 88
  26. 2025F1: A Vision-Language-Action Model Bridging Understanding and Generation to Actionscited by 86
  27. 2025InternVLA-M1: A Spatially Guided Vision-Language-Action Framework for Generalist Robot Policycited by 84
  28. 2025RynnVLA-002: A Unified Vision-Language-Action and World Modelcited by 74
  29. 2025Unified Multimodal Discrete Diffusioncited by 49
  30. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocitiescited by 46
  31. 2024EMOVA: Empowering Language Models to See, Hear and Speak with Vivid Emotionscited by 45
  32. 2025dInfer: An Efficient Inference Framework for Diffusion Language Modelscited by 37
  33. 2025LLaDA-VLA: Vision Language Diffusion Action Modelscited by 30
  34. 2025Goal-VLA: Image-Generative VLMs as Object-Centric World Models Empowering Zero-shot Robot Manipulationcited by 15
  35. 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generationcited by 15
  36. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13
  37. 2025D3P: Dynamic Denoising Diffusion Policy via Reinforcement Learningcited by 10
  38. 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Modelcited by 5

50 most cited of 51 All 51 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Rethinking Visual-Language-Action Model Scaling: Alignment, Mixture, and Regularization
  2. 2026ViDAL: A Visual Dynamics-Grounded Action Latent Space for Vision-Language-Action Models
  3. 2026Wall-OSS-0.5 Technical Report
  4. 2025Align-Then-stEer: Adapting the Vision-Language Action Models through Unified Latent Guidance
  5. 2026VLS: Steering Pretrained Robot Policies via Vision-Language Models
  6. 2026Two Bridges, One Pathway: From VLMs to Generalizable VLAs with Embodied Trajectory-Coupled Data
  7. 2026Vision-Language-Action in Robotics: A Survey of Datasets, Benchmarks, and Data Engines
  8. 2025Enhancing Generalization in Vision-Language-Action Models by Preserving Pretrained Representations