Dynin-Omni: Omnimodal Unified Large Diffusion Language Model
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
We present Dynin-Omni, the first masked-diffusion-based omnimodal foundation model that unifies text, image, and speech understanding and generation, together with video understanding, within a single architecture. Unlike autoregressive unified models that serialize heterogeneous modalities, or compositional unified models that require orchestration with external modality-specific decoders, Dynin-Omni natively formulates omnimodal modeling as masked diffusion over a shared discrete token space, enabling iterative refinement under bidirectional context. Dynin-Omni adopts a multi-stage training strategy with model-merging-based modality expansion and omnimodal alignment. We evaluate Dynin-Omni across 19 multimodal benchmarks spanning language reasoning, image generation and editing, video understanding, and speech recognition and synthesis. Dynin-Omni achieves 87.6 on GSM8K, 1733.6 on MME-P, 61.4 on VideoMME, 0.87 on GenEval, and 2.1 WER on LibriSpeech test-clean, consistently outperforming existing open-source unified models while remaining competitive with strong modality-specific expert systems. These results demonstrate the potential of masked diffusion as a unified paradigm for any-to-any modeling, providing a flexible foundation for real-time omnimodal systems, unified cross-modal retrieval and generation, and embodied multimodal agents.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 119 of its 130 references that are in the map. First posted on arXiv 9 Mar 2026.
Builds on
119 of 130 references.
Closest ancestors · 9
Same direction, newest first
- 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understanding7 Oct
- 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation23 Sep
- 2025Show-o2: Improved Native Unified Multimodal Models18 Jun
- 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model29 May
- 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocities26 May
- 2025MMaDA: Multimodal Large Diffusion Language Models21 May
- 2024Emu3: Next-Token Prediction is All You Need27 Sep
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct
Other references · 110
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021Training Verifiers to Solve Math Word Problemscited by 9,743
- 2025Qwen3 Technical Reportcited by 8,195
- 2020Measuring Massive Multitask Language Understandingcited by 7,768
- 2025Qwen2.5-VL Technical Reportcited by 5,418
- 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
- 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
- 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
38 more
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
- 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
- 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
- 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
- 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
- 2021ViViT: A Video Vision Transformercited by 1,610
- 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
- 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
- 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2022Editing Models with Task Arithmeticcited by 1,076
- 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
- 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
- 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
- 2025Large Language Diffusion Modelscited by 872
- 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
- 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
- 2024Simple and Effective Masked Diffusion Language Modelscited by 800
- 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
- 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
- 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
- 2025Qwen2.5-Omni Technical Reportcited by 704
- 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
- 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
- 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
- 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
- 2024Qwen2-Audio Technical Reportcited by 543
- 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
- 2025Qwen3-Omni Technical Reportcited by 451
- 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
- 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417
50 most cited of 110 All 110 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion
- 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model
- 2025Omni-Video: Democratizing Unified Video Understanding and Generation
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
- 2024OmniBench: Towards The Future of Universal Omni-Language Models
- 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing
- 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models