mlsanityData to 7 Oct 2026

Dynin-Omni: Omnimodal Unified Large Diffusion Language Model

arXiv 2604.00007 ↗First posted 9 Mar 2026cs.CL cs.AIcited by 2

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

We present Dynin-Omni, the first masked-diffusion-based omnimodal foundation model that unifies text, image, and speech understanding and generation, together with video understanding, within a single architecture. Unlike autoregressive unified models that serialize heterogeneous modalities, or compositional unified models that require orchestration with external modality-specific decoders, Dynin-Omni natively formulates omnimodal modeling as masked diffusion over a shared discrete token space, enabling iterative refinement under bidirectional context. Dynin-Omni adopts a multi-stage training strategy with model-merging-based modality expansion and omnimodal alignment. We evaluate Dynin-Omni across 19 multimodal benchmarks spanning language reasoning, image generation and editing, video understanding, and speech recognition and synthesis. Dynin-Omni achieves 87.6 on GSM8K, 1733.6 on MME-P, 61.4 on VideoMME, 0.87 on GenEval, and 2.1 WER on LibriSpeech test-clean, consistently outperforming existing open-source unified models while remaining competitive with strong modality-specific expert systems. These results demonstrate the potential of masked diffusion as a unified paradigm for any-to-any modeling, providing a flexible foundation for real-time omnimodal systems, unified cross-modal retrieval and generation, and embodied multimodal agents.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 119 of its 130 references that are in the map. First posted on arXiv 9 Mar 2026.

Builds on

119 of 130 references.

Closest ancestors · 9

Same direction, newest first

  1. 2025Lumina-DiMOO: An Omni Diffusion Large Language Model for Multi-Modal Generation and Understanding7 Oct
  2. 2025Lavida-O: Elastic Large Masked Diffusion Models for Unified Multimodal Understanding and Generation23 Sep
  3. 2025Show-o2: Improved Native Unified Multimodal Models18 Jun
  4. 2025Muddit: Liberating Generation Beyond Text-to-Image with a Unified Discrete Diffusion Model29 May
  5. 2025FUDOKI: Discrete Flow-based Unified Understanding and Generation via Kinetic-Optimal Velocities26 May
  6. 2025MMaDA: Multimodal Large Diffusion Language Models21 May
  7. 2024Emu3: Next-Token Prediction is All You Need27 Sep
  8. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  9. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignment17 Oct

Other references · 110

  1. 2024The Llama 3 Herd of Modelscited by 14,192
  2. 2021Training Verifiers to Solve Math Word Problemscited by 9,743
  3. 2025Qwen3 Technical Reportcited by 8,195
  4. 2020Measuring Massive Multitask Language Understandingcited by 7,768
  5. 2025Qwen2.5-VL Technical Reportcited by 5,418
  6. 2021Measuring Mathematical Problem Solving With the MATH Datasetcited by 5,203
  7. 2018Think you have Solved Question Answering? Try ARC, the AI2 Reasoning Challengecited by 4,710
  8. 2023GPQA: A Graduate-Level Google-Proof Q&A Benchmarkcited by 2,748
  9. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,669
  10. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,536
  11. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,534
  12. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,105
38 more
  1. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,044
  2. 2025InternVL3: Exploring Advanced Training and Test-Time Recipes for Open-Source Multimodal Modelscited by 1,769
  3. 2023Evaluating Object Hallucination in Large Vision-Language Modelscited by 1,696
  4. 2021Structured Denoising Diffusion Models in Discrete State-Spacescited by 1,665
  5. 2023MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Modelscited by 1,624
  6. 2021ViViT: A Video Vision Transformercited by 1,610
  7. 2021Is Space-Time Attention All You Need for Video Understanding?cited by 1,609
  8. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,375
  9. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,358
  10. 2025gpt-oss-120b & gpt-oss-20b Model Cardcited by 1,258
  11. 2021Frozen in Time: A Joint Video and Image Encoder for End-to-End Retrievalcited by 1,175
  12. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,086
  13. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  14. 2022Editing Models with Task Arithmeticcited by 1,076
  15. 2024MiniCPM-V: A GPT-4V Level MLLM on Your Phonecited by 1,061
  16. 2022Diffusion-LM Improves Controllable Text Generationcited by 1,006
  17. 2023Pick-a-Pic: An Open Dataset of User Preferences for Text-to-Image Generationcited by 950
  18. 2025Large Language Diffusion Modelscited by 872
  19. 2025Emerging Properties in Unified Multimodal Pretrainingcited by 855
  20. 2024Cambrian-1: A Fully Open, Vision-Centric Exploration of Multimodal LLMscited by 822
  21. 2024Simple and Effective Masked Diffusion Language Modelscited by 800
  22. 2023TIES-Merging: Resolving Interference When Merging Modelscited by 795
  23. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 787
  24. 2021NExT-QA:Next Phase of Question-Answering to Explaining Temporal Actionscited by 735
  25. 2024Show-o: One Single Transformer to Unify Multimodal Understanding and Generationcited by 734
  26. 2025Qwen2.5-Omni Technical Reportcited by 704
  27. 2023Language Models are Super Mario: Absorbing Abilities from Homologous Models as a Free Lunchcited by 679
  28. 2023Language Model Beats Diffusion -- Tokenizer is Key to Visual Generationcited by 633
  29. 2023NExT-GPT: Any-to-Any Multimodal LLMcited by 610
  30. 2019ActivityNet-QA: A Dataset for Understanding Complex Web Videos via Question Answeringcited by 559
  31. 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
  32. 2024LLaVA-Video: Video Instruction Tuning With Synthetic Datacited by 550
  33. 2024Qwen2-Audio Technical Reportcited by 543
  34. 2024Transfusion: Predict the Next Token and Diffuse Images with One Multi-Modal Modelcited by 468
  35. 2025Qwen3-Omni Technical Reportcited by 451
  36. 2025GLM-4.5: Agentic, Reasoning, and Coding (ARC) Foundation Modelscited by 446
  37. 2022DiffuSeq: Sequence to Sequence Text Generation with Diffusion Modelscited by 439
  38. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 417

50 most cited of 110 All 110 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion
  2. 2026LLaDA-o: An Effective and Length-Adaptive Omni Diffusion Model
  3. 2025Omni-Video: Democratizing Unified Video Understanding and Generation
  4. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model
  5. 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
  6. 2024OmniBench: Towards The Future of Universal Omni-Language Models
  7. 2026Omni-Video 2: Scaling MLLM-Conditioned Diffusion for Unified Video Generation and Editing
  8. 2026OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models