mlsanityData to 13 Oct 2026

Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generation

arXiv 2510.24821 ↗First posted 28 Oct 2025cs.CV cs.AIcited by 21

On the map: Mixture-of-experts → Multimodal MoE models

Abstract (arXiv)

We propose Ming-Flash-Omni, an upgraded version of Ming-Omni, built upon a sparser Mixture-of-Experts (MoE) variant of Ling-Flash-2.0 with 100 billion total parameters, of which only 6.1 billion are active per token. This architecture enables highly efficient scaling (dramatically improving computational efficiency while significantly expanding model capacity) and empowers stronger unified multimodal intelligence across vision, speech, and language, representing a key step toward Artificial General Intelligence (AGI). Compared to its predecessor, the upgraded version exhibits substantial improvements across multimodal understanding and generation. Notably, it achieves strong performance on vision-language understanding benchmarks, with overall scores on par with Gemini 2.5 Pro, and enables seamless switching among multimodal tasks in multi-turn interactions. In speech, it achieves strong performance in contextual and dialect-aware ASR while enabling joint, continuous-generation of speech, sound, and music. In vision, it introduces generative semantic segmentation that achieves competitive standalone performance and enhances spatial control and editing consistency, alongside marked improvements in identity preservation, and high-fidelity in-image text rendering. Together, these capabilities demonstrate that a single unified model can serve as a practical foundation for general-purpose multimodal intelligence.

Key facts. Cited by 21 papers in the map (data through 13 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 74 of its 85 references that are in the map. First posted on arXiv 28 Oct 2025.

Builds on

74 of 85 references.

Closest ancestors · 1

Same direction, newest first

  1. 2025Kimi-VL Technical Report10 Apr

Other references · 73

  1. 2014Microsoft COCO: Common Objects in Contextcited by 17,550
  2. 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
  3. 2025Qwen2.5-VL Technical Reportcited by 5,499
  4. 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,004
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
  6. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,546
  7. 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,118
  8. 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,057
  9. 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,851
  10. 2019Towards VQA Models That Can Readcited by 1,705
  11. 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,595
  12. 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,461
38 more
  1. 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,389
  2. 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,295
  3. 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,230
  4. 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,222
  5. 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,092
  6. 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,058
  7. 2025Qwen-Image Technical Reportcited by 1,002
  8. 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 953
  9. 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 899
  10. 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 898
  11. 2018Panoptic Segmentationcited by 798
  12. 2016A Diagram Is Worth A Dozen Imagescited by 796
  13. 2025Qwen2.5-Omni Technical Reportcited by 714
  14. 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 653
  15. 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 580
  16. 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 577
  17. 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 576
  18. 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 521
  19. 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 470
  20. 2025Qwen3-Omni Technical Reportcited by 464
  21. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 463
  22. 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 456
  23. 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 424
  24. 2025LLMs Get Lost In Multi-Turn Conversationcited by 418
  25. 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 366
  26. 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 311
  27. 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 297
  28. 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 242
  29. 2025Transfer between Modalities with MetaQueriescited by 232
  30. 2025Kimi-Audio Technical Reportcited by 217
  31. 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 213
  32. 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
  33. 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 193
  34. 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 191
  35. 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 180
  36. 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 138
  37. 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 137
  38. 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90

50 most cited of 73 All 73 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2025: 2; 2026: 19.

21 papers.

Sort:

By area:

  1. 2026Image Generators are Generalist Vision Learnerscited by 42
  2. 2026UI-Venus-1.5 Technical Reportcited by 39
  3. 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 18
  4. 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13
  5. 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
  6. 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimizationcited by 5
  7. 2026Logics-Parsing-Omni Technical Reportcited by 4
  8. 2025Improving Autoformalization Using Direct Dependency Retrievalcited by 2
  9. 2025Does Hearing Help Seeing? Investigating Audio-Video Joint Denoising for Video Generationcited by 2
  10. 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
  11. 2026Orchestra-o1: Omnimodal Agent Orchestrationcited by 2
  12. 2026TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videoscited by 1
9 more
  1. 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 1
  2. 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 1
  3. 2026UI-Venus-2 Technical Reportcited by 1
  4. 2026Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interactioncited by 1
  5. 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
  6. 2026Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Timecited by 0
  7. 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Modelscited by 0
  8. 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesiscited by 0
  9. 2026OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentationcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal Interaction
  2. 2025Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perception
  3. 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
  4. 2025LongCat-Flash-Omni Technical Report
  5. 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion
  6. 2026Omni-C: Compressing Heterogeneous Modalities into a Single Dense Encoder
  7. 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching
  8. 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model