Ming-Flash-Omni: A Sparse, Unified Architecture for Multimodal Perception and Generation
On the map: Mixture-of-experts → Multimodal MoE models
Abstract (arXiv)
We propose Ming-Flash-Omni, an upgraded version of Ming-Omni, built upon a sparser Mixture-of-Experts (MoE) variant of Ling-Flash-2.0 with 100 billion total parameters, of which only 6.1 billion are active per token. This architecture enables highly efficient scaling (dramatically improving computational efficiency while significantly expanding model capacity) and empowers stronger unified multimodal intelligence across vision, speech, and language, representing a key step toward Artificial General Intelligence (AGI). Compared to its predecessor, the upgraded version exhibits substantial improvements across multimodal understanding and generation. Notably, it achieves strong performance on vision-language understanding benchmarks, with overall scores on par with Gemini 2.5 Pro, and enables seamless switching among multimodal tasks in multi-turn interactions. In speech, it achieves strong performance in contextual and dialect-aware ASR while enabling joint, continuous-generation of speech, sound, and music. In vision, it introduces generative semantic segmentation that achieves competitive standalone performance and enhances spatial control and editing consistency, alongside marked improvements in identity preservation, and high-fidelity in-image text rendering. Together, these capabilities demonstrate that a single unified model can serve as a practical foundation for general-purpose multimodal intelligence.
Key facts. Cited by 21 papers in the map (data through 13 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 74 of its 85 references that are in the map. First posted on arXiv 28 Oct 2025.
Builds on
74 of 85 references.
Closest ancestors · 1
Same direction, newest first
- 2025Kimi-VL Technical Report10 Apr
Other references · 73
- 2014Microsoft COCO: Common Objects in Contextcited by 17,550
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,091
- 2025Qwen2.5-VL Technical Reportcited by 5,499
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,004
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,820
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,546
- 2023MMBench: Is Your Multi-modal Model an All-around Player?cited by 2,118
- 2023MMMU: A Massive Multi-discipline Multimodal Understanding and Reasoning Benchmark for Expert AGIcited by 2,057
- 2019Megatron-LM: Training Multi-Billion Parameter Language Models Using Model Parallelismcited by 1,851
- 2019Towards VQA Models That Can Readcited by 1,705
- 2023MathVista: Evaluating Mathematical Reasoning of Foundation Models in Visual Contextscited by 1,595
- 2022ChartQA: A Benchmark for Question Answering about Charts with Visual and Logical Reasoningcited by 1,461
38 more
- 2024Video-MME: The First-Ever Comprehensive Evaluation Benchmark of Multi-modal LLMs in Video Analysiscited by 1,389
- 2020DocVQA: A Dataset for VQA on Document Imagescited by 1,295
- 2023MM-Vet: Evaluating Large Multimodal Models for Integrated Capabilitiescited by 1,230
- 2025Qwen3 Embedding: Advancing Text Embedding and Reranking Through Foundation Modelscited by 1,222
- 2023MVBench: A Comprehensive Multi-modal Video Understanding Benchmarkcited by 1,092
- 2024M3-Embedding: Multi-Linguality, Multi-Functionality, Multi-Granularity Text Embeddings Through Self-Knowledge Distillationcited by 1,058
- 2025Qwen-Image Technical Reportcited by 1,002
- 2023GenEval: An Object-Focused Framework for Evaluating Text-to-Image Alignmentcited by 953
- 2024Are We on the Right Way for Evaluating Large Vision-Language Models?cited by 899
- 2015Generation and Comprehension of Unambiguous Object Descriptionscited by 898
- 2018Panoptic Segmentationcited by 798
- 2016A Diagram Is Worth A Dozen Imagescited by 796
- 2025Qwen2.5-Omni Technical Reportcited by 714
- 2024LongVideoBench: A Benchmark for Long-context Interleaved Video-Language Understandingcited by 653
- 2024MathVerse: Does Your Multi-modal LLM Truly See the Diagrams in Visual Math Problems?cited by 580
- 2023HallusionBench: An Advanced Diagnostic Suite for Entangled Language Hallucination and Visual Illusion in Large Vision-Language Modelscited by 577
- 2024LLaVA-NeXT-Interleave: Tackling Multi-image, Video, and 3D in Large Multimodal Modelscited by 576
- 2024Measuring Multimodal Mathematical Reasoning with MATH-Vision Datasetcited by 521
- 2023OCRBench: On the Hidden Mystery of OCR in Large Multimodal Modelscited by 470
- 2025Qwen3-Omni Technical Reportcited by 464
- 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignmentcited by 463
- 2021VoxPopuli: A Large-Scale Multilingual Speech Corpus for Representation Learning, Semi-Supervised Learning and Interpretationcited by 456
- 2025Step1X-Edit: A Practical Framework for General Image Editingcited by 424
- 2025LLMs Get Lost In Multi-Turn Conversationcited by 418
- 2017AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baselinecited by 366
- 2023Perception Test: A Diagnostic Benchmark for Multimodal Video Modelscited by 311
- 2024Seed-TTS: A Family of High-Quality Versatile Speech Generation Modelscited by 297
- 2024LogicVista: Multimodal LLM Logical Reasoning Benchmark in Visual Contextscited by 242
- 2025Transfer between Modalities with MetaQueriescited by 232
- 2025Kimi-Audio Technical Reportcited by 217
- 2025DiffusionNFT: Online Diffusion Reinforcement with Forward Processcited by 213
- 2024MetaMorph: Multimodal Understanding and Generation via Instruction Tuningcited by 206
- 2024MMT-Bench: A Comprehensive Multimodal Benchmark for Evaluating Large Vision-Language Models Towards Multitask AGIcited by 193
- 2021WenetSpeech: A 10000+ Hours Multi-domain Mandarin Corpus for Speech Recognitioncited by 191
- 2024MuirBench: A Comprehensive Benchmark for Robust Multi-image Understandingcited by 180
- 2024StreamingBench: Assessing the Gap for MLLMs to Achieve Streaming Video Understandingcited by 138
- 2025OVO-Bench: How Far is Your Video-LLMs from Real-World Online Video Understanding?cited by 137
- 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
50 most cited of 73 All 73 (JSON)
Built on by
Citing papers per year: 2025: 2; 2026: 19.
21 papers.
Sort:
By area:
- 2026Image Generators are Generalist Vision Learnerscited by 42
- 2026UI-Venus-1.5 Technical Reportcited by 39
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 18
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Modelcited by 13
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
- 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimizationcited by 5
- 2026Logics-Parsing-Omni Technical Reportcited by 4
- 2025Improving Autoformalization Using Direct Dependency Retrievalcited by 2
- 2025Does Hearing Help Seeing? Investigating Audio-Video Joint Denoising for Video Generationcited by 2
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2026Orchestra-o1: Omnimodal Agent Orchestrationcited by 2
- 2026TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videoscited by 1
9 more
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 1
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 1
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interactioncited by 1
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generationcited by 1
- 2026Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Timecited by 0
- 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Modelscited by 0
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesiscited by 0
- 2026OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentationcited by 0
- 2026PixelUMM: Encoder-Free Unified Image and Video Understanding and Generation29 Sep 2026
- 2026OPERA: A Unified Omnimodal Progressive Spatio-Temporal Reasoning Agent for Referring Video Segmentation27 Sep 2026
- 2026Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction18 Sep 2026
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Models20 Aug 2026
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis27 Jul 2026
- 2026Orchestra-o1: Omnimodal Agent Orchestration10 Jun 2026
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos8 May 2026
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation27 Apr 2026
- 2026LLaDA2.0-Uni: Unifying Multimodal Understanding and Generation with Diffusion Large Language Model22 Apr 2026
9 more
- 2026Image Generators are Generalist Vision Learners22 Apr 2026
- 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Models20 Mar 2026
- 2026Logics-Parsing-Omni Technical Report10 Mar 2026
- 2026Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Time9 Mar 2026
- 2026UI-Venus-1.5 Technical Report9 Feb 2026
- 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimization5 Feb 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
- 2025Does Hearing Help Seeing? Investigating Audio-Video Joint Denoising for Video Generation2 Dec 2025
- 2025Improving Autoformalization Using Direct Dependency Retrieval15 Nov 2025
- 2026UI-Venus-1.5 Technical Reportcited by 39
- 2026Orchestra-o1: Omnimodal Agent Orchestrationcited by 2
- 2026UI-Venus-2 Technical Reportcited by 1
- 2026UI-Venus-2 Technical Report27 Aug 2026
- 2026Orchestra-o1: Omnimodal Agent Orchestration10 Jun 2026
- 2026UI-Venus-1.5 Technical Report9 Feb 2026
- 2026Toward Native Multimodal Modeling: A Roadmapcited by 6
- 2026Toward Native Multimodal Modeling: A Roadmap25 May 2026
- 2026Image Generators are Generalist Vision Learnerscited by 42
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generationcited by 18
- 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimizationcited by 5
- 2026Logics-Parsing-Omni Technical Reportcited by 4
- 2025Does Hearing Help Seeing? Investigating Audio-Video Joint Denoising for Video Generationcited by 2
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentationcited by 2
- 2026TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videoscited by 1
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Modelscited by 1
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generationcited by 1
- 2026Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interactioncited by 1
- 2026Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Timecited by 0
- 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Modelscited by 0
12 most cited of 13 All 13 (JSON)
- 2026Omni Demand Understanding: A Benchmark for Contextual User-Intent Inference in Multimodal Interaction18 Sep 2026
- 2026FireRedAudio: A General-Purpose Audio Language Model with Decoupled Continuous Representations for Understanding and Generation25 Aug 2026
- 2026Exploring the Performance Frontier of Compact Unified Image Generation Models20 Aug 2026
- 2026Let Me Look at You: Advanced Facial Expression Modeling for Conversational Speech Synthesis27 Jul 2026
- 2026TraceAV-Bench: Benchmarking Multi-Hop Trajectory Reasoning over Long Audio-Visual Videos8 May 2026
- 2026Tuna-2: Pixel Embeddings Beat Vision Encoders for Multimodal Understanding and Generation27 Apr 2026
- 2026Image Generators are Generalist Vision Learners22 Apr 2026
- 2026Sommelier: Scalable Open Multi-turn Audio Pre-processing for Full-duplex Speech Language Models20 Mar 2026
- 2026Logics-Parsing-Omni Technical Report10 Mar 2026
- 2026Listening with the Eyes: Benchmarking Egocentric Co-Speech Grounding across Space and Time9 Mar 2026
- 2026OmniFysics: Towards Physical Intelligence Evolution via Omni-Modal Signal Processing and Network Optimization5 Feb 2026
- 2026Audit After Segmentation: Reference-Free Mask Quality Assessment for Language-Referred Audio-Visual Segmentation3 Feb 2026
12 newest of 13 All 13 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Ming-Lite-Uni: Advancements in Unified Architecture for Natural Multimodal Interaction
- 2025Omni-Captioner: Data Pipeline, Models, and Benchmark for Omni Detailed Perception
- 2025Uni-MoE-2.0-Omni: Scaling Language-Centric Omnimodal Large Model with Advanced MoE, Training and Data
- 2025LongCat-Flash-Omni Technical Report
- 2026Omni-Diffusion: Unified Multimodal Understanding and Generation with Masked Discrete Diffusion
- 2026Omni-C: Compressing Heterogeneous Modalities into a Single Dense Encoder
- 2025NExT-OMNI: Towards Any-to-Any Omnimodal Foundation Models with Discrete Flow Matching
- 2026Dynin-Omni: Omnimodal Unified Large Diffusion Language Model