A Survey of Generative Categories and Techniques in Multimodal Generative Models
On the map: Mixture-of-experts → Multimodal MoE models
Abstract (arXiv)
Multimodal Generative Models (MGMs) have rapidly evolved beyond text generation, now spanning diverse output modalities including images, music, video, human motion, and 3D objects, by integrating language with other sensory modalities under unified architectures. This survey categorises six primary generative modalities and examines how foundational techniques, namely Self-Supervised Learning (SSL), Mixture of Experts (MoE), Reinforcement Learning from Human Feedback (RLHF), and Chain-of-Thought (CoT) prompting, enable cross-modal capabilities. We analyze key models, architectural trends, and emergent cross-modal synergies, while highlighting transferable techniques and unresolved challenges. Building on a common taxonomy of models and training recipes, we propose a unified evaluation framework centred on faithfulness, compositionality, and robustness, and synthesise evidence from benchmarks and human studies across modalities. We further analyse trustworthiness, safety, and ethical risks, including multimodal bias, privacy leakage, and the misuse of high-fidelity media generation for deepfakes, disinformation, and copyright infringement in music and 3D assets, together with emerging mitigation strategies. Finally, we discuss how architectural trends, evaluation protocols, and governance mechanisms can be co-designed to close current capability and safety gaps, outlining critical paths toward more general-purpose, controllable, and accountable multimodal generative systems.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. First posted on arXiv 29 May 2025.
Builds on
0 of 0 references.
No references here yet.
Built on by
Citing papers per year: 2025: 1; 2026: 3.
4 papers.
- 2025HUMORCHAIN: Theory-Guided Multi-Stage Reasoning for Interpretable Multimodal Humor Generationcited by 4
- 2026PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMscited by 3
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMscited by 2
- 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&Acited by 1
- 2026Knowing the Self, Understanding the World: A Dual-Cognition Benchmark for UAV Spatio-temporal Reasoning with MLLMs17 Jul 2026
- 2026MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A2 Jun 2026
- 2026PlaM: Training-Free Plateau-Guided Model Merging for Better Visual Grounding in MLLMs12 Jan 2026
- 2025HUMORCHAIN: Theory-Guided Multi-Stage Reasoning for Interpretable Multimodal Humor Generation21 Nov 2025
Similar, not cited
Close in wording, no citation either way
- 2024LLMs Meet Multimodal Generation and Editing: A Survey
- 2024Multi-modal Generative AI: Multi-modal LLMs, Diffusions, and the Unification
- 2026MSP: Modality Self-Play for Training Multimodal LLMs Without Paired Cross-Modal Data
- 2025Disentanglement of Variations with Multimodal Generative Modeling
- 2026DuoGen: Towards General Purpose Interleaved Multimodal Generation
- 2024A Comprehensive Survey and Guide to Multimodal Large Language Models in Vision-Language Tasks
- 2026Toward Native Multimodal Modeling: A Roadmap
- 2023MiniGPT-5: Interleaved Vision-and-Language Generation via Generative Vokens