mlsanityData to 14 Oct 2026

MEPG:Multi-Expert Planning and Generation for Compositionally-Rich Image Generation

arXiv 2509.04126 ↗First posted 4 Sep 2025cs.CV cs.AIcited by 0

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Text-to-image diffusion models have achieved remarkable image quality, but they still struggle with complex, multiele ment prompts, and limited stylistic diversity. To address these limitations, we propose a Multi-Expert Planning and Gen eration Framework (MEPG) that synergistically integrates position- and style-aware large language models (LLMs) with spatial-semantic expert modules. The framework comprises two core components: (1) a Position-Style-Aware (PSA) module that utilizes a supervised fine-tuned LLM to decom pose input prompts into precise spatial coordinates and style encoded semantic instructions; and (2) a Multi-Expert Dif fusion (MED) module that implements cross-region genera tion through dynamic expert routing across both local regions and global areas. During the generation process for each lo cal region, specialized models (e.g., realism experts, styliza tion specialists) are selectively activated for each spatial par tition via attention-based gating mechanisms. The architec ture supports lightweight integration and replacement of ex pert models, providing strong extensibility. Additionally, an interactive interface enables real-time spatial layout editing and per-region style selection from a portfolio of experts. Ex periments show that MEPG significantly outperforms base line models with the same backbone in both image quality and style diversity.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 27 of its 35 references that are in the map. First posted on arXiv 4 Sep 2025.

Builds on

27 of 35 references.

Closest ancestors · 7

Same direction, newest first

  1. 2024MoLE: Enhancing Human-centric Text-to-image Diffusion via Mixture of Low-rank Experts30 Oct
  2. 2024ELLA: Equip Diffusion Models with LLM for Enhanced Semantic Alignment8 Mar
  3. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
  4. 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusion20 Jul
  5. 2023RAPHAEL: Text-to-Image Generation via Large Mixture of Diffusion Paths29 May
  6. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generation30 Mar
  7. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 20

  1. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  4. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  5. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
  6. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,181
  7. 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
  8. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
  9. 2017Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layercited by 3,509
  10. 2021Switch Transformers: Scaling to Trillion Parameter Models with Simple and Efficient Sparsitycited by 3,073
  11. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  12. 2023Training Diffusion Models with Reinforcement Learningcited by 982
8 more
  1. 2021GLaM: Efficient Scaling of Language Models with Mixture-of-Expertscited by 897
  2. 2024DeepSeekMoE: Towards Ultimate Expert Specialization in Mixture-of-Experts Language Modelscited by 867
  3. 2024Autoregressive Model Beats Diffusion: Llama for Scalable Image Generationcited by 777
  4. 2023Aligning Text-to-Image Models using Human Feedbackcited by 422
  5. 2025GoT: Unleashing Reasoning Capability of Multimodal Large Language Model for Visual Generation and Editingcited by 104
  6. 2024Aesthetic Post-Training Diffusion Models from Generic Preferences with Step-by-step Preference Optimizationcited by 84
  7. 2024A Dense Reward View on Aligning Text-to-Image Diffusion with Preferencecited by 55
  8. 2024LAION-SG: An Enhanced Large-Scale Dataset for Training Complex Image-Text Models with Structural Annotationscited by 12

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025EliGen: Entity-Level Controlled Image Generation with Regional Attention
  2. 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models
  3. 2026Mural: Transferring LLM knowledge to image generation via Mixture-of-Transformers
  4. 2025LDGen: Enhancing Text-to-Image Synthesis via Large Language Model-Driven Language Representation
  5. 2023Reason out Your Layout: Evoking the Layout Master from Large Language Models for Text-to-Image Synthesis
  6. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models
  7. 2024Prompt-Consistency Image Generation (PCIG): A Unified Framework Integrating LLMs, Knowledge Graphs, and Controllable Diffusion Models
  8. 2024DiffusionAgent: Navigating Expert Models for Agentic Image Generation