LVLM-Composer's Explicit Planning for Image Generation
On the map: Multimodal LLMs / vision-language models → VLM benchmarks and visual reasoning
Abstract (arXiv)
The burgeoning field of generative artificial intelligence has fundamentally reshaped our approach to content creation, with Large Vision-Language Models (LVLMs) standing at its forefront. While current LVLMs have demonstrated impressive capabilities in text-to-image generation, they often falter when confronted with complex textual descriptions demanding precise compositional understanding and visual planning. This limitation particularly impacts the accurate rendering of multiple objects, their attributes, spatial relationships, and specific poses within intricate scenes, as evidenced by benchmarks like LongBench-T2I. To address these challenges, we introduce LVLM-Composer, a novel 10-billion parameter scale LVLM specifically engineered for enhanced compositional image synthesis. Our method incorporates a Hierarchical Semantic Planning Module for structured prompt decomposition and a Fine-Grained Feature Alignment Mechanism for precise visual guidance during generation. We propose a multi-stage training paradigm, featuring Hierarchical Semantic-Visual Grounding Pre-training and Compositional Planning Reinforcement Learning with Self-Correction, to instill robust compositional reasoning. Extensive experiments on the LongBench-T2I benchmark, utilizing automatic evaluation by Gemini-2.0-Flash and InternVL3-78B, demonstrate LVLM-Composer's superior performance across critical compositional dimensions including object accuracy, composition fidelity, and pose accuracy, significantly outperforming state-of-the-art baselines. An in-depth ablation study further validates the indispensable contribution of our proposed modules, while human evaluations confirm the perceptual superiority of our generated images. LVLM-Composer represents a significant step towards truly controllable and compositionally accurate open-ended text-to-image generation.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in VLM benchmarks and visual reasoning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 22 of its 31 references that are in the map. First posted on arXiv 5 Jul 2025.
Builds on
22 of 31 references.
References · 22
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,403
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,355
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
- 2022CoCa: Contrastive Captioners are Image-Text Foundation Modelscited by 1,274
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 812
- 2021Florence: A New Foundation Model for Computer Visioncited by 804
- 2023Thread of Thought Unraveling Chaotic Contextscited by 72
10 more
- 2025Diffusion-4K: Ultra-High-Resolution Image Synthesis with Latent Diffusion Modelscited by 65
- 2025Interleave-VLA: Enhancing Robot Manipulation with Interleaved Image-Text Instructionscited by 51
- 2025MAM: Modular Multi-Agent Framework for Multi-Modal Medical Diagnosis via Role-Specialized Collaborationcited by 40
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generationcited by 30
- 2023Improving Cross-modal Alignment for Text-Guided Image Inpaintingcited by 21
- 2025ComplexBench-Edit: Benchmarking Complex Instruction-Driven Image Editing via Compositional Dependenciescited by 21
- 2024VisLingInstruct: Elevating Zero-Shot Learning in Multi-Modal Language Models with Autonomous Instruction Optimizationcited by 16
- 2025Divide-Then-Aggregate: An Efficient Tool Learning Method via Parallel Tool Invocationcited by 16
- 2022SDA: Simple Discrete Augmentation for Contrastive Sentence Representation Learningcited by 8
- 2022Training Latent Variable Models with Auto-encoding Variational Bayes: A Tutorialcited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Unlocking Compositional Control: Self-Supervision for LVLM-Based Image Generation
- 2025GoT-R1: Unleashing Reasoning Capability of MLLM for Visual Generation with Reinforcement Learning
- 2025LumiGen: An LVLM-Enhanced Iterative Framework for Fine-Grained Text-to-Image Generation
- 2025Compositional Image Synthesis with Inference-Time Scaling
- 2025Growing Visual Generative Capacity for Pre-Trained MLLMs
- 2025Follow-Your-Instruction: A Comprehensive MLLM Agent for World Data Synthesis
- 2024GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis
- 2026Iterative Refinement Improves Compositional Image Generation