Iterative Refinement Improves Compositional Image Generation
On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning
Abstract (arXiv)
Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as parallel sampling with verifiers or simply increasing denoising steps, can improve prompt alignment but remain inadequate for richly compositional settings where many constraints must be satisfied. Inspired by the success of chain-of-thought reasoning in large language models, we propose an iterative test-time strategy in which a T2I model progressively refines its generations across multiple steps, guided by feedback from a vision-language model as the critic in the loop. Our approach is simple, requires no external tools or priors, and can be flexibly applied to a wide range of image generators and vision-language models. Empirically, we demonstrate consistent gains on image generation across benchmarks: a 16.9% improvement in all-correct rate on ConceptMix (k=7), a 13.8% improvement on T2I-CompBench (3D-Spatial category) and a 12.5% improvement on Visual Jenga scene decomposition compared to compute-matched parallel sampling. Beyond quantitative gains, iterative refinement produces more faithful generations by decomposing complex prompts into sequential corrections, with human evaluators preferring our method 58.7% of the time over 41.3% for the parallel baseline. Together, these findings highlight iterative self-correction as a broadly applicable principle for compositional image generation. Results and visualizations are available at https://iterative-img-gen.github.io/
Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 37 references that are in the map. First posted on arXiv 21 Jan 2026.
Builds on
27 of 37 references.
Closest ancestors · 1
Same direction, newest first
Other references · 26
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
- 2022Classifier-Free Diffusion Guidancecited by 5,785
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
- 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,367
- 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
- 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,954
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,921
- 2025Qwen-Image Technical Reportcited by 1,002
- 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 970
14 more
- 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 799
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 777
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 701
- 2023Aligning Text-to-Image Models using Human Feedbackcited by 420
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 339
- 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 286
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
- 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 231
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
- 2025Seedream 3.0 Technical Reportcited by 150
- 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 67
- 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
- 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 49
- 2025Visual Jenga: Discovering Object Dependencies via Counterfactual Inpaintingcited by 11
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generationcited by 6
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibrationcited by 2
- 2026Personalization as Inverse Planning: Learning Latent Design Intents for Agentic Slide Generation via Structural Denoisingcited by 0
- 2026The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generationcited by 0
- 2026The Plan, Not the Decoder: Diagnosing and Repairing Compositional Failure in Reasoning-Augmented Text-to-Image Generation22 Aug 2026
- 2026Personalization as Inverse Planning: Learning Latent Design Intents for Agentic Slide Generation via Structural Denoising1 Jul 2026
- 2026OmniVerifier-M1: Multimodal Meta-Verifier with Explicit Structured Recalibration27 May 2026
- 2026SCOPE: Structured Decomposition and Conditional Skill Orchestration for Complex Image Generation8 May 2026
Similar, not cited
Close in wording, no citation either way
- 2026EPIC: Efficient Predicate-Guided Inference-Time Control for Compositional Text-to-Image Generation
- 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
- 2025Test-time Prompt Refinement for Text-to-Image Models
- 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
- 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
- 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
- 2025Compositional Image Synthesis with Inference-Time Scaling
- 2024GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis