mlsanityData to 13 Oct 2026

Iterative Refinement Improves Compositional Image Generation

arXiv 2601.15286 ↗First posted 21 Jan 2026cs.CV cs.AI cs.LGcited by 4

On the map: Multimodal LLMs / vision-language models → MLLM training and visual instruction tuning

Abstract (arXiv)

Text-to-image (T2I) models have achieved remarkable progress, yet they continue to struggle with complex prompts that require simultaneously handling multiple objects, relations, and attributes. Existing inference-time strategies, such as parallel sampling with verifiers or simply increasing denoising steps, can improve prompt alignment but remain inadequate for richly compositional settings where many constraints must be satisfied. Inspired by the success of chain-of-thought reasoning in large language models, we propose an iterative test-time strategy in which a T2I model progressively refines its generations across multiple steps, guided by feedback from a vision-language model as the critic in the loop. Our approach is simple, requires no external tools or priors, and can be flexibly applied to a wide range of image generators and vision-language models. Empirically, we demonstrate consistent gains on image generation across benchmarks: a 16.9% improvement in all-correct rate on ConceptMix (k=7), a 13.8% improvement on T2I-CompBench (3D-Spatial category) and a 12.5% improvement on Visual Jenga scene decomposition compared to compute-matched parallel sampling. Beyond quantitative gains, iterative refinement produces more faithful generations by decomposing complex prompts into sequential corrections, with human evaluators preferring our method 58.7% of the time over 41.3% for the parallel baseline. Together, these findings highlight iterative self-correction as a broadly applicable principle for compositional image generation. Results and visualizations are available at https://iterative-img-gen.github.io/

Key facts. Cited by 4 papers in the map (data through 13 Oct 2026). Placed in MLLM training and visual instruction tuning, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 37 references that are in the map. First posted on arXiv 21 Jan 2026.

Builds on

27 of 37 references.

Closest ancestors · 1

Same direction, newest first

  1. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editing8 Jul

Other references · 26

  1. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,376
  2. 2022Classifier-Free Diffusion Guidancecited by 5,785
  3. 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,657
  4. 2022Large Language Models are Zero-Shot Reasonerscited by 4,348
  5. 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,130
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,367
  7. 2023Tree of Thoughts: Deliberate Problem Solving with Large Language Modelscited by 3,181
  8. 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,604
  9. 2024Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameterscited by 1,954
  10. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,921
  11. 2025Qwen-Image Technical Reportcited by 1,002
  12. 2024Large Language Monkeys: Scaling Inference Compute with Repeated Samplingcited by 970
14 more
  1. 2025Janus-Pro: Unified Multimodal Understanding and Generation with Data and Model Scalingcited by 799
  2. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 777
  3. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 701
  4. 2023Aligning Text-to-Image Models using Human Feedbackcited by 420
  5. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 339
  6. 2023Human Preference Score: Better Aligning Text-to-Image Models with Human Preferencecited by 286
  7. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 243
  8. 2025Inference-Time Scaling for Diffusion Models beyond Scaling Denoising Stepscited by 231
  9. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMscited by 224
  10. 2025Seedream 3.0 Technical Reportcited by 150
  11. 2025TIIF-Bench: How Does Your T2I Model Follow Your Instructions?cited by 67
  12. 2024ConceptMix: A Compositional Image Generation Benchmark with Controllable Difficultycited by 60
  13. 2025Inference-time Scaling of Diffusion Models through Classical Searchcited by 49
  14. 2025Visual Jenga: Discovering Object Dependencies via Counterfactual Inpaintingcited by 11

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026EPIC: Efficient Predicate-Guided Inference-Time Control for Compositional Text-to-Image Generation
  2. 2025CRAFT: Continuous Reasoning and Agentic Feedback Tuning for Multimodal Text-to-Image Generation
  3. 2025Test-time Prompt Refinement for Text-to-Image Models
  4. 2025Easier Painting Than Thinking: Can Text-to-Image Models Set the Stage, but Not Direct the Play?
  5. 2025Draw ALL Your Imagine: A Holistic Benchmark and Agent Framework for Complex Instruction-based Image Generation
  6. 2025ConceptMix++: Leveling the Playing Field in Text-to-Image Benchmarking via Iterative Prompt Optimization
  7. 2025Compositional Image Synthesis with Inference-Time Scaling
  8. 2024GraPE: A Generate-Plan-Edit Framework for Compositional T2I Synthesis