mlsanityData to 14 Oct 2026

CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidance

arXiv 2508.16644 ↗First posted 18 Aug 2025cs.CVcited by 4

On the map: Diffusion models → Image generation, text-to-image and editing

Abstract (arXiv)

Diffusion models excel at photorealistic synthesis but struggle with object count fidelity, especially in high-density settings. We introduce COUNTLOOP, a training-free framework that achieves structured instance and count control through iterative, structured feedback. Our method alternates between synthesis and evaluation: a VLM-based planner generates structured scene layouts, while a VLM-based critic provides explicit feedback on object counts, spatial arrangements, and visual quality to refine the layout iteratively. Instance-driven attention masking and cumulative attention composition further prevent semantic leakage, ensuring clear object separation even in densely occluded scenes. Evaluations on COCO-Count, T2I-CompBench, and two newly introduced high instance benchmarks show that COUNTLOOP reduces counting error by up to 57% and achieves the highest or comparable spatial quality scores across all benchmarks, while maintaining photorealism. Project page is at https://mondalanindya.github.io/CountLoop/.

Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 54 of its 76 references that are in the map. First posted on arXiv 18 Aug 2025.

Builds on

54 of 76 references.

Closest ancestors · 13

Same direction, newest first

  1. 2025Be Decisive: Noise-Induced Layouts for Multi-Subject Generation27 May
  2. 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objects14 Jun
  3. 2024TheaterGen: Character Management with LLM for Consistent Multi-turn Image Generation29 Apr
  4. 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation25 Mar
  5. 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
  6. 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
  7. 2023Self-correcting LLM-controlled Diffusion Models27 Nov
  8. 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
  9. 2023Counting Guidance for High Fidelity Text-to-Image Synthesis30 Jun
  10. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models23 May
  11. 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
  12. 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
1 more
  1. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understanding23 May

Other references · 41

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2025Qwen3 Technical Reportcited by 8,820
  4. 2024GPT-4o System Cardcited by 4,588
  5. 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
  6. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
  9. 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
  10. 2025Qwen-Image Technical Reportcited by 1,044
  11. 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
  12. 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
29 more
  1. 2023Adversarial Diffusion Distillationcited by 759
  2. 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
  3. 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
  4. 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
  5. 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
  6. 2023Scaling Open-Vocabulary Object Detectioncited by 343
  7. 2018Image Generation from Scene Graphscited by 324
  8. 2023Teaching CLIP to Count to Tencited by 198
  9. 2023Multimodal Large Language Models: A Surveycited by 195
  10. 2024Pixtral 12Bcited by 179
  11. 2021Learning To Count Everythingcited by 150
  12. 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
  13. 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
  14. 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
  15. 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
  16. 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
  17. 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 62
  18. 2024CountGD: Multi-Modal Open-World Countingcited by 59
  19. 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
  20. 2025ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understandingcited by 41
  21. 2024Autoregressive Models in Vision: A Surveycited by 39
  22. 2023Training-free Object Counting with Promptscited by 34
  23. 2024Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessmentcited by 21
  24. 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Modelscited by 16
  25. 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
  26. 2025How Well Does GPT-4o Understand Vision? Evaluating Multimodal Foundation Models on Standard Computer Vision Taskscited by 14
  27. 2024AFreeCA: Annotation-Free Counting for Allcited by 12
  28. 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generationcited by 10
  29. 2024SMITE: Segment Me In TimEcited by 7

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 4.

4 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026Learning to Generate Multiple Objects from Dense and Occluded Layouts
  2. 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models
  3. 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning
  4. 2026Lighting-grounded Video Generation with Renderer-based Agent Reasoning
  5. 2025STAY Diffusion: Styled Layout Diffusion Model for Diverse Layout-to-Image Generation
  6. 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Training
  7. 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning
  8. 2025Proportion and Perspective Control for Flow-Based Image Generation