CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidance
On the map: Diffusion models → Image generation, text-to-image and editing
Abstract (arXiv)
Diffusion models excel at photorealistic synthesis but struggle with object count fidelity, especially in high-density settings. We introduce COUNTLOOP, a training-free framework that achieves structured instance and count control through iterative, structured feedback. Our method alternates between synthesis and evaluation: a VLM-based planner generates structured scene layouts, while a VLM-based critic provides explicit feedback on object counts, spatial arrangements, and visual quality to refine the layout iteratively. Instance-driven attention masking and cumulative attention composition further prevent semantic leakage, ensuring clear object separation even in densely occluded scenes. Evaluations on COCO-Count, T2I-CompBench, and two newly introduced high instance benchmarks show that COUNTLOOP reduces counting error by up to 57% and achieves the highest or comparable spatial quality scores across all benchmarks, while maintaining photorealism. Project page is at https://mondalanindya.github.io/CountLoop/.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Placed in Image generation, text-to-image and editing, one of 14 directions in Diffusion models. Builds on 54 of its 76 references that are in the map. First posted on arXiv 18 Aug 2025.
Builds on
54 of 76 references.
Closest ancestors · 13
Same direction, newest first
- 2025Be Decisive: Noise-Induced Layouts for Multi-Subject Generation27 May
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objects14 Jun
- 2024TheaterGen: Character Management with LLM for Consistent Multi-turn Image Generation29 Apr
- 2024Be Yourself: Bounded Attention for Multi-Subject Text-to-Image Generation25 Mar
- 2024InstanceDiffusion: Instance-level Control for Image Generation5 Feb
- 2024Mastering Text-to-Image Diffusion: Recaptioning, Planning, and Generating with Multimodal LLMs22 Jan
- 2023Self-correcting LLM-controlled Diffusion Models27 Nov
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Models13 Aug
- 2023Counting Guidance for High Fidelity Text-to-Image Synthesis30 Jun
- 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Models23 May
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Models31 Jan
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generation17 Jan
Other references · 41
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025Qwen3 Technical Reportcited by 8,820
- 2024GPT-4o System Cardcited by 4,588
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,356
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2025Wan: Open and Advanced Large-Scale Video Generative Modelscited by 2,708
- 2023ImageReward: Learning and Evaluating Human Preferences for Text-to-Image Generationcited by 1,045
- 2025Qwen-Image Technical Reportcited by 1,044
- 2022CogVideo: Large-scale Pretraining for Text-to-Video Generation via Transformerscited by 985
- 2022Tune-A-Video: One-Shot Tuning of Image Diffusion Models for Text-to-Video Generationcited by 961
29 more
- 2023Adversarial Diffusion Distillationcited by 759
- 2024SpatialVLM: Endowing Vision-Language Models with Spatial Reasoning Capabilitiescited by 706
- 2023Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levelscited by 503
- 2024Evaluating Text-to-Visual Generation with Image-to-Text Generationcited by 474
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 347
- 2023Scaling Open-Vocabulary Object Detectioncited by 343
- 2018Image Generation from Scene Graphscited by 324
- 2023Teaching CLIP to Count to Tencited by 198
- 2023Multimodal Large Language Models: A Surveycited by 195
- 2024Pixtral 12Bcited by 179
- 2021Learning To Count Everythingcited by 150
- 2024GenArtist: Multimodal LLM as an Agent for Unified Image Generation and Editingcited by 133
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
- 2025Echo-4o: Harnessing the Power of GPT-4o Synthetic Images for Improved Image Generationcited by 100
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2024Isambard-AI: a leadership class supercomputer optimised specifically for Artificial Intelligencecited by 62
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2025GPT-ImgEval: A Comprehensive Benchmark for Diagnosing GPT4o in Image Generationcited by 58
- 2025ArtiMuse: Fine-Grained Image Aesthetics Assessment with Joint Scoring and Expert-Level Understandingcited by 41
- 2024Autoregressive Models in Vision: A Surveycited by 39
- 2023Training-free Object Counting with Promptscited by 34
- 2024Interleaved Scene Graphs for Interleaved Text-and-Image Generation Assessmentcited by 21
- 2023Enhancing Chain-of-Thoughts Prompting with Iterative Bootstrapping in Large Language Modelscited by 16
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2025How Well Does GPT-4o Understand Vision? Evaluating Multimodal Foundation Models on Standard Computer Vision Taskscited by 14
- 2024AFreeCA: Annotation-Free Counting for Allcited by 12
- 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generationcited by 10
- 2024SMITE: Segment Me In TimEcited by 7
Built on by
Citing papers per year: 2026: 4.
4 papers.
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skillscited by 21
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoningcited by 1
- 2026Agentic Visual Generation: From Generative Models to Agentic Controlcited by 1
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
- 2026Agentic Visual Generation: From Generative Models to Agentic Control6 Sep 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026PRISM: A Benchmark for Programmatic Spatial-Temporal Reasoning19 May 2026
- 2026GEMS: Agent-Native Multimodal Generation with Memory and Skills30 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Learning to Generate Multiple Objects from Dense and Occluded Layouts
- 2025A Two-Stage System for Layout-Controlled Image Generation using Large Language Models and Diffusion Models
- 2025LayoutAgent: A Vision-Language Agent Guided Compositional Diffusion for Spatial Layout Planning
- 2026Lighting-grounded Video Generation with Renderer-based Agent Reasoning
- 2025STAY Diffusion: Styled Layout Diffusion Model for Diverse Layout-to-Image Generation
- 2025Control and Realism: Best of Both Worlds in Layout-to-Image without Training
- 2026InstancePin: Instance-Addressable Layout-to-Image Diffusion via Coordinate Pinning
- 2025Proportion and Perspective Control for Flow-Based Image Generation