YOLO-Count: Differentiable Object Counting for Text-to-Image Generation
Not on the map. Why?
Abstract (arXiv)
We propose YOLO-Count, a differentiable open-vocabulary object counting model that tackles both general counting challenges and enables precise quantity control for text-to-image (T2I) generation. A core contribution is the 'cardinality' map, a novel regression target that accounts for variations in object size and spatial distribution. Leveraging representation alignment and a hybrid strong-weak supervision scheme, YOLO-Count bridges the gap between open-vocabulary counting and T2I generation control. Its fully differentiable architecture facilitates gradient-based optimization, enabling accurate object count estimation and fine-grained guidance for generative models. Extensive experiments demonstrate that YOLO-Count achieves state-of-the-art counting accuracy while providing robust and effective quantity control for T2I systems.
Key facts. Cited by 10 papers in the map (data through 14 Oct 2026). Builds on 43 of its 54 references that are in the map. First posted on arXiv 1 Aug 2025.
Builds on
43 of 54 references.
References · 43
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2023IP-Adapter: Text Compatible Image Prompt Adapter for Text-to-Image Diffusion Modelscited by 1,464
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2023Attend-and-Excite: Attention-Based Semantic Guidance for Text-to-Image Diffusion Modelscited by 702
- 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
- 2023Universal Guidance for Diffusion Modelscited by 437
31 more
- 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 359
- 2023FreeDoM: Training-Free Energy-Guided Conditional Diffusion Modelcited by 294
- 2023BoxDiff: Text-to-Image Synthesis with Training-Free Box-Constrained Diffusioncited by 282
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 259
- 2023Michelangelo: Conditional 3D Shape Generation based on Shape-Image-Text Aligned Latent Representationcited by 228
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2021Learning To Count Everythingcited by 150
- 2024Towards Understanding Cross and Self-Attention in Stable Diffusion for Text-Guided Image Editingcited by 135
- 2024MIGC: Multi-Instance Generation Controller for Text-to-Image Synthesiscited by 124
- 2024InitNO: Boosting Text-to-Image Diffusion Models via Initial Noise Optimizationcited by 123
- 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2023Ranni: Taming Text-to-Image Diffusion for Accurate Instruction Followingcited by 77
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2023Zero-shot Object Countingcited by 57
- 2022Few-shot Object Counting and Detectioncited by 55
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2024Make It Count: Text-to-Image Generation with an Accurate Number of Objectscited by 47
- 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2023Point, Segment and Count: A Generalized Framework for Object Countingcited by 39
- 2023Counting Guidance for High Fidelity Text-to-Image Synthesiscited by 24
- 2023LoCo: Locally Constrained Training-Free Layout-to-Image Synthesiscited by 21
- 2024Zero-shot Object Counting with Good Exemplarscited by 21
- 2023Separate-and-Enhance: Compositional Finetuning for Text2Image Diffusion Modelscited by 19
- 2023Regressor-Segmenter Mutual Prompt Learning for Crowd Countingcited by 16
- 2023Focus for Free in Density-Based Countingcited by 8
- 2024QUOTA: Quantifying Objects with Text-to-Image Models for Any Domaincited by 3
Built on by
Citing papers per year: 2025: 4; 2026: 6.
10 papers.
- 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlapscited by 10
- 2025C3Editor: Achieving Controllable Consistency in 2D Model for 3D Editingcited by 5
- 2025CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidancecited by 4
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Modelscited by 4
- 2025CoDi -- an exemplar-conditioned diffusion model for low-shot countingcited by 1
- 2026Soft Tail-dropping for Adaptive Visual Tokenizationcited by 1
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Countingcited by 1
- 2026ATHENA: Adaptive Test-Time Steering for Improving Count Fidelity in Diffusion Modelscited by 0
- 2026Count Anythingcited by 0
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challengescited by 0
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting2 Jul 2026
- 2026Count Anything29 May 2026
- 2026ATHENA: Adaptive Test-Time Steering for Improving Count Fidelity in Diffusion Models20 Mar 2026
- 2026Soft Tail-dropping for Adaptive Visual Tokenization20 Jan 2026
- 2026TP-Blend: Textual-Prompt Attention Pairing for Precise Object-Style Blending in Diffusion Models12 Jan 2026
- 2025CoDi -- an exemplar-conditioned diffusion model for low-shot counting23 Dec 2025
- 2025C3Editor: Achieving Controllable Consistency in 2D Model for 3D Editing6 Oct 2025
- 2025OverLayBench: A Benchmark for Layout-to-Image Generation with Dense Overlaps23 Sep 2025
- 2025CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidance18 Aug 2025