mlsanityData to 7 Oct 2026

CountGD: Multi-Modal Open-World Counting

arXiv 2407.04619 ↗First posted 5 Jul 2024cs.CVcited by 59

Not on the map. Why?

Abstract (arXiv)

The goal of this paper is to improve the generality and accuracy of open-vocabulary object counting in images. To improve the generality, we repurpose an open-vocabulary detection foundation model (GroundingDINO) for the counting task, and also extend its capabilities by introducing modules to enable specifying the target object to count by visual exemplars. In turn, these new capabilities - being able to specify the target object by multi-modalites (text and exemplars) - lead to an improvement in counting accuracy. We make three contributions: First, we introduce the first open-world counting model, CountGD, where the prompt can be specified by a text description or visual exemplars or both; Second, we show that the performance of the model significantly improves the state of the art on multiple counting benchmarks - when using text only, CountGD is comparable to or outperforms all previous text-only works, and when using both text and visual exemplars, we outperform all previous models; Third, we carry out a preliminary study into different interactions between the text and visual exemplar prompts, including the cases where they reinforce each other and where one restricts the other. The code and an app to test the model are available at https://www.robots.ox.ac.uk/~vgg/research/countgd/.

Key facts. Cited by 59 papers in the map (data through 7 Oct 2026). Builds on 32 of its 52 references that are in the map. First posted on arXiv 5 Jul 2024.

Builds on

32 of 52 references.

References · 32

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2023Segment Anythingcited by 8,158
  5. 2017Mask R-CNNcited by 7,259
  6. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
  7. 2016Matching Networks for One Shot Learningcited by 2,246
  8. 2019Objects as Pointscited by 1,172
  9. 2018Few-shot Object Detection via Feature Reweightingcited by 265
  10. 2019Few-Shot Object Detection with Attention-RPN and Multi-Relation Detectorcited by 206
  11. 2023Teaching CLIP to Count to Tencited by 194
  12. 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 155
20 more
  1. 2021Learning To Count Everythingcited by 149
  2. 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
  3. 2016A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learningcited by 86
  4. 2018Class-Agnostic Countingcited by 85
  5. 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
  6. 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
  7. 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
  8. 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
  9. 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
  10. 2022Density-aware NeRF Ensembles: Quantifying Predictive Uncertainty in Neural Radiance Fieldscited by 58
  11. 2023Zero-shot Object Countingcited by 57
  12. 2022Few-shot Object Counting and Detectioncited by 55
  13. 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
  14. 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
  15. 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
  16. 2023Open-world Text-specified Object Countingcited by 41
  17. 2020Completely Self-Supervised Crowd Counting via Distribution Matchingcited by 22
  18. 2023ABC Easy as 123: A Blind Counter for Exemplar-Free Multi-Class Class-agnostic Countingcited by 13
  19. 2023Unsupervised Open-Vocabulary Object Localization in Videoscited by 13
  20. 2023Instant Uncertainty Calibration of NeRFs Using a Meta-Calibratorcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 2; 2025: 25; 2026: 32.

59 papers.

Sort:

By area:

  1. 2025CAPTURe: Evaluating Spatial Reasoning in Vision Language Models via Occluded Object Countingcited by 36
  2. 2025Multimodal Referring Segmentation: A Surveycited by 22
  3. 2024LVLM-COUNT: Enhancing the Counting Ability of Large Vision-Language Modelscited by 20
  4. 2025Psi-Sampler: Initial Particle Sampling for SMC-Based Inference-Time Reward Alignment in Score Modelscited by 15
  5. 2025Open-World Object Counting in Videoscited by 11
  6. 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
  7. 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluationcited by 10
  8. 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generationcited by 10
  9. 2025CountGD++: Generalized Prompting for Open-World Countingcited by 8
  10. 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluationcited by 7
  11. 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventionscited by 6
  12. 2025Generalized-Scale Object Counting with Gradual Query Aggregationcited by 5
38 more
  1. 2025CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidancecited by 4
  2. 2025FiGO: Fine-Grained Object Counting without Annotationscited by 2
  3. 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
  4. 2025What is the Right Embedding Space for Contrastive Learning in Referring Expression Counting?cited by 2
  5. 2025Demystifying Numerosity in Diffusion Models -- Limitations and Remediescited by 2
  6. 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Countingcited by 2
  7. 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Countingcited by 2
  8. 2026Plant Taxonomy Meets Plant Counting: A Fine-Grained, Taxonomic Dataset for Counting Hundreds of Plant Speciescited by 2
  9. 2025Expanding Zero-Shot Object Counting with Rich Promptscited by 1
  10. 2025CountCluster: Training-Free Object Quantity Guidance with Cross-Attention Map Clustering for Text-to-Image Generationcited by 1
  11. 2025D2D: Detector-to-Differentiable Critic for Improved Numeracy in Text-to-Image Generationcited by 1
  12. 2025Decoupling What to Count and Where to See for Referring Expression Countingcited by 1
  13. 2025Counting Through Occlusion: Framework for Open World Amodal Countingcited by 1
  14. 2025Object Counting with GPT-4o and GPT-5: A Comparative Studycited by 1
  15. 2025CoDi -- an exemplar-conditioned diffusion model for low-shot countingcited by 1
  16. 2026CountEx: Fine-Grained Counting via Exemplars and Exclusioncited by 1
  17. 2026Automated Counting of Stacked Objects in Industrial Inspectioncited by 1
  18. 2026RS-OVC: Open-Vocabulary Counting for Remote-Sensing Datacited by 1
  19. 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Countingcited by 1
  20. 2026Count Anything at Any Granularitycited by 1
  21. 2026The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Countingcited by 1
  22. 2026From Failure Taxonomy to Intervention: A Diagnostic Methodology for Industry-Scale AVLM in Video and Live-Streaming Platform Moderationcited by 1
  23. 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Countingcited by 1
  24. 2026Spatially-Aware Class-Agnostic Object Countingcited by 1
  25. 2026Are Image Generators Zero-Shot Perceivers? A Rigorous Evaluationcited by 1
  26. 2024Text-guided Zero-Shot Object Localizationcited by 0
  27. 2025Automated Detection of Salvin's Albatrosses: Improving Deep Learning Tools for Aerial Wildlife Surveyscited by 0
  28. 2025CountZES: Counting via Zero-Shot Exemplar Selectioncited by 0
  29. 2026OCCAM: Class-Agnostic, Training-Free, Prior-Free and Multi-Class Object Countingcited by 0
  30. 2026Referring Multiple Regions with Large Multimodal Models via Contextual Latent Steeringcited by 0
  31. 2026Count Anythingcited by 0
  32. 2026Benchmarking and Enhancing Text-to-Image Models for Generating Visual Representations in Early Arithmetic Educationcited by 0
  33. 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Countingcited by 0
  34. 2026Test-Time Training for Robust Text-Guided Open-Vocabulary Object Countingcited by 0
  35. 2026MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Blockcited by 0
  36. 2026VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observerscited by 0
  37. 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
  38. 2026Depth-Guided Video Object Counting in Crowded Scenescited by 0

50 most cited of 59 All 59 (JSON)