Zero-shot Object Counting
Not on the map. Why?
Abstract (arXiv)
Class-agnostic object counting aims to count object instances of an arbitrary class at test time. It is challenging but also enables many potential applications. Current methods require human-annotated exemplars as inputs which are often unavailable for novel categories, especially for autonomous systems. Thus, we propose zero-shot object counting (ZSC), a new setting where only the class name is available during test time. Such a counting system does not require human annotators in the loop and can operate automatically. Starting from a class name, we propose a method that can accurately identify the optimal patches which can then be used as counting exemplars. Specifically, we first construct a class prototype to select the patches that are likely to contain the objects of interest, namely class-relevant patches. Furthermore, we introduce a model that can quantitatively measure how suitable an arbitrary patch is as a counting exemplar. By applying this model to all the candidate patches, we can select the most suitable patches as exemplars for counting. Experimental results on a recent class-agnostic counting dataset, FSC-147, validate the effectiveness of our method. Code is available at https://github.com/cvlab-stonybrook/zero-shot-counting
Key facts. Cited by 57 papers in the map (data through 7 Oct 2026). Builds on 40 of its 58 references that are in the map. First posted on arXiv 3 Mar 2023.
Builds on
40 of 58 references.
References · 40
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2017Wasserstein GANcited by 635
- 2017Zero-Shot Learning -- A Comprehensive Evaluation of the Good, the Bad and the Uglycited by 536
- 2018Zero-Shot Object Detectioncited by 189
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
- 2019f-VAEGAN-D2: A Feature Generating Framework for Any-Shot Learningcited by 164
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 155
- 2016Learning a Deep Embedding Model for Zero-Shot Learningcited by 153
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2018Context-Aware Crowd Countingcited by 150
- 2021Learning To Count Everythingcited by 149
- 2020Distribution Matching for Crowd Countingcited by 143
28 more
- 2016Latent Embeddings for Zero-shot Classificationcited by 129
- 2016A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learningcited by 86
- 2018Class-Agnostic Countingcited by 85
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2020Localization in the Crowd with Topological Constraintscited by 68
- 2017Zero-Shot Visual Recognition using Semantics-Preserving Adversarial Embedding Networkscited by 66
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2020From Shadow Segmentation to Shadow Removalcited by 59
- 2022Few-shot Object Counting and Detectioncited by 55
- 2018Where are the Blobs: Counting by Localization with Point Supervisioncited by 54
- 2021Zero-Shot Instance Segmentationcited by 40
- 2014Zero Shot Recognition with Unreliable Attributescited by 39
- 2017A+D Net: Training a Shadow Detector with Adversarial Shadow Attenuationcited by 39
- 2022Generating Representative Samples for Few-Shot Classificationcited by 39
- 2020Physics-based Shadow Image Decomposition for Shadow Removalcited by 38
- 2019Object Counting and Instance Segmentation with Image-level Supervisioncited by 35
- 2016Counting Everyday Objects in Everyday Scenescited by 34
- 2019Pushing the Frontiers of Unconstrained Crowd Counting: New Dataset and Benchmark Methodcited by 32
- 2022Exemplar Free Class Agnostic Countingcited by 32
- 2020Variational Feature Disentangling for Fine-Grained Few-Shot Classificationcited by 26
- 2021Leveraging Self-Supervision for Cross-Domain Crowd Countingcited by 24
- 2020Completely Self-Supervised Crowd Counting via Distribution Matchingcited by 22
- 2020Zero-Shot Learning and its Applications from Autonomous Vehicles to COVID-19 Diagnosis: A Reviewcited by 20
- 2022Discrete-Constrained Regression for Local Counting Modelscited by 19
- 2016Co-localization with Category-Consistent Features and Geodesic Distance Propagationcited by 14
- 2019Weakly Labeling the Antarctic: The Penguin Colony Casecited by 12
- 2019Towards Partial Supervision for Generic Object Counting in Natural Scenescited by 9
Built on by
Citing papers per year: 2023: 7; 2024: 15; 2025: 20; 2026: 15.
57 papers.
Sort:
By area:
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
- 2023Open-world Text-specified Object Countingcited by 41
- 2023Point, Segment and Count: A Generalized Framework for Object Countingcited by 39
- 2023Training-free Object Counting with Promptscited by 34
- 2023Counting Guidance for High Fidelity Text-to-Image Synthesiscited by 24
- 2024Zero-shot Object Counting with Good Exemplarscited by 21
- 2025T2ICount: Enhancing Cross-modal Understanding for Zero-Shot Countingcited by 19
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2023ABC Easy as 123: A Blind Counter for Exemplar-Free Multi-Class Class-agnostic Countingcited by 13
38 more
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Countingcited by 11
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
- 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
- 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generationcited by 10
- 2023Zero-Shot Object Counting with Language-Vision Modelscited by 9
- 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videoscited by 8
- 2024Assessing Sample Quality via the Latent Space of Generative Modelscited by 8
- 2024Counting Stacked Objectscited by 8
- 2025CountGD++: Generalized Prompting for Open-World Countingcited by 8
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approachescited by 7
- 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluationcited by 7
- 2025Single Domain Generalization for Few-Shot Counting via Universal Representation Matchingcited by 6
- 2025Point-to-Region Loss for Semi-Supervised Point-Based Crowd Countingcited by 6
- 2024Shadow Removal Refinement via Material-Consistent Shadow Edgescited by 5
- 2024TFCounter:Polishing Gems for Training-Free Object Countingcited by 2
- 2024Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentationcited by 2
- 2025FiGO: Fine-Grained Object Counting without Annotationscited by 2
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Countingcited by 2
- 2024Enhancing Zero-shot Counting via Language-guided Exemplar Learningcited by 1
- 2025Expanding Zero-Shot Object Counting with Rich Promptscited by 1
- 2025Querying Autonomous Vehicle Point Clouds: Enhanced by 3D Object Counting with CounterNetcited by 1
- 2025Counting Through Occlusion: Framework for Open World Amodal Countingcited by 1
- 2025CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentationcited by 1
- 2025Object Counting with GPT-4o and GPT-5: A Comparative Studycited by 1
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusioncited by 1
- 2026Automated Counting of Stacked Objects in Industrial Inspectioncited by 1
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Countingcited by 1
- 2026Count Anything at Any Granularitycited by 1
- 2026Unveiling the Visual Counting Bottleneck in Vision-Language Modelscited by 1
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Countingcited by 1
- 2026Spatially-Aware Class-Agnostic Object Countingcited by 1
- 2024GCA-SUNet: A Gated Context-Aware Swin-UNet for Exemplar-Free Countingcited by 0
- 2025FocalCount: Towards Class-Count Imbalance in Class-Agnostic Countingcited by 0
- 2025CountFormer: A Transformer Framework for Learning Visual Repetition and Structure in Class-Agnostic Object Countingcited by 0
- 2025Cast and Attached Shadow Detection via Iterative Light and Geometry Reasoningcited by 0
- 2025CountZES: Counting via Zero-Shot Exemplar Selectioncited by 0
50 most cited of 57 All 57 (JSON)
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars20 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting2 Jul 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Count Anything29 May 2026
- 2026Unveiling the Visual Counting Bottleneck in Vision-Language Models28 May 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting4 May 2026
- 2026Automated Counting of Stacked Objects in Industrial Inspection16 Mar 2026
38 more
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusion23 Feb 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026OCCAM: Class-Agnostic, Training-Free, Prior-Free and Multi-Class Object Counting20 Jan 2026
- 2025CountGD++: Generalized Prompting for Open-World Counting29 Dec 2025
- 2025CountZES: Counting via Zero-Shot Exemplar Selection18 Dec 2025
- 2025Cast and Attached Shadow Detection via Iterative Light and Geometry Reasoning5 Dec 2025
- 2025Object Counting with GPT-4o and GPT-5: A Comparative Study2 Dec 2025
- 2025CORA: Consistency-Guided Semi-Supervised Framework for Reasoning Segmentation21 Nov 2025
- 2025Counting Through Occlusion: Framework for Open World Amodal Counting16 Nov 2025
- 2025CountFormer: A Transformer Framework for Learning Visual Repetition and Structure in Class-Agnostic Object Counting27 Oct 2025
- 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluation17 Sep 2025
- 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generation1 Aug 2025
- 2025Querying Autonomous Vehicle Point Clouds: Enhanced by 3D Object Counting with CounterNet25 Jul 2025
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2025Point-to-Region Loss for Semi-Supervised Point-Based Crowd Counting28 May 2025
- 2025Single Domain Generalization for Few-Shot Counting via Universal Representation Matching22 May 2025
- 2025Expanding Zero-Shot Object Counting with Rich Prompts21 May 2025
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting24 Apr 2025
- 2025FiGO: Fine-Grained Object Counting without Annotations16 Apr 2025
- 2025Exploring Contextual Attribute Density in Referring Expression Counting16 Mar 2025
- 2025T2ICount: Enhancing Cross-modal Understanding for Zero-Shot Counting28 Feb 2025
- 2025FocalCount: Towards Class-Count Imbalance in Class-Agnostic Counting15 Feb 2025
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approaches31 Jan 2025
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?3 Dec 2024
- 2024Counting Stacked Objects28 Nov 2024
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Counting24 Sep 2024
- 2024GCA-SUNet: A Gated Context-Aware Swin-UNet for Exemplar-Free Counting18 Sep 2024
- 2024Shadow Removal Refinement via Material-Consistent Shadow Edges10 Sep 2024
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videos24 Jul 2024
- 2024Assessing Sample Quality via the Latent Space of Generative Models21 Jul 2024
- 2024Weighting Pseudo-Labels via High-Activation Feature Index Similarity and Object Detection for Semi-Supervised Segmentation17 Jul 2024
- 2024Zero-shot Object Counting with Good Exemplars6 Jul 2024
- 2024CountGD: Multi-Modal Open-World Counting5 Jul 2024
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting25 Apr 2024
- 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videos26 Mar 2024
- 2024TFCounter:Polishing Gems for Training-Free Object Counting12 Mar 2024
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priors8 Mar 2024
- 2024Enhancing Zero-shot Counting via Language-guided Exemplar Learning8 Feb 2024
50 newest of 57 All 57 (JSON)
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?cited by 46
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026Count Anything at Any Granularitycited by 1
- 2026Unveiling the Visual Counting Bottleneck in Vision-Language Modelscited by 1
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Countingcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Unveiling the Visual Counting Bottleneck in Vision-Language Models28 May 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting24 Apr 2025
- 2024AV-Odyssey Bench: Can Your Multimodal LLMs Really Understand Audio-Visual Information?3 Dec 2024
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Counting12 May 2023
- 2023Counting Guidance for High Fidelity Text-to-Image Synthesiscited by 24
- 2023Counting Guidance for High Fidelity Text-to-Image Synthesis30 Jun 2023
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2023Open-world Text-specified Object Countingcited by 41
- 2023Point, Segment and Count: A Generalized Framework for Object Countingcited by 39
- 2023Training-free Object Counting with Promptscited by 34
- 2024Zero-shot Object Counting with Good Exemplarscited by 21
- 2025T2ICount: Enhancing Cross-modal Understanding for Zero-Shot Countingcited by 19
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2023ABC Easy as 123: A Blind Counter for Exemplar-Free Multi-Class Class-agnostic Countingcited by 13
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Countingcited by 11
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
- 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
12 most cited of 47 All 47 (JSON)
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars20 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting2 Jul 2026
- 2026Count Anything29 May 2026
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting4 May 2026
- 2026Automated Counting of Stacked Objects in Industrial Inspection16 Mar 2026
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusion23 Feb 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026OCCAM: Class-Agnostic, Training-Free, Prior-Free and Multi-Class Object Counting20 Jan 2026
- 2025CountGD++: Generalized Prompting for Open-World Counting29 Dec 2025
12 newest of 47 All 47 (JSON)