Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges
Not on the map. Why?
Abstract (arXiv)
Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods now enumerate instances from various visual and textual prompts. While this shift marks major conceptual progress, our survey argues that claims of universal generality have outpaced the evaluative infrastructure. Most progress metrics rely on a few saturated benchmarks that models exploit for statistical regularities. Newly introduced diagnostic datasets reveal systematic failures in semantic grounding, temporal identity, and spatial reasoning with occlusion. To address these failures, we introduce a five-axis taxonomy (modality, mechanism, prompting, supervision level, and generalization setting). We use this taxonomy to audit the literature across application domains, including microscopy, remote sensing, crowd counting, and agriculture. This formalizes prevailing challenges into six structural contradictions. From these, we propose a roadmap for compositional scene understanding, active counting agents, and unified multimodal evaluation protocols. The main imperative is to build a robust evaluation infrastructure to distinguish open-world generalization from benchmark-specific optimization, rather than simple incremental engineering.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 115 of its 224 references that are in the map. First posted on arXiv 24 Aug 2026.
Builds on
115 of 224 references.
References · 115
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2023Segment Anythingcited by 8,234
- 2020End-to-End Object Detection with Transformerscited by 7,414
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
- 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
- 2025SAM 3: Segment Anything with Conceptscited by 906
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
- 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
- 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
- 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
- 2021Towards Open World Object Detectioncited by 297
38 more
- 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
- 2014Towards Open World Recognitioncited by 226
- 2023Teaching CLIP to Count to Tencited by 198
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
- 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
- 2018TallyQA: Answering Complex Counting Questionscited by 153
- 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2021Learning To Count Everythingcited by 150
- 2020Distribution Matching for Crowd Countingcited by 143
- 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
- 2021OW-DETR: Open-world Detection Transformercited by 129
- 2020JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Methodcited by 109
- 2018Class-Agnostic Countingcited by 85
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2020Counting Out Time: Class Agnostic Video Repetition Counting in the Wildcited by 68
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2019Precise Detection in Densely Packed Scenescited by 63
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2025YOLOv13: Real-Time Object Detection with Hypergraph-Enhanced Adaptive Visual Perceptioncited by 58
- 2018Leveraging Unlabeled Data for Crowd Counting by Learning to Rankcited by 57
- 2022PROB: Probabilistic Objectness for Open World Object Detectioncited by 57
- 2023Zero-shot Object Countingcited by 57
- 2018Where are the Blobs: Counting by Localization with Point Supervisioncited by 54
- 2022Rethinking Spatial Invariance of Convolutional Networks for Object Countingcited by 54
- 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Modelscited by 54
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
- 2022TransRAC: Encoding Multi-scale Temporal Correlation with Transformers for Repetitive Action Countingcited by 44
- 2020CNN-based Density Estimation and Crowd Counting: A Surveycited by 43
- 2021Tracking Pedestrian Heads in Dense Crowdcited by 42
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2023Open-world Text-specified Object Countingcited by 41
- 2023STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learningcited by 41
50 most cited of 115 All 115 (JSON)
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
- 2026Count Anything at Any Granularity
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs
- 2025FiGO: Fine-Grained Object Counting without Annotations
- 2024AFreeCA: Annotation-Free Counting for All
- 2023Zero-Shot Object Counting with Language-Vision Models
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting
- 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars