mlsanityData to 14 Oct 2026

Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges

arXiv 2608.23845 ↗First posted 24 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Object-counting methods have rapidly shifted from class-specific density regression to open-vocabulary, foundation-model-backed counters. These methods now enumerate instances from various visual and textual prompts. While this shift marks major conceptual progress, our survey argues that claims of universal generality have outpaced the evaluative infrastructure. Most progress metrics rely on a few saturated benchmarks that models exploit for statistical regularities. Newly introduced diagnostic datasets reveal systematic failures in semantic grounding, temporal identity, and spatial reasoning with occlusion. To address these failures, we introduce a five-axis taxonomy (modality, mechanism, prompting, supervision level, and generalization setting). We use this taxonomy to audit the literature across application domains, including microscopy, remote sensing, crowd counting, and agriculture. This formalizes prevailing challenges into six structural contradictions. From these, we propose a roadmap for compositional scene understanding, active counting agents, and unified multimodal evaluation protocols. The main imperative is to build a robust evaluation infrastructure to distinguish open-world generalization from benchmark-specific optimization, rather than simple incremental engineering.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 115 of its 224 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

115 of 224 references.

References · 115

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2023Segment Anythingcited by 8,234
  3. 2020End-to-End Object Detection with Transformerscited by 7,414
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2024SAM 2: Segment Anything in Images and Videoscited by 2,863
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 823
  8. 2016Performance Measures and a Data Set for Multi-Target, Multi-Camera Trackingcited by 692
  9. 2020HOTA: A Higher Order Metric for Evaluating Multi-Object Trackingcited by 552
  10. 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 515
  11. 2024Molmo and PixMo: Open Weights and Open Data for State-of-the-Art Vision-Language Modelscited by 329
  12. 2021Towards Open World Object Detectioncited by 297
38 more
  1. 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
  2. 2014Towards Open World Recognitioncited by 226
  3. 2023Teaching CLIP to Count to Tencited by 198
  4. 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
  5. 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
  6. 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
  7. 2018TallyQA: Answering Complex Counting Questionscited by 153
  8. 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
  9. 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
  10. 2021Learning To Count Everythingcited by 150
  11. 2020Distribution Matching for Crowd Countingcited by 143
  12. 2026Molmo2: Open Weights and Data for Vision-Language Models with Video Understanding and Groundingcited by 139
  13. 2021OW-DETR: Open-world Detection Transformercited by 129
  14. 2020JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Methodcited by 109
  15. 2018Class-Agnostic Countingcited by 85
  16. 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 83
  17. 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
  18. 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
  19. 2020Counting Out Time: Class Agnostic Video Repetition Counting in the Wildcited by 68
  20. 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
  21. 2019Precise Detection in Densely Packed Scenescited by 63
  22. 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
  23. 2024CountGD: Multi-Modal Open-World Countingcited by 59
  24. 2025YOLOv13: Real-Time Object Detection with Hypergraph-Enhanced Adaptive Visual Perceptioncited by 58
  25. 2018Leveraging Unlabeled Data for Crowd Counting by Learning to Rankcited by 57
  26. 2022PROB: Probabilistic Objectness for Open World Object Detectioncited by 57
  27. 2023Zero-shot Object Countingcited by 57
  28. 2018Where are the Blobs: Counting by Localization with Point Supervisioncited by 54
  29. 2022Rethinking Spatial Invariance of Convolutional Networks for Object Countingcited by 54
  30. 2024Overconfidence is Key: Verbalized Uncertainty Evaluation in Large Language and Vision-Language Modelscited by 54
  31. 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
  32. 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
  33. 2022TransRAC: Encoding Multi-scale Temporal Correlation with Transformers for Repetitive Action Countingcited by 44
  34. 2020CNN-based Density Estimation and Crowd Counting: A Surveycited by 43
  35. 2021Tracking Pedestrian Heads in Dense Crowdcited by 42
  36. 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
  37. 2023Open-world Text-specified Object Countingcited by 41
  38. 2023STEERER: Resolving Scale Variations for Counting and Localization via Selective Inheritance Learningcited by 41

50 most cited of 115 All 115 (JSON)

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation
  2. 2026Count Anything at Any Granularity
  3. 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs
  4. 2025FiGO: Fine-Grained Object Counting without Annotations
  5. 2024AFreeCA: Annotation-Free Counting for All
  6. 2023Zero-Shot Object Counting with Language-Vision Models
  7. 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting
  8. 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars