Learning To Count Everything
Not on the map. Why?
Cited by 20 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
Existing works on visual counting primarily focus on one specific category at a time, such as people, animals, and cells. In this paper, we are interested in counting everything, that is to count objects from any category given only a few annotated instances from that category. To this end, we pose counting as a few-shot regression task. To tackle this task, we present a novel method that takes a query image together with a few exemplar objects from the query image and predicts a density map for the presence of all objects of interest in the query image. We also present a novel adaptation strategy to adapt our network to any novel visual category at test time, using only a few exemplar objects from the novel category. We also introduce a dataset of 147 object categories containing over 6000 images that are suitable for the few-shot counting task. The images are annotated with two types of annotation, dots and bounding boxes, and they can be used for developing few-shot counting models. Experiments on this dataset shows that our method outperforms several state-of-the-art object detectors and few-shot counting approaches. Our code and dataset can be found at https://github.com/cvlab-stonybrook/LearningToCountEverything.
Key facts. Cited by 149 papers in the map (data through 7 Oct 2026). Builds on 32 of its 55 references that are in the map. First posted on arXiv 16 Apr 2021.
Builds on
32 of 55 references.
References · 32
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Mask R-CNNcited by 7,259
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2016Matching Networks for One Shot Learningcited by 2,246
- 2018Fast Online Object Tracking and Segmentation: A Unifying Approachcited by 272
- 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
- 2018Few-shot Object Detection via Feature Reweightingcited by 265
- 2019Few-Shot Object Detection with Attention-RPN and Multi-Relation Detectorcited by 206
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
20 more
- 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 155
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2018Context-Aware Crowd Countingcited by 150
- 2019Learning from Synthetic Data for Crowd Counting in the Wildcited by 148
- 2020Distribution Matching for Crowd Countingcited by 143
- 2020JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Methodcited by 109
- 2017Switching Convolutional Neural Network for Crowd Countingcited by 93
- 2019Generalized Inner Loop Meta-Learningcited by 92
- 2017End-to-end representation learning for Correlation Filter based trackingcited by 90
- 2016A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learningcited by 86
- 2018Class-Agnostic Countingcited by 85
- 2020Localization in the Crowd with Topological Constraintscited by 68
- 2016One-shot Learning with Memory-Augmented Neural Networkscited by 60
- 2018Leveraging Unlabeled Data for Crowd Counting by Learning to Rankcited by 57
- 2018Revisiting Perspective Information for Efficient Crowd Countingcited by 49
- 2018Iterative Crowd Countingcited by 48
- 2018Divide and Grow: Capturing Huge Diversity in Crowd Images with Incrementally Growing CNNcited by 19
- 2020Uncertainty Estimation and Sample Selection for Crowd Countingcited by 11
- 2019Crowd Transformer Networkcited by 5
Built on by
Citing papers per year: 2021: 1; 2022: 11; 2023: 23; 2024: 35; 2025: 41; 2026: 38.
149 papers.
Sort:
By area:
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2025Detect Anything via Next Point Predictioncited by 66
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2023Zero-shot Object Countingcited by 57
38 more
- 2022Few-shot Object Counting and Detectioncited by 55
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2023VLCounter: Text-aware Visual Representation for Zero-Shot Object Countingcited by 45
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2023Open-world Text-specified Object Countingcited by 41
- 2023Point, Segment and Count: A Generalized Framework for Object Countingcited by 39
- 2024Assessment of Multimodal Large Language Models in Alignment with Human Valuescited by 36
- 2023Training-free Object Counting with Promptscited by 34
- 2022Exemplar Free Class Agnostic Countingcited by 32
- 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referringcited by 29
- 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Countingcited by 25
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
- 2024Zero-shot Object Counting with Good Exemplarscited by 21
- 2024A Novel Unified Architecture for Low-Shot Counting by Detection and Segmentationcited by 21
- 2023T-Rex: Counting by Visual Promptingcited by 20
- 2024LVLM-COUNT: Enhancing the Counting Ability of Large Vision-Language Modelscited by 20
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2025T2ICount: Enhancing Cross-modal Understanding for Zero-Shot Countingcited by 19
- 2023Can SAM Count Anything? An Empirical Study on SAM Countingcited by 18
- 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMscited by 18
- 2024OmniCount: Multi-label Object Counting with Semantic-Geometric Priorscited by 16
- 2022Interactive Multi-Class Tiny-Object Detectioncited by 14
- 2021Object Counting: You Only Need to Look at Onecited by 13
- 2023ABC Easy as 123: A Blind Counter for Exemplar-Free Multi-Class Class-agnostic Countingcited by 13
- 2024AFreeCA: Annotation-Free Counting for Allcited by 12
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Countingcited by 11
- 2025Open-World Object Counting in Videoscited by 11
- 2024A Fixed-Point Approach to Unified Prompt-Based Countingcited by 10
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
- 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
- 2025YOLO-Count: Differentiable Object Counting for Text-to-Image Generationcited by 10
- 2023Zero-Shot Object Counting with Language-Vision Modelscited by 9
- 2023Interactive Class-Agnostic Object Countingcited by 8
- 2024Counting Stacked Objectscited by 8
- 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
- 2025CountGD++: Generalized Prompting for Open-World Countingcited by 8
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approachescited by 7
50 most cited of 149 All 149 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026Counting Beyond Instances: A Benchmark for Group-Individual Object Counting4 Sep 2026
- 2026LookThere! Sparse Vision by Reinforced Selection4 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars20 Aug 2026
- 2026NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models15 Aug 2026
- 2026ToolVision: Learning When and How to Use Visual Tools with Capability-Aligned Supervision9 Aug 2026
- 2026Depth-Guided Video Object Counting in Crowded Scenes6 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026HoloCount: A Holistic Visual Counting Benchmark for MLLMs7 Jul 2026
38 more
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting2 Jul 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model18 Jun 2026
- 2026VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers17 Jun 2026
- 2026MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block16 Jun 2026
- 2026Test-Time Training for Robust Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Kwai Keye-VL-2.0 Technical Report9 Jun 2026
- 2026Count Anything29 May 2026
- 2026ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation28 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting18 May 2026
- 2026Counting Machine Parts18 May 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting4 May 2026
- 2026Counting to Four is still a Chore for VLMs11 Apr 2026
- 2026PANDORA: Pixel-wise Attention Dissolution and Latent Guidance for Zero-Shot Object Removal29 Mar 2026
- 2026Getting to the Point: Pointing Improves LVLMs at Counting23 Mar 2026
- 2026Plant Taxonomy Meets Plant Counting: A Fine-Grained, Taxonomic Dataset for Counting Hundreds of Plant Species22 Mar 2026
- 2026FineViT: Progressively Unlocking Fine-Grained Perception with Dense Recaptions18 Mar 2026
- 2026Automated Counting of Stacked Objects in Industrial Inspection16 Mar 2026
- 2026UNICBench: UNIfied Counting Benchmark for MLLM28 Feb 2026
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusion23 Feb 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026One-Shot Crowd Counting With Density Guidance For Scene Adaptation8 Feb 2026
- 2026OCCAM: Class-Agnostic, Training-Free, Prior-Free and Multi-Class Object Counting20 Jan 2026
- 2025CountGD++: Generalized Prompting for Open-World Counting29 Dec 2025
- 2025CoDi -- an exemplar-conditioned diffusion model for low-shot counting23 Dec 2025
- 2025CountZES: Counting via Zero-Shot Exemplar Selection18 Dec 2025
- 2025Semi-Supervised Multi-View Crowd Counting by Ranking Multi-View Fusion Models18 Dec 2025
- 2025Assessing the Visual Enumeration Abilities of Specialized Counting Architectures and Vision-Language Models17 Dec 2025
- 2025Object Counting with GPT-4o and GPT-5: A Comparative Study2 Dec 2025
- 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventions21 Nov 2025
- 2025Counting Through Occlusion: Framework for Open World Amodal Counting16 Nov 2025
- 2025Generalized-Scale Object Counting with Gradual Query Aggregation11 Nov 2025
- 2025Decoupling What to Count and Where to See for Referring Expression Counting28 Oct 2025
- 2025CountFormer: A Transformer Framework for Learning Visual Repetition and Structure in Class-Agnostic Object Counting27 Oct 2025
- 2025D2D: Detector-to-Differentiable Critic for Improved Numeracy in Text-to-Image Generation22 Oct 2025
50 newest of 149 All 149 (JSON)
- 2023CLIP-Count: Towards Text-Guided Zero-Shot Object Countingcited by 82
- 2024Assessment of Multimodal Large Language Models in Alignment with Human Valuescited by 36
- 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referringcited by 29
- 2024UrBench: A Comprehensive Benchmark for Evaluating Large Multimodal Models in Multi-View Urban Scenarioscited by 28
- 2024Lumen: Unleashing Versatile Vision-Centric Capabilities of Large Multimodal Modelscited by 24
- 2024LVLM-COUNT: Enhancing the Counting Ability of Large Vision-Language Modelscited by 20
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decodingcited by 20
- 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMscited by 18
- 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventionscited by 6
- 2026UNICBench: UNIfied Counting Benchmark for MLLMcited by 3
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
12 most cited of 19 All 19 (JSON)
- 2026NumerosityVLM: A Cognitively Inspired Benchmark for Interpreting Numerosity Representations in Vision-Language Models15 Aug 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026ReactBench: A Cause-Driven Benchmark for Multimodal Hallucination via Systematic Evaluation28 May 2026
- 2026LocateAnything: Fast and High-Quality Vision-Language Grounding with Parallel Box Decoding26 May 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2026FineViT: Progressively Unlocking Fine-Grained Perception with Dense Recaptions18 Mar 2026
- 2026UNICBench: UNIfied Counting Benchmark for MLLM28 Feb 2026
- 2025Assessing the Visual Enumeration Abilities of Specialized Counting Architectures and Vision-Language Models17 Dec 2025
- 2025Can Vision-Language Models Count? A Synthetic Benchmark and Analysis of Attention-Based Interventions21 Nov 2025
- 2025Grasp Any Region: Towards Precise, Contextual Pixel Understanding for Multimodal LLMs21 Oct 2025
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
12 newest of 19 All 19 (JSON)
- 2023Semantic Generative Augmentations for Few-Shot Countingcited by 6
- 2024Detection-Driven Object Count Optimization for Text-to-Image Diffusion Modelscited by 4
- 2025CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidancecited by 4
- 2025D2D: Detector-to-Differentiable Critic for Improved Numeracy in Text-to-Image Generationcited by 1
- 2025CoDi -- an exemplar-conditioned diffusion model for low-shot countingcited by 1
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Modelcited by 1
- 2026One-Shot Novel View and Pose Human Image Synthesis via 3D Prior Guided Diffusion Model18 Jun 2026
- 2025CoDi -- an exemplar-conditioned diffusion model for low-shot counting23 Dec 2025
- 2025D2D: Detector-to-Differentiable Critic for Improved Numeracy in Text-to-Image Generation22 Oct 2025
- 2025CountLoop: Training-Free High-Instance Image Generation via Iterative Agent Guidance18 Aug 2025
- 2024Detection-Driven Object Count Optimization for Text-to-Image Diffusion Models21 Aug 2024
- 2023Semantic Generative Augmentations for Few-Shot Counting26 Oct 2023
- 2026Kwai Keye-VL-2.0 Technical Reportcited by 3
- 2026Kwai Keye-VL-2.0 Technical Report9 Jun 2026
- 2023LAMM: Language-Assisted Multi-Modal Instruction-Tuning Dataset, Framework, and Benchmarkcited by 169
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2025Detect Anything via Next Point Predictioncited by 66
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2023Zero-shot Object Countingcited by 57
- 2022Few-shot Object Counting and Detectioncited by 55
12 most cited of 118 All 118 (JSON)
- 2026UGO: Unified Architecture for General Multi-Object Tracking by Segmentation29 Sep 2026
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026Counting Beyond Instances: A Benchmark for Group-Individual Object Counting4 Sep 2026
- 2026LookThere! Sparse Vision by Reinforced Selection4 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026RECOUNT: Reference-guided Counting with Synthetic Visual Exemplars20 Aug 2026
- 2026ToolVision: Learning When and How to Use Visual Tools with Capability-Aligned Supervision9 Aug 2026
- 2026Depth-Guided Video Object Counting in Crowded Scenes6 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026AdaCount: Training-Free Similarity-Guided Spatial and Feature Adaptation for Zero-Shot Object Counting2 Jul 2026
- 2026VTOS: Learning to Orchestrate Vision Tools by Co-Searching Solutions and Observers17 Jun 2026
12 newest of 118 All 118 (JSON)