Open-world Text-specified Object Counting
Not on the map. Why?
Abstract (arXiv)
Our objective is open-world object counting in images, where the target object class is specified by a text description. To this end, we propose CounTX, a class-agnostic, single-stage model using a transformer decoder counting head on top of pre-trained joint text-image representations. CounTX is able to count the number of instances of any class given only an image and a text description of the target object class, and can be trained end-to-end. In addition to this model, we make the following contributions: (i) we compare the performance of CounTX to prior work on open-world object counting, and show that our approach exceeds the state of the art on all measures on the FSC-147 benchmark for methods that use text to specify the task; (ii) we present and release FSC-147-D, an enhanced version of FSC-147 with text descriptions, so that object classes can be described with more detailed language than their simple class names. FSC-147-D and the code are available at https://www.robots.ox.ac.uk/~vgg/research/countx.
Key facts. Cited by 41 papers in the map (data through 14 Oct 2026). Builds on 21 of its 35 references that are in the map. First posted on arXiv 2 Jun 2023.
Builds on
21 of 35 references.
References · 21
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017Mask R-CNNcited by 7,277
- 2022LAION-5B: An open large-scale dataset for training next generation image-text modelscited by 4,152
- 2021LiT: Zero-Shot Transfer with Locked-image text Tuningcited by 577
- 2023Teaching CLIP to Count to Tencited by 198
- 2017Drone-based Object Counting by Spatially Regularized Regional Proposal Networkcited by 156
- 2021Learning To Count Everythingcited by 150
- 2016A Large Contextual Dataset for Classification, Detection and Counting of Cars with Deep Learningcited by 86
- 2018Class-Agnostic Countingcited by 85
9 more
- 2022Represent, Compare, and Learn: A Similarity-Aware Framework for Class-Agnostic Countingcited by 80
- 2022CounTR: Transformer-based Generalised Visual Countingcited by 79
- 2022A Low-Shot Object Counting Network With Iterative Prototype Adaptationcited by 65
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2023Zero-shot Object Countingcited by 57
- 2022Few-shot Object Counting and Detectioncited by 55
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2022Exemplar Free Class Agnostic Countingcited by 32
- 2020Completely Self-Supervised Crowd Counting via Distribution Matchingcited by 22
Built on by
Citing papers per year: 2024: 7; 2025: 14; 2026: 20.
41 papers.
Sort:
By area:
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2025CrowdVLM-R1: Expanding R1 Ability to Vision Language Model for Crowd Counting using Fuzzy Group Relative Policy Rewardcited by 15
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Countingcited by 11
- 2025Open-World Object Counting in Videoscited by 11
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
- 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
- 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videoscited by 9
- 2025CountGD++: Generalized Prompting for Open-World Countingcited by 8
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approachescited by 7
- 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluationcited by 7
29 more
- 2026Vision as Unified Multimodal Generationcited by 7
- 2025Single Domain Generalization for Few-Shot Counting via Universal Representation Matchingcited by 6
- 2025CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Modelscited by 3
- 2025What is the Right Embedding Space for Contrastive Learning in Referring Expression Counting?cited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Countingcited by 2
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Countingcited by 2
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Countingcited by 2
- 2024Enhancing Zero-shot Counting via Language-guided Exemplar Learningcited by 1
- 2025Expanding Zero-Shot Object Counting with Rich Promptscited by 1
- 2025Counting Through Occlusion: Framework for Open World Amodal Countingcited by 1
- 2025Object Counting with GPT-4o and GPT-5: A Comparative Studycited by 1
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusioncited by 1
- 2026Count Anything at Any Granularitycited by 1
- 2026The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Countingcited by 1
- 2026Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoningcited by 1
- 2026Spatially-Aware Class-Agnostic Object Countingcited by 1
- 2024A Recipe for CAC: Mosaic-based Generalized Loss for Improved Class-Agnostic Countingcited by 0
- 2025CountFormer: A Transformer Framework for Learning Visual Repetition and Structure in Class-Agnostic Object Countingcited by 0
- 2026Count Anythingcited by 0
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Countingcited by 0
- 2026Test-Time Training for Robust Text-Guided Open-Vocabulary Object Countingcited by 0
- 2026MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Blockcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
- 2026Depth-Guided Video Object Counting in Crowded Scenescited by 0
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challengescited by 0
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesiscited by 0
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Countingcited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glancecited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glance30 Sep 2026
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026Depth-Guided Video Object Counting in Crowded Scenes6 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026MambaCount: Efficient Text-guided Open-vocabulary Object Counting with Spatial Sparse State Space Duality Block16 Jun 2026
- 2026Test-Time Training for Robust Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Count Anything29 May 2026
29 more
- 2026Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning28 May 2026
- 2026The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting18 May 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting4 May 2026
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agency21 Mar 2026
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusion23 Feb 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Counting11 Feb 2026
- 2025CountGD++: Generalized Prompting for Open-World Counting29 Dec 2025
- 2025Object Counting with GPT-4o and GPT-5: A Comparative Study2 Dec 2025
- 2025Counting Through Occlusion: Framework for Open World Amodal Counting16 Nov 2025
- 2025CountFormer: A Transformer Framework for Learning Visual Repetition and Structure in Class-Agnostic Object Counting27 Oct 2025
- 2025CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Models25 Sep 2025
- 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluation17 Sep 2025
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2025Open-World Object Counting in Videos18 Jun 2025
- 2025What is the Right Embedding Space for Contrastive Learning in Referring Expression Counting?28 May 2025
- 2025Single Domain Generalization for Few-Shot Counting via Universal Representation Matching22 May 2025
- 2025Expanding Zero-Shot Object Counting with Rich Prompts21 May 2025
- 2025CrowdVLM-R1: Expanding R1 Ability to Vision Language Model for Crowd Counting using Fuzzy Group Relative Policy Reward31 Mar 2025
- 2025Exploring Contextual Attribute Density in Referring Expression Counting16 Mar 2025
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approaches31 Jan 2025
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Counting24 Sep 2024
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videos24 Jul 2024
- 2024CountGD: Multi-Modal Open-World Counting5 Jul 2024
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Counting25 Apr 2024
- 2024A Recipe for CAC: Mosaic-based Generalized Loss for Improved Class-Agnostic Counting15 Apr 2024
- 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videos26 Mar 2024
- 2024Enhancing Zero-shot Counting via Language-guided Exemplar Learning8 Feb 2024
- 2025CrowdVLM-R1: Expanding R1 Ability to Vision Language Model for Crowd Counting using Fuzzy Group Relative Policy Rewardcited by 15
- 2025CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Modelscited by 3
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Countingcited by 2
- 2026Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoningcited by 1
- 2026Train the Agent, Not the Expert: Learning to Harness Heterogeneous Experts for Multi-Turn Visual Reasoning28 May 2026
- 2026Chain-of-Look Spatial Reasoning for Dense Surgical Instrument Counting11 Feb 2026
- 2025CompareBench: A Benchmark for Visual Comparison Reasoning in Vision-Language Models25 Sep 2025
- 2025CrowdVLM-R1: Expanding R1 Ability to Vision Language Model for Crowd Counting using Fuzzy Group Relative Policy Reward31 Mar 2025
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026Count Anything at Any Granularitycited by 1
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Countingcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026RT-Counter: Real-Time Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Count Anything at Any Granularity11 May 2026
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glancecited by 0
- 2026EviRover: Reinforcing Agentic Perception Beyond a Glance30 Sep 2026
- 2024CountGD: Multi-Modal Open-World Countingcited by 59
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agencycited by 50
- 2024DAVE -- A Detect-and-Verify Paradigm for Low-Shot Countingcited by 49
- 2024Mind the Prompt: A Novel Benchmark for Prompt-based Class-Agnostic Countingcited by 11
- 2025Open-World Object Counting in Videoscited by 11
- 2024OVR: A Dataset for Open Vocabulary Temporal Repetition Counting in Videoscited by 10
- 2025Exploring Contextual Attribute Density in Referring Expression Countingcited by 10
- 2024Every Shot Counts: Using Exemplars for Repetition Counting in Videoscited by 9
- 2025CountGD++: Generalized Prompting for Open-World Countingcited by 8
- 2025A Survey on Class-Agnostic Counting: Advancements from Reference-Based to Open-World Text-Guided Approachescited by 7
- 2025Can Current AI Models Count What We Mean, Not What They See? A Benchmark and Systematic Evaluationcited by 7
- 2026Vision as Unified Multimodal Generationcited by 7
12 most cited of 31 All 31 (JSON)
- 2026DualCount: Structurally Consistent Density and Point Modeling for Zero-Shot Object Counting14 Sep 2026
- 2026Bottom-up Modeling of Repeated Elements via Single Image Analysis-by-Synthesis7 Sep 2026
- 2026Object Counting Across Modalities: Taxonomies, Benchmarks, Applications, and Open Challenges24 Aug 2026
- 2026Depth-Guided Video Object Counting in Crowded Scenes6 Aug 2026
- 2026Spatially-Aware Class-Agnostic Object Counting18 Jul 2026
- 2026Vision as Unified Multimodal Generation7 Jul 2026
- 2026Test-Time Training for Robust Text-Guided Open-Vocabulary Object Counting16 Jun 2026
- 2026Count Anything29 May 2026
- 2026The MixCount Dataset: Bridging the Data Gap for Open-Vocabulary Object Counting18 May 2026
- 2026Does it Really Count? Assessing Semantic Grounding in Text-Guided Class-Agnostic Counting4 May 2026
- 2026Seed1.8 Model Card: Towards Generalized Real-World Agency21 Mar 2026
- 2026CountEx: Fine-Grained Counting via Exemplars and Exclusion23 Feb 2026
12 newest of 31 All 31 (JSON)