An End-to-End Transformer Model for Crowd Localization
Not on the map. Why?
Abstract (arXiv)
Crowd localization, predicting head positions, is a more practical and high-level task than simply counting. Existing methods employ pseudo-bounding boxes or pre-designed localization maps, relying on complex post-processing to obtain the head positions. In this paper, we propose an elegant, end-to-end Crowd Localization Transformer named CLTR that solves the task in the regression-based paradigm. The proposed method views the crowd localization as a direct set prediction problem, taking extracted features and trainable embeddings as input of the transformer-decoder. To reduce the ambiguous points and generate more reasonable matching results, we introduce a KMO-based Hungarian matcher, which adopts the nearby context as the auxiliary matching cost. Extensive experiments conducted on five datasets in various data settings show the effectiveness of our method. In particular, the proposed method achieves the best localization performance on the NWPU-Crowd, UCF-QNRF, and ShanghaiTech Part A datasets.
Key facts. Cited by 74 papers in the map (data through 7 Oct 2026). Builds on 39 of its 49 references that are in the map. First posted on arXiv 26 Feb 2022.
Builds on
39 of 49 references.
References · 39
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2020Training data-efficient image transformers & distillation through attentioncited by 4,560
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2018CSRNet: Dilated Convolutional Neural Networks for Understanding the Highly Congested Scenescited by 267
- 2018Composition Loss for Counting, Density Map Estimation and Localization in Dense Crowdscited by 186
- 2019Bayesian Loss for Crowd Count Estimation with Point Supervisioncited by 162
- 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
27 more
- 2020NWPU-Crowd: A Large-Scale Benchmark for Crowd Counting and Localizationcited by 151
- 2018Context-Aware Crowd Countingcited by 150
- 2021End-to-end Temporal Action Detection with Transformercited by 150
- 2019Learning from Synthetic Data for Crowd Counting in the Wildcited by 148
- 2020Distribution Matching for Crowd Countingcited by 143
- 2020JHU-CROWD++: Large-Scale Crowd Counting Dataset and A Benchmark Methodcited by 109
- 2019Locate, Size and Count: Accurately Resolving People in Dense Crowds via Detectioncited by 73
- 2016Finding Tiny Facescited by 72
- 2020Localization in the Crowd with Topological Constraintscited by 68
- 2019Point in, Box out: Beyond Counting Persons in Crowdscited by 62
- 2021TransCrowd: weakly-supervised crowd counting with transformerscited by 61
- 2018Where are the Blobs: Counting by Localization with Point Supervisioncited by 54
- 2019Crowd Counting with Deep Structured Scale Integration Networkcited by 46
- 2019Multi-Level Bottom-Top and Top-Bottom Feature Fusion for Crowd Countingcited by 36
- 2020NAS-Count: Counting-by-Density with Neural Architecture Searchcited by 36
- 2020A Self-Training Approach for Point-Supervised Object Detection and Counting in Crowdscited by 36
- 2021Focal Inverse Distance Transform Maps for Crowd Localizationcited by 36
- 2019AutoScale: Learning to Scale for Crowd Counting and Localizationcited by 35
- 2019Learn to Scale: Generating Multipolar Normalized Density Maps for Crowd Countingcited by 32
- 2020Weighing Counts: Sequential Crowd Counting by Reinforcement Learningcited by 30
- 2021Detection, Tracking, and Counting Meets Drones in Crowds: A Benchmarkcited by 30
- 2021CCTrans: Simplifying and Improving Crowd Counting with Transformercited by 30
- 2019SCAR: Spatial-/Channel-wise Attention Regression Networks for Crowd Countingcited by 28
- 2018Locating Objects Without Bounding Boxescited by 25
- 2020Learning Independent Instance Maps for Crowd Localizationcited by 24
- 2021Congested Crowd Instance Localization with Dilated Convolutional Swin Transformercited by 11
- 2021VisDrone-CC2020: The Vision Meets Drone Crowd Counting Challenge Resultscited by 5
Built on by
Citing papers per year: 2022: 6; 2023: 15; 2024: 17; 2025: 24; 2026: 12.
74 papers.
Sort:
By area:
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 166
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2023Point-Query Quadtree for Crowd Counting, Localization, and Morecited by 40
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Countingcited by 25
- 2024Improving Point-based Crowd Counting and Localization Based on Auxiliary Point Guidancecited by 22
- 2023CrowdDiff: Multi-hypothesis Crowd Density Estimation using Diffusion Modelscited by 20
- 2024Gramformer: Learning Crowd Counting via Graph-Modulated Transformercited by 19
- 2022Revisiting Crowd Counting: State-of-the-art, Trends, and Future Perspectivescited by 16
- 2023Regressor-Segmenter Mutual Prompt Learning for Crowd Countingcited by 16
- 2023Counting Crowds in Bad Weathercited by 14
38 more
- 2023Boosting Detection in Crowd Analysis via Underutilized Output Featurescited by 14
- 2024CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classificationcited by 12
- 2024CountFormer: Multi-View Crowd Counting Transformercited by 12
- 2023RGB-D Indiscernible Object Counting in Underwater Scenescited by 9
- 2022CrowdFormer: Weakly-supervised Crowd counting with Improved Generalizabilitycited by 8
- 2022Consistency-Aware Anchor Pyramid Network for Crowd Localizationcited by 8
- 2023DPA-P2PNet: Deformable Proposal-aware P2PNet for Accurate Point-based Cell Detectioncited by 8
- 2023Learning Discriminative Features for Crowd Countingcited by 8
- 2024FGENet: Fine-Grained Extraction Network for Congested Crowd Countingcited by 7
- 2024VMambaCC: A Visual State Space Model for Crowd Countingcited by 7
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysiscited by 7
- 2023SoybeanNet: Transformer-Based Convolutional Neural Network for Soybean Pod Counting from Unmanned Aerial Vehicle (UAV) Imagescited by 6
- 2025CountingDINO: A Training-free Pipeline for Class-Agnostic Counting using Unsupervised Backbonescited by 6
- 2025Point-to-Region Loss for Semi-Supervised Point-Based Crowd Countingcited by 6
- 2022Glance to Count: Learning to Rank with Anchors for Weakly-supervised Crowd Countingcited by 5
- 2024Diffusion-based Data Augmentation for Object Counting Problemscited by 5
- 2025[De|Re]constructing VLMs' Reasoning in Countingcited by 5
- 2022Progressive Multi-resolution Loss for Crowd Countingcited by 4
- 2024Robust Zero-Shot Crowd Counting and Localization With Adaptive Resolution SAMcited by 4
- 2025Video Individual Counting for Moving Dronescited by 4
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognitioncited by 4
- 2024The Effectiveness of a Simplified Model Structure for Crowd Countingcited by 3
- 2026UNICBench: UNIfied Counting Benchmark for MLLMcited by 3
- 2023Super-Resolution Information Enhancement For Crowd Countingcited by 2
- 2023Shifted Autoencoders for Point Annotation Restoration in Object Countingcited by 2
- 2024Few-shot Object Localizationcited by 2
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Countingcited by 2
- 2023Semi-supervised Cell Recognition under Point Supervisioncited by 1
- 2024Tree Counting by Bridging 3D Point Clouds with Imagerycited by 1
- 2024A Density-Guided Temporal Attention Transformer for Indiscernible Object Counting in Underwater Videocited by 1
- 2024Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learningcited by 1
- 2025Depth-Assisted Network for Indiscernible Marine Object Counting with Adaptive Motion-Differentiated Feature Encodingcited by 1
- 2025Learning Extremely High Density Crowds as Active Matterscited by 1
- 2025Consistent-Point: Consistent Pseudo-Points for Semi-Supervised Crowd Counting and Localizationcited by 1
- 2025L2HCount:Generalizing Crowd Counting from Low to High Crowd Density via Density Simulationcited by 1
- 2025ProgRoCC: A Progressive Approach to Rough Crowd Countingcited by 1
50 most cited of 74 All 74 (JSON)
- 2026DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting15 Aug 2026
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026Multi-Modal Hyper-Graph Fusion for Low-Light Crowd Counting17 Jun 2026
- 2026When Numbers Speak: Aligning Textual Numerals and Visual Instances in Text-to-Video Diffusion Models9 Apr 2026
- 2026Dense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation2 Apr 2026
- 2026SynMVCrowd: A Large Synthetic Benchmark for Multi-view Crowd Counting and Localization25 Mar 2026
- 2026Getting to the Point: Pointing Improves LVLMs at Counting23 Mar 2026
- 2026UNICBench: UNIfied Counting Benchmark for MLLM28 Feb 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods18 Jan 2026
- 2026An Efficient Additive Kolmogorov-Arnold Transformer for Point-Level Maize Localization in Unmanned Aerial Vehicle Imagery12 Jan 2026
38 more
- 2025[De|Re]constructing VLMs' Reasoning in Counting22 Oct 2025
- 2025Exploring Scale Shift in Crowd Localization under the Context of Domain Generalization22 Oct 2025
- 2025Foggy Crowd Counting: Combining Physical Priors and KAN-Graph29 Sep 2025
- 2025Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budget20 Sep 2025
- 2025DSGC-Net: A Dual-Stream Graph Convolutional Network for Crowd Counting via Feature Correlation Mining2 Sep 2025
- 2025Local Information Matters: A Rethink of Crowd Counting23 Aug 2025
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2025Point-to-Region Loss for Semi-Supervised Point-Based Crowd Counting28 May 2025
- 2025SoftHGNN: Soft Hypergraph Neural Networks for General Visual Recognition21 May 2025
- 2025Transformer-Based Dual-Optical Attention Fusion Crowd Head Point Counting and Localization Network11 May 2025
- 2025Adept: Annotation-Denoising Auxiliary Tasks with Discrete Cosine Transform Map and Keypoint for Human-Centric Pretraining29 Apr 2025
- 2025Crowd Detection Using Very-Fine-Resolution Satellite Imagery28 Apr 2025
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting24 Apr 2025
- 2025CountingDINO: A Training-free Pipeline for Class-Agnostic Counting using Unsupervised Backbones23 Apr 2025
- 2025ProgRoCC: A Progressive Approach to Rough Crowd Counting18 Apr 2025
- 2025Constrained Gaussian Process Motion Planning via Stein Variational Newton Inference7 Apr 2025
- 2025L2HCount:Generalizing Crowd Counting from Low to High Crowd Density via Density Simulation17 Mar 2025
- 2025Consistent-Point: Consistent Pseudo-Points for Semi-Supervised Crowd Counting and Localization16 Mar 2025
- 2025Learning Extremely High Density Crowds as Active Matters15 Mar 2025
- 2025EHNet: An Efficient Hybrid Network for Crowd Counting and Localization15 Mar 2025
- 2025Video Individual Counting for Moving Drones12 Mar 2025
- 2025Depth-Assisted Network for Indiscernible Marine Object Counting with Adaptive Motion-Differentiated Feature Encoding11 Mar 2025
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis3 Feb 2025
- 2025ANTHROPOS-V: benchmarking the novel task of Crowd Volume Estimation3 Jan 2025
- 2024Text-guided Zero-Shot Object Localization18 Nov 2024
- 2024A Survey of Camouflaged Object Detection and Beyond26 Aug 2024
- 2024Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning12 Aug 2024
- 2024CountFormer: Multi-View Crowd Counting Transformer2 Jul 2024
- 2024Improving Point-based Crowd Counting and Localization Based on Auxiliary Point Guidance17 May 2024
- 2024VMambaCC: A Visual State Space Model for Crowd Counting7 May 2024
- 2024The Effectiveness of a Simplified Model Structure for Crowd Counting11 Apr 2024
- 2024MCNet: A crowd denstity estimation network based on integrating multiscale attention module29 Mar 2024
- 2024Few-shot Object Localization19 Mar 2024
- 2024CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classification14 Mar 2024
- 2024A Density-Guided Temporal Attention Transformer for Indiscernible Object Counting in Underwater Video6 Mar 2024
- 2024Tree Counting by Bridging 3D Point Clouds with Imagery4 Mar 2024
- 2024Robust Zero-Shot Crowd Counting and Localization With Adaptive Resolution SAM27 Feb 2024
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysis16 Feb 2024
50 newest of 74 All 74 (JSON)
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Modelcited by 47
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysiscited by 7
- 2026UNICBench: UNIfied Counting Benchmark for MLLMcited by 3
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Countingcited by 2
- 2025Text-promptable Object Counting via Quantity Awareness Enhancementcited by 2
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generationcited by 0
- 2026ABACUS: Adapting Unified Foundation Model for Bridging Image Count Understanding and Generation22 Jun 2026
- 2026UNICBench: UNIfied Counting Benchmark for MLLM28 Feb 2026
- 2025Text-promptable Object Counting via Quantity Awareness Enhancement9 Jul 2025
- 2025SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting24 Apr 2025
- 2025AquaticCLIP: A Vision-Language Foundation Model for Underwater Scene Analysis3 Feb 2025
- 2023CrowdCLIP: Unsupervised Crowd Counting via Vision-Language Model9 Apr 2023
- 2025[De|Re]constructing VLMs' Reasoning in Countingcited by 5
- 2026Getting to the Point: Pointing Improves LVLMs at Countingcited by 0
- 2026Getting to the Point: Pointing Improves LVLMs at Counting23 Mar 2026
- 2025[De|Re]constructing VLMs' Reasoning in Counting22 Oct 2025
- 2024PointMamba: A Simple State Space Model for Point Cloud Analysiscited by 166
- 2024VMambaCC: A Visual State Space Model for Crowd Countingcited by 7
- 2022Learning to Count Anything: Reference-less Class-agnostic Counting with Weak Supervisioncited by 41
- 2023Point-Query Quadtree for Crowd Counting, Localization, and Morecited by 40
- 2024A Survey of Camouflaged Object Detection and Beyondcited by 37
- 2023Vision Transformer Off-the-Shelf: A Surprising Baseline for Few-Shot Class-Agnostic Countingcited by 25
- 2024Improving Point-based Crowd Counting and Localization Based on Auxiliary Point Guidancecited by 22
- 2024Gramformer: Learning Crowd Counting via Graph-Modulated Transformercited by 19
- 2022Revisiting Crowd Counting: State-of-the-art, Trends, and Future Perspectivescited by 16
- 2023Regressor-Segmenter Mutual Prompt Learning for Crowd Countingcited by 16
- 2023Counting Crowds in Bad Weathercited by 14
- 2023Boosting Detection in Crowd Analysis via Underutilized Output Featurescited by 14
- 2024CLIP-EBC: CLIP Can Count Accurately through Enhanced Blockwise Classificationcited by 12
- 2024CountFormer: Multi-View Crowd Counting Transformercited by 12
12 most cited of 60 All 60 (JSON)
- 2026VTO: Visual Tool Orchestration for Video Anomaly Detection8 Aug 2026
- 2026Multi-Modal Hyper-Graph Fusion for Low-Light Crowd Counting17 Jun 2026
- 2026Dense Point-to-Mask Optimization with Reinforced Point Selection for Crowd Instance Segmentation2 Apr 2026
- 2026SynMVCrowd: A Large Synthetic Benchmark for Multi-view Crowd Counting and Localization25 Mar 2026
- 2026Bootstrapping MLLM for Weakly-Supervised Class-Agnostic Object Counting13 Feb 2026
- 2026Video Individual Counting and Tracking from Moving Drones: A Benchmark and Methods18 Jan 2026
- 2026An Efficient Additive Kolmogorov-Arnold Transformer for Point-Level Maize Localization in Unmanned Aerial Vehicle Imagery12 Jan 2026
- 2025Exploring Scale Shift in Crowd Localization under the Context of Domain Generalization22 Oct 2025
- 2025Foggy Crowd Counting: Combining Physical Priors and KAN-Graph29 Sep 2025
- 2025Active View Selection for Scene-level Multi-view Crowd Counting and Localization with Limited Labeling Budget20 Sep 2025
- 2025DSGC-Net: A Dual-Stream Graph Convolutional Network for Crowd Counting via Feature Correlation Mining2 Sep 2025
- 2025Local Information Matters: A Rethink of Crowd Counting23 Aug 2025
12 newest of 60 All 60 (JSON)