End-to-end people detection in crowded scenes
Not on the map. Why?
Abstract (arXiv)
Current people detectors operate either by scanning an image in a sliding window fashion or by classifying a discrete set of proposals. We propose a model that is based on decoding an image into a set of people detections. Our system takes an image as input and directly outputs a set of distinct detection hypotheses. Because we generate predictions jointly, common post-processing steps such as non-maximum suppression are unnecessary. We use a recurrent LSTM layer for sequence generation and train our model end-to-end with a new loss function that operates on sets of detections. We demonstrate the effectiveness of our approach on the challenging task of detecting people in crowded scenes.
Key facts. Cited by 140 papers in the map (data through 7 Oct 2026). First posted on arXiv 16 Jun 2015.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 41; 2022: 33; 2023: 35; 2024: 17; 2025: 8; 2026: 6.
140 papers.
Sort:
By area:
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
- 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
- 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
- 2021Efficient DETR: Improving End-to-End Object Detector with Dense Priorcited by 128
- 2021You Only Look One-level Featurecited by 116
38 more
- 2021Panoptic SegFormer: Delving Deeper into Panoptic Segmentation with Transformerscited by 109
- 2021Video Instance Segmentation using Inter-Frame Communication Transformerscited by 105
- 2021Pose Recognition with Cascade Transformerscited by 99
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2021E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learningcited by 84
- 2023Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Modelscited by 82
- 2022TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 78
- 20213D-MAN: 3D Multi-frame Attention Network for Object Detectioncited by 73
- 2021QVHighlights: Detecting Moments and Highlights in Videos via Natural Language Queriescited by 72
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigationcited by 71
- 2022SwinTextSpotter: Scene Text Spotting via Better Synergy between Text Detection and Text Recognitioncited by 70
- 2022A Keypoint-based Global Association Network for Lane Detectioncited by 68
- 2022Sparse Instance Activation for Real-Time Instance Segmentationcited by 63
- 2022Few-shot Object Counting with Similarity-Aware Feature Enhancementcited by 62
- 2023Continual Detection Transformer for Incremental Object Detectioncited by 59
- 2021Object DGCNN: 3D Object Detection using Dynamic Graphscited by 58
- 2021On Pursuit of Designing Multi-modal Transformer for Video Groundingcited by 54
- 2022Polar Parametrization for Vision-based Surround-View 3D Detectioncited by 53
- 2021Mitigating Dataset Harms Requires Stewardship: Lessons from 1000 Paperscited by 49
- 2021Activity Graph Transformer for Temporal Action Localizationcited by 48
- 20214D-Net for Learned Multi-Modal Alignmentcited by 44
- 2022Discovering Objects that Can Movecited by 44
- 2023LATR: 3D Lane Detection from Monocular Images with Transformercited by 44
- 2021Tracking Pedestrian Heads in Dense Crowdcited by 42
- 2021End-to-End Video Object Detection with Spatial-Temporal Transformerscited by 40
- 2023FastInst: A Simple Query-Based Model for Real-Time Instance Segmentationcited by 32
- 2022Progressive End-to-End Object Detection in Crowded Scenescited by 31
- 2022BoxTeacher: Exploring High-Quality Pseudo Labels for Weakly Supervised Instance Segmentationcited by 31
- 2021Multi-Instance Pose Networks: Rethinking Top-Down Pose Estimationcited by 30
- 2021About Face: A Survey of Facial Recognition Evaluationcited by 27
- 2022Learning 3D Scene Priors with 2D Supervisioncited by 24
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Imagescited by 24
- 2021A Survey of Deep Learning Techniques for Weed Detection from Imagescited by 23
- 2023Object Detection with Transformers: A Reviewcited by 22
- 2023Calibrating Uncertainty for Semi-Supervised Crowd Countingcited by 22
- 2021Maria: A Visual Experience Powered Conversational Agentcited by 19
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentationcited by 18
- 2021Multiset-Equivariant Set Prediction with Approximate Implicit Differentiationcited by 17
50 most cited of 140 All 140 (JSON)
- 2026Fiber-Resolved Microstructure Quantification from Multi-Shell Diffusion MRI using Detection Transformers30 Sep 2026
- 2026Small Object Detection in Industrial Recycling: A New Dataset and YOLO Performance Evaluation26 May 2026
- 2026Global monitoring of methane point sources using deep learning on hyperspectral radiance measurements from EMIT11 Apr 2026
- 2026Heuristic-inspired Reasoning Priors Facilitate Data-Efficient Referring Object Detection25 Mar 2026
- 2026Exclusivity-Guided Mask Learning for Semi-Supervised Crowd Instance Segmentation and Counting17 Mar 2026
- 2026MatchED: Crisp Edge Detection Using End-to-End, Matching-based Supervision24 Feb 2026
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing9 Dec 2025
- 2025VLM-SlideEval: Evaluating VLMs on Structured Comprehension and Perturbation Sensitivity in PPT24 Oct 2025
- 2025IAUNet: Instance-Aware U-Net3 Aug 2025
- 2025UniSite: The First Cross-Structure Dataset and Learning Framework for End-to-End Ligand Binding Site Detection3 Jun 2025
- 2025WaveInst: A Frequency-Domain Enhanced Network for Fine-Grained Thin Tree Trunk Extraction in Forest Scenes3 May 2025
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making7 Apr 2025
38 more
- 2025FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection10 Mar 2025
- 2025MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds26 Feb 2025
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentation5 Dec 2024
- 2024Benchmark Data Repositories for Better Benchmarking31 Oct 2024
- 2024PointSAM: Pointly-Supervised Segment Anything Model for Remote Sensing Images20 Sep 2024
- 2024Mutually-Aware Feature Learning for Few-Shot Object Counting19 Aug 2024
- 2024Boosting Adverse Weather Crowd Counting via Multi-queue Contrastive Learning12 Aug 2024
- 2024The Research of Group Re-identification from Multiple Cameras19 Jul 2024
- 2024WPS-SAM: Towards Weakly-Supervised Part Segmentation with Foundation Models14 Jul 2024
- 2024Part2Object: Hierarchical Unsupervised 3D Instance Segmentation14 Jul 2024
- 2024MOS: Model Synergy for Test-Time Adaptation on LiDAR-Based 3D Object Detection21 Jun 2024
- 2024DPO: Dual-Perturbation Optimization for Test-time Adaptation in 3D Object Detection19 Jun 2024
- 2024Deep Transformer Network for Monocular Pose Estimation of Shipborne Unmanned Aerial Vehicle13 Jun 2024
- 2024YOLOv10: Real-Time End-to-End Object Detection23 May 2024
- 2024Learning Spatial Similarity Distribution for Few-shot Object Counting20 May 2024
- 2024Lightweight Spatial Modeling for Combinatorial Information Extraction From Documents8 May 2024
- 2024Criteria for Uncertainty-based Corner Cases Detection in Instance Segmentation17 Apr 2024
- 2024Explicitly Representing Syntax Improves Sentence-to-layout Prediction of Unexpected Situations25 Jan 2024
- 2024SwinTextSpotter v2: Towards Better Synergy for Scene Text Spotting15 Jan 2024
- 2023Multiscale Vision Transformers meet Bipartite Matching for efficient single-stage Action Localization29 Dec 2023
- 2023OsmLocator: locating overlapping scatter marks with a non-training generative perspective18 Dec 2023
- 2023Efficient Multi-Object Pose Estimation using Multi-Resolution Deformable Attention and Query Aggregation13 Dec 2023
- 2023Weakly Supervised Point Cloud Segmentation via Conservative Propagation of Scene-level Labels11 Dec 2023
- 2023LightCLIP: Learning Multi-Level Interaction for Lightweight Vision-Language Models1 Dec 2023
- 2023SoybeanNet: Transformer-Based Convolutional Neural Network for Soybean Pod Counting from Unmanned Aerial Vehicle (UAV) Images16 Oct 2023
- 2023AiAReSeg: Catheter Detection and Segmentation in Interventional Ultrasound using Transformers25 Sep 2023
- 2023PSDiff: Diffusion Model for Person Search with Iterative and Collaborative Refinement20 Sep 2023
- 2023Temporal-aware Hierarchical Mask Classification for Video Semantic Segmentation14 Sep 2023
- 2023Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Art10 Sep 2023
- 2023DeNoising-MOT: Towards Multiple Object Tracking with Severe Occlusions9 Sep 2023
- 2023An extensible point-based method for data chart value detection22 Aug 2023
- 2023Calibrating Uncertainty for Semi-Supervised Crowd Counting19 Aug 2023
- 2023Bird's-Eye-View Scene Graph for Vision-Language Navigation9 Aug 2023
- 2023LATR: 3D Lane Detection from Monocular Images with Transformer8 Aug 2023
- 2023Count, Decode and Fetch: A New Approach to Handwritten Chinese Character Error Correction30 Jul 2023
- 2023YOLOPose V2: Understanding and Improving Transformer-based 6D Pose Estimation21 Jul 2023
- 2023TreeFormer: a Semi-Supervised Transformer-based Framework for Tree Counting from a Single High Resolution Image12 Jul 2023
- 2023Object Detection with Transformers: A Review7 Jun 2023
50 newest of 140 All 140 (JSON)
- 2021E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learningcited by 84
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentationcited by 18
- 2022MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learningcited by 13
- 2023LightCLIP: Learning Multi-Level Interaction for Lightweight Vision-Language Modelscited by 3
- 2025VLM-SlideEval: Evaluating VLMs on Structured Comprehension and Perturbation Sensitivity in PPTcited by 2
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensingcited by 0
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing9 Dec 2025
- 2025VLM-SlideEval: Evaluating VLMs on Structured Comprehension and Perturbation Sensitivity in PPT24 Oct 2025
- 2024Mask-Adapter: The Devil is in the Masks for Open-Vocabulary Segmentation5 Dec 2024
- 2023LightCLIP: Learning Multi-Level Interaction for Lightweight Vision-Language Models1 Dec 2023
- 2022MVPTR: Multi-Level Semantic Alignment for Vision-Language Pre-Training via Multi-Stage Learning29 Jan 2022
- 2021E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning3 Jun 2021
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2021TrackFormer: Multi-Object Tracking with Transformerscited by 515
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2021Pix2seq: A Language Modeling Framework for Object Detectioncited by 345
- 2021An End-to-End Transformer Model for 3D Object Detectioncited by 329
- 2022Mask3D: Mask Transformer for 3D Semantic Instance Segmentationcited by 299
- 2021K-Net: Towards Unified Image Segmentationcited by 211
- 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
- 2021Rethinking Counting and Localization in Crowds:A Purely Point-Based Frameworkcited by 152
- 2021End-to-End Human Object Interaction Detection with HOI Transformercited by 134
- 2021Efficient DETR: Improving End-to-End Object Detector with Dense Priorcited by 128
- 2021You Only Look One-level Featurecited by 116
12 most cited of 132 All 132 (JSON)
- 2026Fiber-Resolved Microstructure Quantification from Multi-Shell Diffusion MRI using Detection Transformers30 Sep 2026
- 2026Small Object Detection in Industrial Recycling: A New Dataset and YOLO Performance Evaluation26 May 2026
- 2026Global monitoring of methane point sources using deep learning on hyperspectral radiance measurements from EMIT11 Apr 2026
- 2026Heuristic-inspired Reasoning Priors Facilitate Data-Efficient Referring Object Detection25 Mar 2026
- 2026Exclusivity-Guided Mask Learning for Semi-Supervised Crowd Instance Segmentation and Counting17 Mar 2026
- 2026MatchED: Crisp Edge Detection Using End-to-End, Matching-based Supervision24 Feb 2026
- 2025IAUNet: Instance-Aware U-Net3 Aug 2025
- 2025UniSite: The First Cross-Structure Dataset and Learning Framework for End-to-End Ligand Binding Site Detection3 Jun 2025
- 2025WaveInst: A Frequency-Domain Enhanced Network for Fine-Grained Thin Tree Trunk Extraction in Forest Scenes3 May 2025
- 2025Multimodal Agricultural Agent Architecture (MA3): A New Paradigm for Intelligent Agricultural Decision-Making7 Apr 2025
- 2025FastInstShadow: A Simple Query-Based Model for Instance Shadow Detection10 Mar 2025
- 2025MaskPlanner: Learning-Based Object-Centric Motion Generation from 3D Point Clouds26 Feb 2025
12 newest of 132 All 132 (JSON)