Occlusion-aware R-CNN: Detecting Pedestrians in a Crowd
Not on the map. Why?
Abstract (arXiv)
Pedestrian detection in crowded scenes is a challenging problem since the pedestrians often gather together and occlude each other. In this paper, we propose a new occlusion-aware R-CNN (OR-CNN) to improve the detection accuracy in the crowd. Specifically, we design a new aggregation loss to enforce proposals to be close and locate compactly to the corresponding objects. Meanwhile, we use a new part occlusion-aware region of interest (PORoI) pooling unit to replace the RoI pooling layer in order to integrate the prior structure information of human body with visibility prediction into the network to handle occlusion. Our detector is trained in an end-to-end fashion, which achieves state-of-the-art results on three pedestrian detection datasets, i.e., CityPersons, ETH, and INRIA, and performs on-pair with the state-of-the-arts on Caltech.
Key facts. Cited by 58 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Jul 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 19; 2022: 18; 2023: 10; 2024: 4; 2025: 4; 2026: 3.
58 papers.
Sort:
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2021Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)cited by 45
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2022Progressive End-to-End Object Detection in Crowded Scenescited by 31
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detectioncited by 26
- 2021Occlusion Handling in Generic Object Detection: A Reviewcited by 25
- 2023VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervisioncited by 19
38 more
- 2022Towards Domain Generalization in Object Detectioncited by 16
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Reviewcited by 13
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenescited by 13
- 2021Variational Pedestrian Detectioncited by 10
- 2021Holistic Guidance for Occluded Person Re-Identificationcited by 9
- 2021BlockCopy: High-Resolution Video Processing with Block-Sparse Feature Propagation and Online Policiescited by 9
- 2022Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyondcited by 8
- 2022Beta R-CNN: Looking into Pedestrian Detection from Another Perspectivecited by 8
- 2021LLA: Loss-aware Label Assignment for Dense Pedestrian Detectioncited by 7
- 20212.5D Visual Relationship Detectioncited by 7
- 2021NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detectioncited by 7
- 2021Multi-Modal Pedestrian Detection with Large Misalignment Based on Modal-Wise Regression and Multi-Modal IoUcited by 7
- 2023Self-similarity Driven Scale-invariant Learning for Weakly Supervised Person Searchcited by 7
- 2021Occluded Video Instance Segmentation: Dataset and ICCV 2021 Challengecited by 6
- 2022Improving Crowded Object Detection via Copy-Pastecited by 6
- 2025SARMAE: Masked Autoencoder for SAR Representation Learningcited by 6
- 2022KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D Correspondencescited by 5
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architecturescited by 5
- 2022Body-Part Joint Detection and Association via Extended Object Representationcited by 5
- 2022Deep Multi-Task Networks For Occluded Pedestrian Pose Estimationcited by 4
- 2022Humans need not label more humans: Occlusion Copy & Paste for Occluded Human Instance Segmentationcited by 4
- 2022Feature Calibration Network for Occluded Pedestrian Detectioncited by 4
- 2023Learning Pedestrian Actions to Ensure Safe Autonomous Drivingcited by 4
- 2022Mask Focal Loss: A unifying framework for dense crowd counting with canonical object detection networkscited by 3
- 2023Attribute Annotation and Bias Evaluation in Visual Datasets for Autonomous Drivingcited by 3
- 2021V2F-Net: Explicit Decomposition of Occluded Pedestrian Detectioncited by 2
- 2021Pedestrian Detection by Exemplar-Guided Contrastive Learningcited by 2
- 2023BPJDet: Extended Object Representation for Generic Body-Part Joint Detectioncited by 2
- 2023Now You See Me: Robust approach to Partial Occlusionscited by 2
- 2024YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systemscited by 2
- 2025Learning better representations for crowded pedestrians in offboard LiDAR-camera 3D tracking-by-detectioncited by 2
- 2021You Better Look Twice: a new perspective for designing accurate detectors with reduced computationscited by 1
- 2022An Objective Method for Pedestrian Occlusion Level Classificationcited by 1
- 2022UnfoldML: Cost-Aware and Uncertainty-Based Dynamic 2D Prediction for Multi-Stage Classificationcited by 1
- 2023Hardwiring ViT Patch Selectivity into CNNs using Patch Mixingcited by 1
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completioncited by 1
- 2025Density-based Object Detection in Crowded Scenescited by 1
- 2026Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenescited by 1
50 most cited of 58 All 58 (JSON)
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenes6 Mar 2026
- 2025SARMAE: Masked Autoencoder for SAR Representation Learning18 Dec 2025
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025Learning better representations for crowded pedestrians in offboard LiDAR-camera 3D tracking-by-detection21 May 2025
- 2025Density-based Object Detection in Crowded Scenes14 Apr 2025
- 2024Mean Height Aided Post-Processing for Pedestrian Detection24 Aug 2024
- 2024YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems25 Jul 2024
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes16 Jul 2024
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion2 May 2024
- 2023Attribute Annotation and Bias Evaluation in Visual Datasets for Autonomous Driving11 Dec 2023
38 more
- 2023Perception Reinforcement Using Auxiliary Learning Feature Fusion: A Modified Yolov8 for Head Detection14 Oct 2023
- 2023Hardwiring ViT Patch Selectivity into CNNs using Patch Mixing30 Jun 2023
- 2023Learning Pedestrian Actions to Ensure Safe Autonomous Driving22 May 2023
- 2023Now You See Me: Robust approach to Partial Occlusions24 Apr 2023
- 2023BPJDet: Extended Object Representation for Generic Body-Part Joint Detection21 Apr 2023
- 2023VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervision6 Apr 2023
- 2023Self-similarity Driven Scale-invariant Learning for Weakly Supervised Person Search25 Feb 2023
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenes3 Feb 2023
- 2023DINF: Dynamic Instance Noise Filter for Occluded Pedestrian Detection13 Jan 2023
- 2022Mask Focal Loss: A unifying framework for dense crowd counting with canonical object detection networks22 Dec 2022
- 2022Body-Part Joint Detection and Association via Extended Object Representation15 Dec 2022
- 2022Feature Calibration Network for Occluded Pedestrian Detection12 Dec 2022
- 2022CircleNet: Reciprocating Feature Adaptation for Robust Pedestrian Detection12 Dec 2022
- 2022Improving Crowded Object Detection via Copy-Paste22 Nov 2022
- 2022TSAA: A Two-Stage Anchor Assignment Method towards Anchor Drift in Crowded Object Detection2 Nov 2022
- 2022UnfoldML: Cost-Aware and Uncertainty-Based Dynamic 2D Prediction for Multi-Stage Classification26 Oct 2022
- 2022Beta R-CNN: Looking into Pedestrian Detection from Another Perspective23 Oct 2022
- 2022Humans need not label more humans: Occlusion Copy & Paste for Occluded Human Instance Segmentation7 Oct 2022
- 2022Occlusion-Aware Instance Segmentation via BiLayer Network Architectures8 Aug 2022
- 2022KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D Correspondences21 Jun 2022
- 2022Deep Multi-Task Networks For Occluded Pedestrian Pose Estimation15 Jun 2022
- 2022An Objective Method for Pedestrian Occlusion Level Classification11 May 2022
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detection21 Apr 2022
- 2022Towards Domain Generalization in Object Detection27 Mar 2022
- 2022Progressive End-to-End Object Detection in Crowded Scenes15 Mar 2022
- 2022Deep Learning Serves Traffic Safety Analysis: A Forward-looking Review7 Mar 2022
- 2022Pedestrian Detection: Domain Generalization, CNNs, Transformers and Beyond10 Jan 2022
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detection4 Dec 2021
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenes29 Nov 2021
- 2021Pedestrian Detection by Exemplar-Guided Contrastive Learning17 Nov 2021
- 2021Occluded Video Instance Segmentation: Dataset and ICCV 2021 Challenge15 Nov 2021
- 2021BlockCopy: High-Resolution Video Processing with Block-Sparse Feature Propagation and Online Policies20 Aug 2021
- 2021Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)12 Aug 2021
- 2021Multi-Modal Pedestrian Detection with Large Misalignment Based on Modal-Wise Regression and Multi-Modal IoU23 Jul 2021
- 2021You Better Look Twice: a new perspective for designing accurate detectors with reduced computations21 Jul 2021
- 2021NMS-Loss: Learning with Non-Maximum Suppression for Crowded Pedestrian Detection4 Jun 2021
- 20212.5D Visual Relationship Detection26 Apr 2021
- 2021Variational Pedestrian Detection26 Apr 2021
50 newest of 58 All 58 (JSON)
- 2023MOSE: A New Dataset for Video Object Segmentation in Complex Scenescited by 232
- 2021Occluded Video Instance Segmentation: A Benchmarkcited by 154
- 2021Deep Occlusion-Aware Instance Segmentation with Overlapping BiLayerscited by 104
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenescited by 59
- 2021Behind the Curtain: Learning Occluded Shapes for 3D Object Detectioncited by 58
- 2021Multiview Detection with Shadow Transformer (and View-Coherent Data Augmentation)cited by 45
- 2021Human De-occlusion: Invisible Perception and Recovery for Humanscited by 31
- 2021Instance-wise Occlusion and Depth Orders in Natural Scenescited by 31
- 2022Progressive End-to-End Object Detection in Crowded Scenescited by 31
- 2022Weakly Aligned Feature Fusion for Multimodal Object Detectioncited by 26
- 2021Occlusion Handling in Generic Object Detection: A Reviewcited by 25
- 2023VLPD: Context-Aware Pedestrian Detection via Vision-Language Semantic Self-Supervisioncited by 19
12 most cited of 58 All 58 (JSON)
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026QCell: Recombining and Aligning Cell Queries for Overlapping Instance Segmentation29 Aug 2026
- 2026Towards Driver Behavior Understanding: Weakly-Supervised Risk Perception in Driving Scenes6 Mar 2026
- 2025SARMAE: Masked Autoencoder for SAR Representation Learning18 Dec 2025
- 2025MOSEv2: A More Challenging Dataset for Video Object Segmentation in Complex Scenes7 Aug 2025
- 2025Learning better representations for crowded pedestrians in offboard LiDAR-camera 3D tracking-by-detection21 May 2025
- 2025Density-based Object Detection in Crowded Scenes14 Apr 2025
- 2024Mean Height Aided Post-Processing for Pedestrian Detection24 Aug 2024
- 2024YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems25 Jul 2024
- 2024Crowd-SAM: SAM as a Smart Annotator for Object Detection in Crowded Scenes16 Jul 2024
- 2024Imagine the Unseen: Occluded Pedestrian Detection via Adversarial Feature Completion2 May 2024
- 2023Attribute Annotation and Bias Evaluation in Visual Datasets for Autonomous Driving11 Dec 2023
12 newest of 58 All 58 (JSON)