Sparse R-CNN: End-to-End Object Detection with Learnable Proposals
Not on the map. Why?
Abstract (arXiv)
We present Sparse R-CNN, a purely sparse method for object detection in images. Existing works on object detection heavily rely on dense object candidates, such as k anchor boxes pre-defined on all grids of image feature map of size H× W. In our method, however, a fixed sparse set of learned object proposals, total length of N, are provided to object recognition head to perform classification and location. By eliminating HWk (up to hundreds of thousands) hand-designed object candidates to N (e.g. 100) learnable proposals, Sparse R-CNN completely avoids all efforts related to object candidates design and many-to-one label assignment. More importantly, final predictions are directly output without non-maximum suppression post-procedure. Sparse R-CNN demonstrates accuracy, run-time and training convergence performance on par with the well-established detector baselines on the challenging COCO dataset, e.g., achieving 45.0 AP in standard 3× training schedule and running at 22 fps using ResNet-50 FPN model. We hope our work could inspire re-thinking the convention of dense prior in object detectors. The code is available at: https://github.com/PeizeSun/SparseR-CNN.
Key facts. Cited by 494 papers in the map (data through 7 Oct 2026). First posted on arXiv 25 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 62; 2022: 115; 2023: 135; 2024: 102; 2025: 55; 2026: 25.
494 papers.
Sort:
By area:
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
38 more
- 2022TransFusion: Robust LiDAR-Camera Fusion for 3D Object Detection with Transformerscited by 464
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2021Focal Self-attention for Local-Global Interactions in Vision Transformerscited by 286
- 2022Visual Attention Networkcited by 210
- 2021DetCo: Unsupervised Contrastive Learning for Object Detectioncited by 205
- 2023Universal Instance Perception as Object Discovery and Retrievalcited by 190
- 2022Focal Modulation Networkscited by 186
- 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 185
- 2022Language as Queries for Referring Video Object Segmentationcited by 180
- 2022Sparse4D: Multi-view 3D Object Detection with Sparse Spatial-Temporal Fusioncited by 161
- 2021Instances as Queriescited by 157
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2022More ConvNets in the 2020s: Scaling up Kernels Beyond 51x51 using Sparsitycited by 142
- 2021CrossFormer: A Versatile Vision Transformer Hinging on Cross-scale Attentioncited by 139
- 2021Visformer: The Vision-friendly Transformercited by 137
- 2021Efficient DETR: Improving End-to-End Object Detector with Dense Priorcited by 128
- 2021CycleMLP: A MLP-like Architecture for Dense Predictioncited by 126
- 2022Vision-Centric BEV Perception: A Surveycited by 126
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2021MPViT: Multi-Path Vision Transformer for Dense Predictioncited by 122
- 2022Towards Large-Scale Small Object Detection: Survey and Benchmarkscited by 119
- 2021A Survey of Visual Transformerscited by 117
- 2021Shuffle Transformer: Rethinking Spatial Shuffle for Vision Transformercited by 115
- 2022Global Tracking Transformerscited by 110
- 2021Beyond Self-attention: External Attention using Two Linear Layers for Visual Taskscited by 109
- 2021Efficient Training of Visual Transformers with Small Datasetscited by 107
- 2021Oriented RepPoints for Aerial Object Detectioncited by 102
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
- 2021AS-MLP: An Axial Shifted MLP Architecture for Visioncited by 101
- 2022CODA: A Real-World Road Corner Case Dataset for Object Detection in Autonomous Drivingcited by 100
- 2021SeqFormer: Sequential Transformer for Video Instance Segmentationcited by 98
- 2022Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignmentcited by 96
- 2022Learning Object-Language Alignments for Open-Vocabulary Object Detectioncited by 95
- 2022Towards Grand Unification of Object Trackingcited by 93
- 2021CAT: Cross Attention in Vision Transformercited by 92
- 2022MonoDETR: Depth-guided Transformer for Monocular 3D Object Detectioncited by 85
- 2022CLRNet: Cross Layer Refinement Network for Lane Detectioncited by 82
50 most cited of 494 All 494 (JSON)
- 2026PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery26 Sep 2026
- 2026Hyperbolic Geometry for Open-World Object Detection in Remote Sensing Imagery9 Sep 2026
- 2026Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection31 Aug 2026
- 2026RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection26 Aug 2026
- 2026SULAND v2: A Refined RGB Dataset and Deep Learning Object Detection Benchmark for UAV/UGV-Based SUrface LANDmine Detection Under Domain Shift31 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection27 Jun 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation13 Jun 2026
- 2026A Turbo-Inference Strategy for Object Detection and Instance Segmentation10 Jun 2026
- 2026Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs4 Jun 2026
- 2026UniISP: A Unified ISP Framework for Both Human and Machine Vision8 May 2026
38 more
- 2026Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization29 Apr 2026
- 2026Caries DETR: Tooth Structure-aware Prior and Lesion-aware Dynamic Loss Refinement for DETR Based Caries Detection26 Apr 2026
- 2026Detecting Unknown Objects via Energy-based Separation for Open World Object Detection31 Mar 2026
- 2026SparseVoxelDet: Fully Sparse Voxel Networks for Efficient Event-Based Drone Detection23 Mar 2026
- 2026VSD-MOT: End-to-End Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Distillation21 Mar 2026
- 2026Exemplar Diffusion: Improving Medical Object Detection with Opportunistic Labels16 Mar 2026
- 2026Real-Time Glottis Detection Framework via Spatial-decoupled Feature Learning for Nasal Transnasal Intubation8 Mar 2026
- 2026Explore Intrinsic Geometry for Query-based Tiny and Oriented Object Detector with Momentum-based Bipartite Matching14 Feb 2026
- 2026SPOT-Occ: Sparse Prototype-guided Transformer for Camera-based 3D Occupancy Prediction4 Feb 2026
- 2026Adaptive 1D Video Diffusion Autoencoder4 Feb 2026
- 2026Learning Sparse Visual Representations via Spatial-Semantic Factorization2 Feb 2026
- 2026Disentangle Object and Non-object Infrared Features via Language Guidance14 Jan 2026
- 2026GenDet: Painting Colored Bounding Boxes on Images via Diffusion Model for Object Detection12 Jan 2026
- 2025DeFloMat: Detection with Flow Matching for Stable and Efficient Generative Object Localization26 Dec 2025
- 2025FlowDet: Unifying Object Detection and Generative Transport Flows18 Dec 2025
- 2025LeAD-M3D: Leveraging Asymmetric Distillation for Real-Time Monocular 3D Detection5 Dec 2025
- 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagery1 Dec 2025
- 2025Uni-Hema: Unified Model for Digital Hematopathology17 Nov 2025
- 2025From 2D to 3D Without Extra Baggage: Data-Efficient Cancer Detection in Digital Breast Tomosynthesis13 Nov 2025
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery26 Oct 2025
- 2025DiffusionLane: Diffusion Model for Lane Detection25 Oct 2025
- 2025Dynamic Semantic-Aware Correlation Modeling for UAV Tracking24 Oct 2025
- 2025Align Your Query: Representation Alignment for Multimodality Medical Object Detection3 Oct 2025
- 2025From Camera-Based Sensing to Reasoning: A Comprehensive Review Toward Proactive Vulnerable Road User Safety30 Sep 2025
- 2025Visual Instruction Pretraining for Domain-Specific Foundation Models22 Sep 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025Dark-ISP: Enhancing RAW Image Processing for Low-Light Object Detection11 Sep 2025
- 2025TriLiteNet: Lightweight Model for Multi-Task Visual Perception4 Sep 2025
- 2025An End-to-End Framework for Video Multi-Person Pose Estimation1 Sep 2025
- 2025C-DiffDet+: Fusing Global Scene Context with Generative Denoising for High-Fidelity Car Damage Detection30 Aug 2025
- 2025Image Quality Assessment for Machines: Paradigm, Large-scale Database, and Models27 Aug 2025
- 2025Clustering-based Feature Representation Learning for Oracle Bone Inscriptions Detection26 Aug 2025
- 2025High-Precision Mixed Feature Fusion Network Using Hypergraph Computation for Cervical Abnormal Cell Detection22 Aug 2025
- 2025FastTracker: Real-Time and Accurate Visual Tracking20 Aug 2025
- 2025Real-Time Beach Litter Detection and Counting: A Comparative Analysis of RT-DETR Model Variants18 Aug 2025
- 2025AVPDN: Learning Motion-Robust and Scale-Adaptive Representations for Video-Based Polyp Detection5 Aug 2025
- 2025Benchmarking Deep Learning-Based Object Detection Models on Feature Deficient Astrophotography Imagery Dataset4 Aug 2025
- 2025Spatial-Frequency Aware for Object Detection in RAW Image2 Aug 2025
50 newest of 494 All 494 (JSON)
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2023ArSDM: Colonoscopy Images Synthesis with Adaptive Refinement Semantic Diffusion Modelscited by 31
- 2023DiffTAD: Temporal Action Detection with Proposal Denoising Diffusioncited by 19
- 2023Diffusion-based 3D Object Detection with Random Boxescited by 5
- 2024CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generationcited by 5
- 20233DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusioncited by 4
- 2026Adaptive 1D Video Diffusion Autoencodercited by 3
- 2023DiffusionVMR: Diffusion Model for Joint Video Moment Retrieval and Highlight Detectioncited by 2
- 2023PSDiff: Diffusion Model for Person Search with Iterative and Collaborative Refinementcited by 2
- 2023DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detectioncited by 2
- 2024ConsistencyDet: A Few-step Denoising Framework for Object Detection Using the Consistency Modelcited by 1
- 2025FlowDet: Unifying Object Detection and Generative Transport Flowscited by 1
12 most cited of 16 All 16 (JSON)
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Adaptive 1D Video Diffusion Autoencoder4 Feb 2026
- 2026GenDet: Painting Colored Bounding Boxes on Images via Diffusion Model for Object Detection12 Jan 2026
- 2025DeFloMat: Detection with Flow Matching for Stable and Efficient Generative Object Localization26 Dec 2025
- 2025FlowDet: Unifying Object Detection and Generative Transport Flows18 Dec 2025
- 2025DiffusionLane: Diffusion Model for Lane Detection25 Oct 2025
- 2024CycleHOI: Improving Human-Object Interaction Detection with Cycle Consistency of Detection and Generation16 Jul 2024
- 2024ConsistencyDet: A Few-step Denoising Framework for Object Detection Using the Consistency Model11 Apr 2024
- 20233DifFusionDet: Diffusion Model for 3D Object Detection with Robust LiDAR-Camera Fusion7 Nov 2023
- 2023DiffRef3D: A Diffusion-based Proposal Refinement Framework for 3D Object Detection25 Oct 2023
- 2023PSDiff: Diffusion Model for Person Search with Iterative and Collaborative Refinement20 Sep 2023
- 2023Diffusion-based 3D Object Detection with Random Boxes5 Sep 2023
12 newest of 16 All 16 (JSON)
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLMcited by 45
- 2023GridCLIP: One-Stage Object Detection by Grid-Level CLIP Representation Learningcited by 15
- 2025VLM-C4L: Continual Core Dataset Learning with Corner Case Optimization via Vision-Language Models for Autonomous Drivingcited by 4
- 2025Modulating CNN Features with Pre-Trained ViT Representations for Open-Vocabulary Object Detectioncited by 0
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancementcited by 0
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 0
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery26 Oct 2025
- 2025VSE-MOT: Multi-Object Tracking in Low-Quality Video Scenes Guided by Visual Semantic Enhancement17 Sep 2025
- 2025VLM-C4L: Continual Core Dataset Learning with Corner Case Optimization via Vision-Language Models for Autonomous Driving29 Mar 2025
- 2025Modulating CNN Features with Pre-Trained ViT Representations for Open-Vocabulary Object Detection28 Jan 2025
- 2024DetToolChain: A New Prompting Paradigm to Unleash Detection Ability of MLLM19 Mar 2024
- 2023GridCLIP: One-Stage Object Detection by Grid-Level CLIP Representation Learning16 Mar 2023
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2021Pyramid Vision Transformer: A Versatile Backbone for Dense Prediction without Convolutionscited by 1,960
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2022YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectorscited by 978
- 2021ByteTrack: Multi-Object Tracking by Associating Every Detection Boxcited by 812
- 2021PVT v2: Improved Baselines with Pyramid Vision Transformercited by 749
- 2021DETR3D: 3D Object Detection from Multi-view Images via 3D-to-2D Queriescited by 655
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2022Vision Transformer Adapter for Dense Predictionscited by 564
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
12 most cited of 466 All 466 (JSON)
- 2026PolyTopoBench: A Benchmark for Complex Vector Polygon Generation from Remote Sensing Imagery26 Sep 2026
- 2026Hyperbolic Geometry for Open-World Object Detection in Remote Sensing Imagery9 Sep 2026
- 2026Real-Time Scene-Adaptive Tone Mapping for High-Dynamic Range Object Detection31 Aug 2026
- 2026RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection26 Aug 2026
- 2026SULAND v2: A Refined RGB Dataset and Deep Learning Object Detection Benchmark for UAV/UGV-Based SUrface LANDmine Detection Under Domain Shift31 Jul 2026
- 2026LOGOS: Language-guided Oriented Object Detection in Aerial Scenes9 Jul 2026
- 2026Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection27 Jun 2026
- 2026Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation13 Jun 2026
- 2026A Turbo-Inference Strategy for Object Detection and Instance Segmentation10 Jun 2026
- 2026Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs4 Jun 2026
- 2026UniISP: A Unified ISP Framework for Both Human and Machine Vision8 May 2026
- 2026Bridge: Basis-Driven Causal Inference Marries VFMs for Domain Generalization29 Apr 2026
12 newest of 466 All 466 (JSON)