Group DETR v2: Strong Object Detector with Encoder-Decoder Pretraining
Not on the map. Why?
Abstract (arXiv)
We present a strong object detector with encoder-decoder pretraining and finetuning. Our method, called Group DETR v2, is built upon a vision transformer encoder ViT-Huge~citedosovitskiy2020image, a DETR variant DINO~citezhang2022dino, and an efficient DETR training method Group DETR~citechen2022group. The training process consists of self-supervised pretraining and finetuning a ViT-Huge encoder on ImageNet-1K, pretraining the detector on Object365, and finally finetuning it on COCO. Group DETR v2 achieves 64.5 mAP on COCO test-dev, and establishes a new SoTA on the COCO leaderboard https://paperswithcode.com/sota/object-detection-on-coco
Key facts. Cited by 25 papers in the map (data through 7 Oct 2026). Builds on 26 of its 31 references that are in the map. First posted on arXiv 7 Nov 2022.
Builds on
26 of 31 references.
References · 26
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2021BEiT: BERT Pre-Training of Image Transformerscited by 2,360
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2021Swin Transformer V2: Scaling Up Capacity and Resolutioncited by 1,215
- 2021SimMIM: A Simple Framework for Masked Image Modelingcited by 1,147
- 2021Grounded Language-Image Pre-trainingcited by 1,147
- 2021Scaling Vision Transformerscited by 993
14 more
- 2022Exploring Plain Vision Transformer Backbones for Object Detectioncited by 723
- 2021ImageNet-21K Pretraining for the Massescited by 607
- 2022DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETRcited by 569
- 2022Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Taskscited by 510
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2021End-to-End Semi-Supervised Object Detection with Soft Teachercited by 315
- 2022BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizerscited by 298
- 2022Context Autoencoder for Self-Supervised Representation Learningcited by 297
- 2022GLIPv2: Unifying Localization and Vision-Language Understandingcited by 275
- 2022Focal Modulation Networkscited by 186
- 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 185
- 2022Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignmentcited by 96
- 2022Contrastive Learning Rivals Masked Image Modeling in Fine-tuning via Feature Distillationcited by 93
Built on by
Citing papers per year: 2022: 4; 2023: 16; 2024: 4; 2025: 0; 2026: 1.
25 papers.
Sort:
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinementcited by 73
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detectioncited by 36
- 2024MS-DETR: Efficient DETR Training with Mixed Supervisioncited by 34
- 2022Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Informationcited by 31
- 2023Uni3DETR: Unified 3D Detection Transformercited by 26
- 2023Uncovering and Quantifying Social Biases in Code Generationcited by 25
- 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24
13 more
- 2022D3ETR: Decoder Distillation for Detection Transformercited by 17
- 2023Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Artcited by 15
- 2023S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking with Adaptive Spatio-Temporal Appearance Representationscited by 12
- 2023A Strong and Reproducible Object Detector with Only Public Datasetscited by 8
- 2023detrex: Benchmarking Detection Transformerscited by 8
- 2023Language-aware Multiple Datasets Detection Pretraining for DETRscited by 5
- 2023Uncovering and Categorizing Social Biases in Text-to-SQLcited by 5
- 2023Revisiting DETR Pre-training for Object Detectioncited by 5
- 2023DETR Doesn't Need Multi-Scale or Locality Designcited by 4
- 2023Real-time 3D Semantic Scene Completion Via Feature Aggregation and Conditioned Predictioncited by 3
- 2023Enhancing Your Trained DETRs with Box Refinementcited by 2
- 2026Don't let the information slip awaycited by 2
- 2024PK-YOLO: Pretrained Knowledge Guided YOLO for Brain Tumor Detection in Multiplanar MRI Slicescited by 1
- 2026Don't let the information slip away26 Feb 2026
- 2024PK-YOLO: Pretrained Knowledge Guided YOLO for Brain Tumor Detection in Multiplanar MRI Slices29 Oct 2024
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinement17 Oct 2024
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection5 Jun 2024
- 2024MS-DETR: Efficient DETR Training with Mixed Supervision8 Jan 2024
- 2023Uni3DETR: Unified 3D Detection Transformer9 Oct 2023
- 2023Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Art10 Sep 2023
- 2023DETR Doesn't Need Multi-Scale or Locality Design3 Aug 2023
- 2023Revisiting DETR Pre-training for Object Detection2 Aug 2023
- 2023Enhancing Your Trained DETRs with Box Refinement21 Jul 2023
- 2023S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking with Adaptive Spatio-Temporal Appearance Representations30 Jun 2023
- 2023detrex: Benchmarking Detection Transformers12 Jun 2023
13 more
- 2023Uncovering and Categorizing Social Biases in Text-to-SQL25 May 2023
- 2023Interactive Segment Anything NeRF with Feature Imitation25 May 2023
- 2023Uncovering and Quantifying Social Biases in Code Generation24 May 2023
- 2023A Strong and Reproducible Object Detector with Only Public Datasets25 Apr 2023
- 2023DETRs Beat YOLOs on Real-time Object Detection17 Apr 2023
- 2023Language-aware Multiple Datasets Detection Pretraining for DETRs7 Apr 2023
- 2023EVA-02: A Visual Representation for Neon Genesis20 Mar 2023
- 2023Real-time 3D Semantic Scene Completion Via Feature Aggregation and Conditioned Prediction20 Mar 2023
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detection3 Jan 2023
- 2022DETRs with Collaborative Hybrid Assignments Training22 Nov 2022
- 2022Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Information17 Nov 2022
- 2022D3ETR: Decoder Distillation for Detection Transformer17 Nov 2022
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scale14 Nov 2022
- 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2023EVA-02: A Visual Representation for Neon Genesiscited by 377
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinementcited by 73
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detectioncited by 36
- 2024MS-DETR: Efficient DETR Training with Mixed Supervisioncited by 34
- 2022Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Informationcited by 31
- 2023Uni3DETR: Unified 3D Detection Transformercited by 26
- 2023Uncovering and Quantifying Social Biases in Code Generationcited by 25
- 2023Interactive Segment Anything NeRF with Feature Imitationcited by 24
12 most cited of 25 All 25 (JSON)
- 2026Don't let the information slip away26 Feb 2026
- 2024PK-YOLO: Pretrained Knowledge Guided YOLO for Brain Tumor Detection in Multiplanar MRI Slices29 Oct 2024
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinement17 Oct 2024
- 2024LW-DETR: A Transformer Replacement to YOLO for Real-Time Detection5 Jun 2024
- 2024MS-DETR: Efficient DETR Training with Mixed Supervision8 Jan 2024
- 2023Uni3DETR: Unified 3D Detection Transformer9 Oct 2023
- 2023Transformers in Small Object Detection: A Benchmark and Survey of State-of-the-Art10 Sep 2023
- 2023DETR Doesn't Need Multi-Scale or Locality Design3 Aug 2023
- 2023Revisiting DETR Pre-training for Object Detection2 Aug 2023
- 2023Enhancing Your Trained DETRs with Box Refinement21 Jul 2023
- 2023S.T.A.R.-Track: Latent Motion Models for End-to-End 3D Object Tracking with Adaptive Spatio-Temporal Appearance Representations30 Jun 2023
- 2023detrex: Benchmarking Detection Transformers12 Jun 2023
12 newest of 25 All 25 (JSON)