DAB-DETR: Dynamic Anchor Boxes are Better Queries for DETR
Not on the map. Why?
Abstract (arXiv)
We present in this paper a novel query formulation using dynamic anchor boxes for DETR (DEtection TRansformer) and offer a deeper understanding of the role of queries in DETR. This new formulation directly uses box coordinates as queries in Transformer decoders and dynamically updates them layer-by-layer. Using box coordinates not only helps using explicit positional priors to improve the query-to-feature similarity and eliminate the slow training convergence issue in DETR, but also allows us to modulate the positional attention map using the box width and height information. Such a design makes it clear that queries in DETR can be implemented as performing soft ROI pooling layer-by-layer in a cascade manner. As a result, it leads to the best performance on MS-COCO benchmark among the DETR-like detection models under the same setting, e.g., AP 45.7% using ResNet50-DC5 as backbone trained in 50 epochs. We also conducted extensive experiments to confirm our analysis and verify the effectiveness of our methods. Code is available at urlhttps://github.com/SlongLiu/DAB-DETR.
Key facts. Cited by 569 papers in the map (data through 7 Oct 2026). Builds on 20 of its 24 references that are in the map. First posted on arXiv 28 Jan 2022.
Builds on
20 of 24 references.
References · 20
- 2017Attention Is All You Needcited by 59,932
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Microsoft COCO: Common Objects in Contextcited by 17,498
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2020End-to-End Object Detection with Transformerscited by 7,384
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,829
- 2015Delving Deep into Rectifiers: Surpassing Human-Level Performance on ImageNet Classificationcited by 3,590
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
- 2015Fast R-CNNcited by 2,930
- 2020YOLOv4: Optimal Speed and Accuracy of Object Detectioncited by 1,624
- 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
- 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,361
8 more
- 2019Objects as Pointscited by 1,172
- 2021YOLOX: Exceeding YOLO Series in 2021cited by 1,064
- 2017Focal Loss for Dense Object Detectioncited by 749
- 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
- 2021Conditional DETR for Fast Training Convergencecited by 422
- 2021Fast Convergence of DETR with Spatially Modulated Co-Attentioncited by 176
- 2020Rethinking Transformer-based Set Prediction for Object Detectioncited by 156
- 2021Efficient DETR: Improving End-to-End Object Detector with Dense Priorcited by 128
Built on by
Citing papers per year: 2022: 64; 2023: 149; 2024: 167; 2025: 115; 2026: 74.
569 papers.
Sort:
By area:
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
38 more
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 267
- 2022Visual Attention Networkcited by 210
- 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 197
- 2023MapTRv2: An End-to-End Framework for Online Vectorized HD Map Constructioncited by 192
- 2023Query-Dependent Video Representation for Moment Retrieval and Highlight Detectioncited by 166
- 2022DETRs with Hybrid Matchingcited by 149
- 2023SparseBEV: High-Performance Sparse 3D Object Detection from Multi-Camera Videoscited by 149
- 2022MOTRv2: Bootstrapping End-to-End Multi-Object Tracking by Pretrained Object Detectorscited by 148
- 2023MTR++: Multi-Agent Motion Prediction with Symmetric Scene Modeling and Guided Intention Queryingcited by 139
- 2023CORA: Adapting CLIP for Open-Vocabulary Detection with Region Prompting and Anchor Pre-Matchingcited by 133
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 125
- 2023Transformer-Based Visual Segmentation: A Surveycited by 124
- 2022Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipecited by 122
- 2024GaussCtrl: Multi-View Consistent Text-Driven 3D Gaussian Splatting Editingcited by 114
- 2022ConvMAE: Masked Convolution Meets Masked Autoencoderscited by 105
- 2022CenterFormer: Center-based Transformer for 3D Object Detectioncited by 99
- 2022Group DETR: Fast DETR Training with Group-Wise One-to-Many Assignmentcited by 96
- 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
- 2023MeMOTR: Long-Term Memory-Augmented Transformer for Multi-Object Trackingcited by 86
- 2023Knowing Where to Focus: Event-aware Transformer for Video Groundingcited by 79
- 2023Dense Distinct Query for End-to-End Object Detectioncited by 76
- 2022DeepSolo: Let Transformer Decoder with Explicit Points Solo for Text Spottingcited by 74
- 2024D-FINE: Redefine Regression Task in DETRs as Fine-grained Distribution Refinementcited by 73
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 70
- 2023Sparse4D v3: Advancing End-to-End 3D Detection and Trackingcited by 69
- 2023Cross Modal Transformer: Towards Fast and Robust 3D Object Detectioncited by 68
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
- 2024DEIM: DETR with Improved Matching for Fast Convergencecited by 67
- 2023SPTS v2: Single-Point Scene Text Spottingcited by 66
- 2025Detect Anything via Next Point Predictioncited by 66
- 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 59
- 2024TR-DETR: Task-Reciprocal Transformer for Joint Moment Retrieval and Highlight Detectioncited by 59
- 2024Multiple Object Tracking as ID Predictioncited by 58
- 2023Exploring Predicate Visual Context in Detecting Human-Object Interactionscited by 56
- 2024OPUS: Occupancy Prediction Using a Sparse Setcited by 56
- 2022AO2-DETR: Arbitrary-Oriented Object Detection Transformercited by 55
- 2022RLIP: Relational Language-Image Pre-training for Human-Object Interaction Detectioncited by 54
50 most cited of 569 All 569 (JSON)
- 2026ASPIRE: Saddle-Point Discovery through Set Prediction and Physical Refinement7 Oct 2026
- 2026S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Driving24 Sep 2026
- 2026HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection20 Sep 2026
- 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement17 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026End-to-End Cell Detection via Instance-aware Graph Modeling14 Sep 2026
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026Reading Decoder Trajectories: Training-Free Counterfactual Query-Trajectory Reliability for Small-Object Detection6 Sep 2026
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Hyper-Fold: Exploring the Expressive Limit of Sequence-Geometry Learning for Proteins via Hypergraph Modeling29 Aug 2026
- 2026OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels29 Aug 2026
- 2026RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection26 Aug 2026
38 more
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
- 2026TinyDETR-Pose: Towards End-to-End Real-Time Single-Stage 6DoF Object Pose Estimation with Lightweight Transformers15 Aug 2026
- 2026LocusGS: Spatially Grounded Tokens for Feed-Forward 3D Gaussian Splatting13 Aug 2026
- 2026Match One, Learn with Graph: One-to-Graph Query Collaboration with Backward Sharing for Object Detection6 Aug 2026
- 2026FUSEP: A Multi-Center Benchmark for Diverse Tasks in Early Pregnancy Fetal Ultrasound Screening5 Aug 2026
- 2026DyFrDet: Towards Accurate Small Object Detection via Dynamic Frequency Suppression with Label Disambiguation3 Aug 2026
- 2026Queries Knew More Than We Thought: Uncovering Latent Knowledge in Segmentation Models30 Jul 2026
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding27 Jul 2026
- 2026DETRAM: End-to-end DEtection, Tracking and Recovery of HumAn Meshes10 Jul 2026
- 2026Revisiting Scene Graph Generation from the Perspective of Detector-Conditioned Reachability7 Jul 2026
- 2026Real-Time Source-Free Object Detection30 Jun 2026
- 2026MatMMExtract: An Open-Source Pipeline for Panel-Level Extraction of Grounded Image-Text Pairs from Materials Science Literature29 Jun 2026
- 2026CellDETR: A Detection-Guided Framework for Scalable Cell Representation Learning from Histopathology Images28 Jun 2026
- 2026Adaptive Spectrum-Aware Feature Disentangled Network for Small Object Detection27 Jun 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Multi-view feature High-order Fusion for Space Weak Object Detection and Segmentation13 Jun 2026
- 2026Gaussian Spatial Priors for Anatomy-Aware Object Detection in Surgical Videos13 Jun 2026
- 2026Multi-HMR 2: Multi-Person Camera-Centric Human Detection, Mesh Recovery and Tracking12 Jun 2026
- 2026FEMOT: Multi-Object Tracking using Frame and Event Cameras12 Jun 2026
- 2026Context-Guided Semantic Alignment for Feature Fusion Networks12 Jun 2026
- 2026A Turbo-Inference Strategy for Object Detection and Instance Segmentation10 Jun 2026
- 2026GNSS-FM: A Self-Supervised Foundation Model for Daily GNSS Displacement Time Series5 Jun 2026
- 2026End-to-End Text Line Detection and Ordering2 Jun 2026
- 2026Ultralytics YOLO26: Unified Real-Time End-to-End Vision Models2 Jun 2026
- 2026FDDet: Achieving Data-Efficient Food Defect Detection Under Real-World Scenarios23 May 2026
- 2026MDS-DETR: DETR with Masked Duplicate Suppressor22 May 2026
- 2026LangFlash: Feed-forward 3D Language Gaussian Splatting from Sparse Unposed Images22 May 2026
- 2026SToRe3D: Sparse Token Relevance in ViTs for Efficient Multi-View 3D Object Detection13 May 2026
- 2026Set Prediction for Next-Day Active Fire Forecasting11 May 2026
- 2026AnyDepth-DETR/-YOLO: Any-depth object detection with a single network10 May 2026
- 2026UniPCB: A Generation-Assisted Vision-Based Measurement Framework for PCB Defect Inspection6 May 2026
- 2026InterMesh: Explicit Interaction-Aware End-to-End Multi-Person Human Mesh Recovery6 May 2026
- 2026SimPB++: Simultaneously Detecting 2D and 3D Objects from Multiple Cameras3 May 2026
- 2026A Real-time Scale-robust Network for Glottis Segmentation in Nasal Transnasal Intubation30 Apr 2026
- 2026Caries DETR: Tooth Structure-aware Prior and Lesion-aware Dynamic Loss Refinement for DETR Based Caries Detection26 Apr 2026
- 2026UHR-DETR: Efficient End-to-End Small Object Detection for Ultra-High-Resolution Remote Sensing Imagery23 Apr 2026
- 2026Radar-Camera BEV Multi-Task Learning with Cross-Task Attention Bridge for Joint 3D Detection and Segmentation14 Apr 2026
- 2026WUTDet: A 100K-Scale Ship Detection Dataset and Benchmarks with Dense Small Objects9 Apr 2026
50 newest of 569 All 569 (JSON)
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
- 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referringcited by 29
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Modelcited by 23
- 2024Textual Query-Driven Mask Transformer for Domain Generalized Segmentationcited by 20
- 2025Open-PMC-18M: A High-Fidelity Large Scale Medical Dataset for Multimodal Representation Learningcited by 9
- 2023Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisorcited by 4
- 2024Griffon-G: Bridging Vision-Language and Vision-Centric Tasks via Large Multimodal Modelscited by 3
- 2025Knowledge Transfer from Interaction Learningcited by 2
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Modelscited by 1
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 0
- 2026PhenoLIP: Integrating Phenotype Ontology Knowledge into Medical Vision-Language Pretrainingcited by 0
- 2026PhenoLIP: Integrating Phenotype Ontology Knowledge into Medical Vision-Language Pretraining5 Feb 2026
- 2025Forging a Dynamic Memory: Retrieval-Guided Continual Learning for Generalist Medical Foundation Models15 Dec 2025
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery26 Oct 2025
- 2025Knowledge Transfer from Interaction Learning23 Sep 2025
- 2025Open-PMC-18M: A High-Fidelity Large Scale Medical Dataset for Multimodal Representation Learning3 Jun 2025
- 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learning23 Mar 2025
- 2024Griffon-G: Bridging Vision-Language and Vision-Centric Tasks via Large Multimodal Models21 Oct 2024
- 2024Textual Query-Driven Mask Transformer for Domain Generalized Segmentation12 Jul 2024
- 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referring14 Mar 2024
- 2024VLM-PL: Advanced Pseudo Labeling Approach for Class Incremental Object Detection via Vision-Language Model8 Mar 2024
- 2023Focusing on what to decode and what to train: SOV Decoding with Specific Target Guided DeNoising and Vision Language Advisor5 Jul 2023
- 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
- 2024InstaGen: Enhancing Object Detection by Training on Synthetic Datasetcited by 26
- 2023DiffTAD: Temporal Action Detection with Proposal Denoising Diffusioncited by 19
- 2022Exploring Vision Transformers as Diffusion Learnerscited by 10
- 2023DiffSED: Sound Event Detection with Denoising Diffusioncited by 4
- 2025FlowDet: Unifying Object Detection and Generative Transport Flowscited by 1
- 2026Modular Diffusion Models for Structured Visual Recognitioncited by 0
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2025FlowDet: Unifying Object Detection and Generative Transport Flows18 Dec 2025
- 2024InstaGen: Enhancing Object Detection by Training on Synthetic Dataset8 Feb 2024
- 2023DiffSED: Sound Event Detection with Denoising Diffusion14 Aug 2023
- 2023DiffTAD: Temporal Action Detection with Proposal Denoising Diffusion27 Mar 2023
- 2022Exploring Vision Transformers as Diffusion Learners28 Dec 2022
- 2022DiffusionDet: Diffusion Model for Object Detection17 Nov 2022
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Drivingcited by 125
- 2025GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Drivingcited by 16
- 2026DriveMamba: Task-Centric Scalable State Space Model for Efficient End-to-End Autonomous Drivingcited by 9
- 2025InstanceBEV: Unifying Instance and BEV Representation for 3D Panoptic Segmentationcited by 0
- 2026S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Drivingcited by 0
- 2026S2Planner: Multi-Scale Semantic Planner for End-to-End Autonomous Driving24 Sep 2026
- 2026DriveMamba: Task-Centric Scalable State Space Model for Efficient End-to-End Autonomous Driving9 Feb 2026
- 2025GaussianFusion: Gaussian-Based Multi-Sensor Fusion for End-to-End Autonomous Driving27 May 2025
- 2025InstanceBEV: Unifying Instance and BEV Representation for 3D Panoptic Segmentation20 May 2025
- 2025DriveTransformer: Unified Transformer for Scalable End-to-End Autonomous Driving7 Mar 2025
- 2024Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Datasetcited by 25
- 2023DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasetscited by 23
- 2024Mr. DETR++: Instructive Multi-Route Training for Detection Transformers with Mixture-of-Expertscited by 1
- 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagerycited by 1
- 2025Exploring Speaker Diarization with Mixture of Expertscited by 0
- 2025Bridging the Scale Gap: Balanced Tiny and General Object Detection in Remote Sensing Imagery1 Dec 2025
- 2025Exploring Speaker Diarization with Mixture of Experts17 Jun 2025
- 2024Mr. DETR++: Instructive Multi-Route Training for Detection Transformers with Mixture-of-Experts13 Dec 2024
- 2024Object Detection using Event Camera: A MoE Heat Conduction based Detector and A New Benchmark Dataset9 Dec 2024
- 2023DAMEX: Dataset-aware Mixture-of-Experts for visual understanding of mixture-of-datasets8 Nov 2023
- 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoningcited by 6
- 2025DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Modelscited by 5
- 2025From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoningcited by 3
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Groundingcited by 0
- 2026Mixture-of-Thought-Tokens: Unifying Perception and Reasoning for Free-form Multimodal Grounding27 Jul 2026
- 2025Bridging the Gap in Ophthalmic AI: MM-Retinal-Reason Dataset and OphthaReason Model toward Dynamic Multimodal Reasoning22 Aug 2025
- 2025DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Models29 May 2025
- 2025From Objects to Events: Unlocking Complex Visual Understanding in Object Detectors via LLM-guided Symbolic Reasoning9 Feb 2025
- 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,274
- 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
- 2022PETR: Position Embedding Transformation for Multi-View 3D Object Detectioncited by 550
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2024YOLOv10: Real-Time End-to-End Object Detectioncited by 508
- 2022DN-DETR: Accelerate DETR Training by Introducing Query DeNoisingcited by 486
- 2022PETRv2: A Unified Framework for 3D Perception from Multi-Camera Imagescited by 351
- 2022Mask DINO: Towards A Unified Transformer-based Framework for Object Detection and Segmentationcited by 341
- 2022OneFormer: One Transformer to Rule Universal Image Segmentationcited by 327
- 2025YOLOv12: Attention-Centric Real-Time Object Detectorscited by 300
- 2022DETRs with Collaborative Hybrid Assignments Trainingcited by 273
- 2022Visual Attention Networkcited by 210
12 most cited of 532 All 532 (JSON)
- 2026ASPIRE: Saddle-Point Discovery through Set Prediction and Physical Refinement7 Oct 2026
- 2026HOIBlender: Blending Lightweight Detection with Vision-Language Priors for Efficient Human-Object Interaction Detection20 Sep 2026
- 2026Enhanced Knowledge Distillation for Detection Transformer via Teacher Prediction Refinement17 Sep 2026
- 2026Beyond the Survey: A Systematic Empirical Study of Detection and Association in Visual MOT14 Sep 2026
- 2026End-to-End Cell Detection via Instance-aware Graph Modeling14 Sep 2026
- 2026Contour-Guided Spectral Routing for Robust Real-Time Pedestrian Detection13 Sep 2026
- 2026Reading Decoder Trajectories: Training-Free Counterfactual Query-Trajectory Reliability for Small-Object Detection6 Sep 2026
- 2026Physical Adversarial Examples for Person Detectors in Thermal Images Based on 3D Modeling31 Aug 2026
- 2026Hyper-Fold: Exploring the Expressive Limit of Sequence-Geometry Learning for Proteins via Hypergraph Modeling29 Aug 2026
- 2026OPUS-V2: Bridging the Gap between Sparse Points and Dense Voxels29 Aug 2026
- 2026RSFusionDet: Underwater RGB-Sonar Multimodal Object Detection26 Aug 2026
- 2026Probing Association Instability with Track-State Perturbations for Clip-Level Active Learning in Query-Propagation Multi-Object Tracking18 Aug 2026
12 newest of 532 All 532 (JSON)