mlsanityData to 14 Oct 2026

An Open and Comprehensive Pipeline for Unified Object Grounding and Detection

arXiv 2401.02361 ↗First posted 4 Jan 2024cs.CVcited by 65

Not on the map. Why?

Abstract (arXiv)

Grounding-DINO is a state-of-the-art open-set detection model that tackles multiple vision tasks including Open-Vocabulary Detection (OVD), Phrase Grounding (PG), and Referring Expression Comprehension (REC). Its effectiveness has led to its widespread adoption as a mainstream architecture for various downstream applications. However, despite its significance, the original Grounding-DINO model lacks comprehensive public technical details due to the unavailability of its training code. To bridge this gap, we present MM-Grounding-DINO, an open-source, comprehensive, and user-friendly baseline, which is built with the MMDetection toolbox. It adopts abundant vision datasets for pre-training and various detection and grounding datasets for fine-tuning. We give a comprehensive analysis of each reported result and detailed settings for reproduction. The extensive experiments on the benchmarks mentioned demonstrate that our MM-Grounding-DINO-Tiny outperforms the Grounding-DINO-Tiny baseline. We release all our models to the research community. Codes and trained models are released at https://github.com/open-mmlab/mmdetection/tree/main/configs/mm_grounding_dino.

Key facts. Cited by 65 papers in the map (data through 14 Oct 2026). Builds on 13 of its 27 references that are in the map. First posted on arXiv 4 Jan 2024.

Builds on

13 of 27 references.

References · 13

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2020End-to-End Object Detection with Transformerscited by 7,414
  3. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  4. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,385
  5. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  6. 2015Flickr30k Entities: Collecting Region-to-Phrase Correspondences for Richer Image-to-Sentence Modelscited by 1,362
  7. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  8. 2023Kosmos-2: Grounding Multimodal Large Language Models to the Worldcited by 1,089
  9. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  10. 2023Towards Open Vocabulary Learning: A Surveycited by 166
  11. 2022ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Modelscited by 141
  12. 2023Described Object Detection: Liberating Object Detection with Flexible Expressionscited by 40
1 more
  1. 2023Cascade-DETR: Delving into High-Quality Universal Object Detectioncited by 19

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2024: 16; 2025: 25; 2026: 24.

65 papers.

Sort:

By area:

  1. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domaincited by 184
  2. 2024Multimodal Autoregressive Pre-training of Large Vision Encoderscited by 109
  3. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 89
  4. 2025LLMDet: Learning Strong Open-Vocabulary Object Detectors under the Supervision of Large Language Modelscited by 57
  5. 2025OmniAlign-V: Towards Enhanced Alignment of MLLMs with Human Preferencecited by 28
  6. 2024Learning Visual Grounding from Generative Vision and Language Modelcited by 27
  7. 2025DynamicEarth: How Far are We from Open-Vocabulary Change Detection?cited by 21
  8. 2024FineCops-Ref: A new Dataset and Task for Fine-Grained Compositional Referring Expression Comprehensioncited by 20
  9. 20243D-GRES: Generalized 3D Referring Expression Segmentationcited by 18
  10. 2024MMRo: Are Multimodal LLMs Eligible as the Brain for In-Home Robotics?cited by 15
  11. 2024Popeye: A Unified Visual-Language Model for Multi-Source Ship Detection from Remote Sensing Imagerycited by 14
  12. 2025WeDetect: Fast Open-Vocabulary Object Detection as Retrievalcited by 14
38 more
  1. 2025ToolVQA: A Dataset for Multi-step Reasoning VQA with External Toolscited by 13
  2. 2025FG-CLIP 2: A Bilingual Fine-grained Vision-Language Alignment Modelcited by 13
  3. 2026The Second Challenge on Cross-Domain Few-Shot Object Detection at NTIRE 2026: Methods and Resultscited by 13
  4. 20253D-MOOD: Lifting 2D to 3D for Monocular Open-Set Object Detectioncited by 11
  5. 2024Grounding Partially-Defined Events in Multimodal Datacited by 10
  6. 2025New Dataset and Methods for Fine-Grained Compositional Referring Expression Comprehension via Specialist-MLLM Collaborationcited by 7
  7. 2025DINO-R1: Incentivizing Reasoning Capability in Vision Foundation Modelscited by 6
  8. 2025Referring Expression Comprehension for Small Objectscited by 6
  9. 2026GREx: Generalized Referring Expression Segmentation, Comprehension, and Generationcited by 6
  10. 2025STRIVE: Structured Representation Integrating VLM Reasoning for Efficient Object Navigationcited by 5
  11. 2025CoT Referring: Improving Referring Expression Tasks with Grounded Reasoningcited by 5
  12. 2024Auto Cherry-Picker: Learning from High-quality Generative Data Driven by Languagecited by 4
  13. 2025Leveraging Vision-Language Models for Open-Vocabulary Instance Segmentation and Trackingcited by 4
  14. 2025Re-Aligning Language to Visual Objects with an Agentic Workflowcited by 4
  15. 2025VLA^2: Empowering Vision-Language-Action Models with an Agentic Framework for Unseen Concept Manipulationcited by 4
  16. 2024Mamba-YOLO-World: Marrying YOLO-World with Mamba for Open-Vocabulary Detectioncited by 3
  17. 2026PET-DINO: Unifying Visual Cues into Grounding DINO with Prompt-Enriched Trainingcited by 3
  18. 2026DroneFINE: Domain-Aware Parameter-Efficient Fine-Tuning of Vision-Language Detectors for Drone Imagescited by 3
  19. 2024Constellation Dataset: Benchmarking High-Altitude Object Detection for an Urban Intersectioncited by 2
  20. 2026A Closer Look at Cross-Domain Few-Shot Object Detection: Fine-Tuning Matters and Parallel Decoder Helpscited by 2
  21. 2026DETR-ViP: Detection Transformer with Robust Discriminative Visual Promptscited by 2
  22. 2024Decay Pruning Method: Smooth Pruning With a Self-Rectifying Procedurecited by 1
  23. 2024Universal Medical Image Representation Learning with Compositional Decoderscited by 1
  24. 2024Multi-Point Positional Insertion Tuning for Small Object Detectioncited by 1
  25. 2025ReferDINO-Plus: 2nd Solution for 4th PVUW MeViS Challenge at CVPR 2025cited by 1
  26. 2025Synthetic Object Compositions for Scalable and Accurate Learning in Detection, Segmentation, and Groundingcited by 1
  27. 2025Connecting the Dots: Training-Free Visual Grounding via Agentic Reasoningcited by 1
  28. 2025Detector-Empowered Video Large Language Model for Efficient Spatio-Temporal Groundingcited by 1
  29. 2026RAWDet-7: A Multi-Scenario Benchmark for Object Detection and Description on Quantized RAW Imagescited by 1
  30. 2026ForestPersons: A Large-Scale Dataset for Under-Canopy Missing Person Detectioncited by 1
  31. 2026Prompt-Free Universal Region Proposal Networkcited by 1
  32. 2026Robust Onion: Peeling Open Vocab Object Detectors Under Noisecited by 1
  33. 2024UNCOVER: Unknown Class Object Detection for Autonomous Vehicles in Real-timecited by 0
  34. 2025SEED: Towards More Accurate Semantic Evaluation for Visual Brain Decodingcited by 0
  35. 2025CAST: Contrastive Adaptation and Distillation for Semi-Supervised Instance Segmentationcited by 0
  36. 2025ZERO: Industry-ready Vision Foundation Model with Multi-modal Promptscited by 0
  37. 2025AI-Driven Detection and Analysis of Handwriting on Seized Ivory: A Tool to Uncover Criminal Networks in the Illicit Wildlife Tradecited by 0
  38. 2025A Multi-Modal Neuro-Symbolic Approach for Spatial Reasoning-Based Visual Grounding in Roboticscited by 0

50 most cited of 65 All 65 (JSON)