mlsanityData to 7 Oct 2026

V3Det: Vast Vocabulary Visual Detection Dataset

arXiv 2304.03752 ↗First posted 7 Apr 2023cs.CVcited by 81

Not on the map. Why?

Cited by 29 in Multimodal LLMs / vision-language models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

Recent advances in detecting arbitrary objects in the real world are trained and evaluated on object detection datasets with a relatively restricted vocabulary. To facilitate the development of more general visual object detection, we propose V3Det, a vast vocabulary visual detection dataset with precisely annotated bounding boxes on massive images. V3Det has several appealing properties: 1) Vast Vocabulary: It contains bounding boxes of objects from 13,204 categories on real-world images, which is 10 times larger than the existing large vocabulary object detection dataset, e.g., LVIS. 2) Hierarchical Category Organization: The vast vocabulary of V3Det is organized by a hierarchical category tree which annotates the inclusion relationship among categories, encouraging the exploration of category relationships in vast and open vocabulary object detection. 3) Rich Annotations: V3Det comprises precisely annotated objects in 243k images and professional descriptions of each category written by human experts and a powerful chatbot. By offering a vast exploration space, V3Det enables extensive benchmarks on both vast and open vocabulary object detection, leading to new observations, practices, and insights for future research. It has the potential to serve as a cornerstone dataset for developing more general visual perception systems. V3Det is available at https://v3det.openxlab.org.cn/.

Key facts. Cited by 81 papers in the map (data through 7 Oct 2026). Builds on 60 of its 75 references that are in the map. First posted on arXiv 7 Apr 2023.

Builds on

60 of 75 references.

References · 60

  1. 2015Deep Residual Learning for Image Recognitioncited by 51,809
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  3. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  4. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  5. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  6. 2014Microsoft COCO: Common Objects in Contextcited by 17,498
  7. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  8. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
  9. 2014ImageNet Large Scale Visual Recognition Challengecited by 8,441
  10. 2020End-to-End Object Detection with Transformerscited by 7,384
  11. 2016Feature Pyramid Networks for Object Detectioncited by 5,021
  12. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,410
38 more
  1. 2015SSD: Single Shot MultiBox Detectorcited by 3,125
  2. 2015Fast R-CNNcited by 2,930
  3. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  4. 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,160
  5. 2019FCOS: Fully Convolutional One-Stage Object Detectioncited by 1,573
  6. 2015Microsoft COCO Captions: Data Collection and Evaluation Servercited by 1,447
  7. 2016YOLO9000: Better, Faster, Strongercited by 1,429
  8. 2019MMDetection: Open MMLab Detection Toolbox and Benchmarkcited by 1,379
  9. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,306
  10. 2017Cascade R-CNN: Delving into High Quality Object Detectioncited by 1,275
  11. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
  12. 2021Grounded Language-Image Pre-trainingcited by 1,147
  13. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 903
  14. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  15. 2018CornerNet: Detecting Objects as Paired Keypointscited by 763
  16. 2022EVA: Exploring the Limits of Masked Visual Representation Learning at Scalecited by 685
  17. 2019CenterNet: Keypoint Triplets for Object Detectioncited by 654
  18. 2022Detecting Twenty-thousand Classes using Image-level Supervisioncited by 613
  19. 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 612
  20. 2020Simple Copy-Paste is a Strong Data Augmentation Method for Instance Segmentationcited by 595
  21. 2019Bridging the Gap Between Anchor-based and Anchor-free Detection via Adaptive Training Sample Selectioncited by 539
  22. 2020Sparse R-CNN: End-to-End Object Detection with Learnable Proposalscited by 494
  23. 2019Hybrid Task Cascade for Instance Segmentationcited by 479
  24. 2019Cascade R-CNN: High Quality Object Detection and Instance Segmentationcited by 428
  25. 2020Open-Vocabulary Object Detection Using Captionscited by 427
  26. 2022Learning to Prompt for Open-Vocabulary Object Detection with Vision-Language Modelcited by 317
  27. 2020Conditional Convolutions for Instance Segmentationcited by 314
  28. 2019SOLO: Segmenting Objects by Locationscited by 289
  29. 2021Prototypical Pseudo Label Denoising and Target Structure Learning for Domain Adaptive Semantic Segmentationcited by 268
  30. 2019Mask Scoring R-CNNcited by 265
  31. 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 185
  32. 2020Seesaw Loss for Long-Tailed Instance Segmentationcited by 146
  33. 2022Bridging the Gap between Object and Image-level Representations for Open-Vocabulary Detectioncited by 145
  34. 2022ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Modelscited by 141
  35. 2022PromptDet: Towards Open-vocabulary Detection using Uncurated Imagescited by 133
  36. 2021Probabilistic two-stage detectioncited by 130
  37. 2019CARAFE: Content-Aware ReAssembly of FEaturescited by 119
  38. 2020TIDE: A General Toolbox for Identifying Object Detection Errorscited by 113

50 most cited of 60 All 60 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 13; 2024: 30; 2025: 22; 2026: 16.

81 papers.

Sort:

By area:

  1. 2024Grounded SAM: Assembling Open-World Models for Diverse Visual Taskscited by 914
  2. 2023GLaMM: Pixel Grounding Large Multimodal Modelcited by 447
  3. 2024SpatialRGPT: Grounded Spatial Reasoning in Vision Language Modelscited by 297
  4. 2023Towards Open Vocabulary Learning: A Surveycited by 165
  5. 2024VisionLLM v2: An End-to-End Generalist Multimodal Large Language Model for Hundreds of Vision-Language Taskscited by 136
  6. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  7. 2024Groma: Localized Visual Tokenization for Grounding Multimodal Large Language Modelscited by 118
  8. 2023The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open Worldcited by 114
  9. 2023Contextual Object Detection with Multimodal Large Language Modelscited by 100
  10. 2024Draw-and-Understand: Leveraging Visual Prompts to Enable MLLMs to Comprehend What You Wantcited by 98
  11. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 85
  12. 2024Open-Vocabulary SAM: Segment and Recognize Twenty-thousand Classes Interactivelycited by 74
38 more
  1. 2024RegionGPT: Towards Region Understanding Vision Language Modelcited by 71
  2. 2025Vision-R1: Evolving Human-Free Alignment in Large Vision-Language Models via Vision-Guided Reinforcement Learningcited by 68
  3. 2025Detect Anything via Next Point Predictioncited by 66
  4. 2023A Comprehensive Survey on Segment Anything Model for Vision and Beyondcited by 64
  5. 2025LLMDet: Learning Strong Open-Vocabulary Object Detectors under the Supervision of Large Language Modelscited by 53
  6. 2024DetCLIPv3: Towards Versatile Generative Open-vocabulary Object Detectioncited by 48
  7. 2024InternLM-XComposer2.5-OmniLive: A Comprehensive Multimodal System for Long-term Streaming Video and Audio Interactionscited by 48
  8. 2023Described Object Detection: Liberating Object Detection with Flexible Expressionscited by 40
  9. 2023MosaicFusion: Diffusion Models as Data Augmenters for Large Vocabulary Instance Segmentationcited by 35
  10. 2025Retrieval Augmented Generation and Understanding in Vision: A Survey and New Outlookcited by 32
  11. 2023Segment and Caption Anythingcited by 30
  12. 2024Griffon v2: Advancing Multimodal Perception with High-Resolution Scaling and Visual-Language Co-Referringcited by 29
  13. 2024VastTrack: Vast Category Visual Object Trackingcited by 25
  14. 2024PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Modelscited by 25
  15. 2024RAR: Retrieving And Ranking Augmented MLLMs for Visual Recognitioncited by 24
  16. 2025Pixel-SAIL: Single Transformer For Pixel-Grounded Understandingcited by 22
  17. 2024Subobject-level Image Tokenizationcited by 20
  18. 2024Retrieval-Augmented Open-Vocabulary Object Detectioncited by 20
  19. 2025Omni-RGPT: Unifying Image and Video Region-level Understanding via Token Markscited by 17
  20. 2023Segment Anything in Non-Euclidean Domains: Challenges and Opportunitiescited by 16
  21. 2025DenseWorld-1M: Towards Detailed Dense Grounded Caption in the Real Worldcited by 16
  22. 2023How to Evaluate the Generalization of Detection? A Benchmark for Comprehensive Open-Vocabulary Detectioncited by 15
  23. 2024DualFocus: Integrating Macro and Micro Perspectives in Multi-modal Large Language Modelscited by 14
  24. 2024ReasonPix2Pix: Instruction Reasoning Dataset for Advanced Image Editingcited by 14
  25. 2024UMG-CLIP: A Unified Multi-Granularity Vision Generalist for Open-World Understandingcited by 13
  26. 2025Improving the Reasoning of Multi-Image Grounding in MLLMs via Reinforcement Learningcited by 11
  27. 2025WeDetect: Fast Open-Vocabulary Object Detection as Retrievalcited by 11
  28. 2024HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embeddingcited by 10
  29. 2025Vision-Language Model for Object Detection and Segmentation: A Review and Evaluationcited by 10
  30. 2026SAMTok: Representing Any Mask with Two Wordscited by 10
  31. 2023Towards Open-Ended Visual Recognition with Large Language Modelcited by 8
  32. 2025InstructSAM: A Training-Free Framework for Instruction-Oriented Remote Sensing Object Recognitioncited by 8
  33. 2025Dynamic-DINO: Fine-Grained Mixture of Experts Tuning for Real-time Open-Vocabulary Object Detectioncited by 8
  34. 2025OmniSTVG: Toward Spatio-Temporal Omni-Object Video Groundingcited by 7
  35. 2024Adaptive Parametric Activation: Unifying and Generalising Activation Functions Across Taskscited by 6
  36. 2025Referring Expression Comprehension for Small Objectscited by 6
  37. 2023Recognize Any Regionscited by 5
  38. 2024Fractal Calibration for long-tailed object detectioncited by 5

50 most cited of 81 All 81 (JSON)