mlsanityData to 14 Oct 2026

OPUS: A Simple yet Effective Unified Framework for Open-Vocabulary Detection

arXiv 2608.30247 ↗First posted 31 Aug 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Recent unified open-vocabulary detection (OVD) supports heterogeneous prompts, including text queries, visual exemplars, and their combinations, but often rely on increasingly complex designs such as heavy cross-modal fusion, staged training, and iterative annotation pipelines. We revisit whether such complexity is necessary in the era of stronger foundation models. Our finding is that unified OVD can be made substantially simpler with semantic-rich visual representations and scalable grounding supervision. We present OPUS (Open-vocabulary, Prompt-Unified, Simple), a unified detector supporting text, interactive visual, generic visual, and mixed prompting within one framework. OPUS adopts a simple three-part design. Its model architecture combines a semantic-rich visual encoder, built on a DINOv3-ConvNeXt-B backbone with efficient hybrid encoding, with a prompt-aware decoder that avoids prompt-specific branches for unified prompt reasoning. OPUS is trained with a one-stage text-visual training strategy with Instance-level Contrastive Alignment (ICA), and is supported by a SAM3-based single-pass data engine for heterogeneous grounding supervision. Experiments on COCO, LVIS-minival, and ODinW35 show that OPUS achieves state-of-the-art Visual-I performance, reaching 68.1/69.2/54.7 AP, while maintaining balanced Text and Visual-G accuracy. OPUS also turns mixed prompting from interference into complementarity, improving over text or visual prompt alone. These results show that simplicity and strong unified prompting capability can be achieved together.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 25 of its 38 references that are in the map. First posted on arXiv 31 Aug 2026.

Builds on

25 of 38 references.

References · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  4. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  5. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  6. 2025SAM 3: Segment Anything with Conceptscited by 906
  7. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  8. 2022Simple Open-Vocabulary Object Detection with Vision Transformerscited by 305
  9. 2018CrowdHuman: A Benchmark for Detecting Human in a Crowdcited by 284
  10. 2023A Simple Framework for Open-Vocabulary Segmentation and Detectioncited by 198
  11. 2022ELEVATER: A Benchmark and Toolkit for Evaluating Language-Augmented Visual Modelscited by 141
  12. 2022Towards End-to-End Unified Scene Text Detection and Layout Analysiscited by 97
13 more
  1. 2024T-Rex2: Towards Generic Object Detection via Text-Visual Prompt Synergycited by 94
  2. 2024DINO-X: A Unified Vision Model for Open-World Object Detection and Understandingcited by 89
  3. 2023V3Det: Vast Vocabulary Visual Detection Datasetcited by 81
  4. 2023General Object Foundation Model for Images and Videos at Scalecited by 71
  5. 2024CountGD: Multi-Modal Open-World Countingcited by 59
  6. 2023Multi-modal Queried Object Detection in the Wildcited by 47
  7. 2024OV-DINO: Unified Open-Vocabulary Detection with Language-Aware Selective Fusioncited by 28
  8. 2022Bamboo: Building Mega-Scale Vision Dataset Continually with Human-Machine Synergycited by 21
  9. 2023T-Rex: Counting by Visual Promptingcited by 20
  10. 2025WeDetect: Fast Open-Vocabulary Object Detection as Retrievalcited by 14
  11. 2025Text-guided Visual Prompt DINO for Generic Segmentationcited by 5
  12. 2026PET-DINO: Unifying Visual Cues into Grounding DINO with Prompt-Enriched Trainingcited by 3
  13. 2026DETR-ViP: Detection Transformer with Robust Discriminative Visual Promptscited by 2

Built on by

Not cited yet.