mlsanityData to 14 Oct 2026

FlowOVD: Learning Generative Latent Flows for Zero-shot Open-vocabulary Detection

arXiv 2606.00782 ↗First posted 30 May 2026cs.CVcited by 0

On the map: Multimodal LLMs / vision-language models → Driving VLMs and open-vocabulary detection

Abstract (arXiv)

Open-vocabulary object detection (OVD) has achieved remarkable progress through large-scale vision-language pre-training. Existing methods, however, typically formulate OVD as a discriminative prediction problem, where decoder queries are either static or initialized from encoder features, thus limiting their diversity and flexibility. In this paper, we introduce a generative perspective by modeling decoder query generation as a continuous transport process in latent space. We propose FlowOVD, a text-conditioned query generation framework based on rectified flow that progressively transforms text-agnostic queries into text-guided queries. By introducing continuous latent query dynamics into a vision-language model (VLM) based detector, our method avoids heuristic discrete query construction and enables more expressive semantic alignment for open-vocabulary detection. Without requiring additional training data, FlowOVD achieves 49.5 AP on COCO and 31.5 AP on LVIS, outperforming GroundingDINO by +1.2 AP (+2.5 %) and +4.1 AP (+15.0 %), respectively. The larger gain on the challenging long-tailed LVIS benchmark further highlights the effectiveness of continuous query generation for open-vocabulary generalization.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Driving VLMs and open-vocabulary detection, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 29 of its 33 references that are in the map. First posted on arXiv 30 May 2026.

Builds on

29 of 33 references.

References · 29

  1. 2017Attention Is All You Needcited by 60,361
  2. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  3. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  4. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  5. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  6. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  7. 2020End-to-End Object Detection with Transformerscited by 7,414
  8. 2017Mask R-CNNcited by 7,277
  9. 2022Flow Matching for Generative Modelingcited by 5,702
  10. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  11. 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,700
  12. 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
17 more
  1. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  2. 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
  3. 2015Variational Inference with Normalizing Flowscited by 2,170
  4. 2016YOLO9000: Better, Faster, Strongercited by 1,431
  5. 2019Generalized Intersection over Union: A Metric and A Loss for Bounding Box Regressioncited by 1,368
  6. 2022DINO: DETR with Improved DeNoising Anchor Boxes for End-to-End Object Detectioncited by 1,319
  7. 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,217
  8. 2021Grounded Language-Image Pre-trainingcited by 1,156
  9. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 819
  10. 2024YOLO-World: Real-Time Open-Vocabulary Object Detectioncited by 503
  11. 2022DiffusionDet: Diffusion Model for Object Detectioncited by 354
  12. 2021Dynamic Head: Unifying Object Detection Heads with Attentionscited by 187
  13. 2024Grounding DINO 1.5: Advance the "Edge" of Open-Set Object Detectioncited by 122
  14. 2024Benchmarking Object Detectors with COCO: A New Path Forwardcited by 23
  15. 2025Deforming Videos to Masks: Flow Matching for Referring Video Segmentationcited by 10
  16. 2025Dynamic-DINO: Fine-Grained Mixture of Experts Tuning for Real-time Open-Vocabulary Object Detectioncited by 8
  17. 2025FlowDet: Unifying Object Detection and Generative Transport Flowscited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026NoOVD: Novel Category Discovery and Embedding for Open-Vocabulary Object Detection
  2. 2024MarvelOVD: Marrying Object Recognition and Vision-Language Models for Robust Open-Vocabulary Object Detection
  3. 2024LLMs Meet VLMs: Boost Open Vocabulary Object Detection with Fine-grained Descriptors
  4. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillation
  5. 2026ExDet: Open-Domain Open-Vocabulary Detection with Cross-modal Extrapolation and Rectification
  6. 2025Cyclic Contrastive Knowledge Transfer for Open-Vocabulary Object Detection
  7. 2025Open-Det: An Efficient Learning Framework for Open-Ended Detection
  8. 2026COVD: Continual Open-Vocabulary Object Detection with Novel Concept Injection