mlsanityData to 7 Oct 2026

Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cues

arXiv 1611.06641 ↗First posted 21 Nov 2016cs.CVcited by 33

Not on the map. Why?

Abstract (arXiv)

This paper presents a framework for localization or grounding of phrases in images using a large collection of linguistic and visual cues. We model the appearance, size, and position of entity bounding boxes, adjectives that contain attribute information, and spatial relationships between pairs of entities connected by verbs or prepositions. Special attention is given to relationships between people and clothing or body part mentions, as they are useful for distinguishing individuals. We automatically learn weights for combining these cues and at test time, perform joint inference over all phrases in a caption. The resulting system produces state of the art performance on phrase localization on the Flickr30k Entities dataset and visual relationship detection on the Stanford VRD dataset.

Key facts. Cited by 33 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Nov 2016.

Builds on

No reference list yet.

Built on by

Cited by year

Citing papers per year: 2021: 13; 2022: 10; 2023: 6; 2024: 2; 2025: 2.

33 papers.

Sort:

By area:

  1. 2021MDETR -- Modulated Detection for End-to-End Multi-Modal Understandingcited by 811
  2. 2023Multi3DRefer: Grounding Text Description to Multiple 3D Objectscited by 142
  3. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  4. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  5. 2021Fully Convolutional Scene Graph Generationcited by 57
  6. 2024Toward Visual Grounding: A Surveycited by 52
  7. 2021Towards General Purpose Vision Systemscited by 46
  8. 2023CoTDet: Affordance Knowledge Prompting for Task Driven Object Detectioncited by 36
  9. 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
  10. 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
  11. 2022Adapting CLIP For Phrase Localization Without Further Trainingcited by 21
  12. 2024SAM as the Guide: Mastering Pseudo-Label Refinement in Semi-Supervised Referring Expression Segmentationcited by 17
21 more
  1. 2021Who's Waldo? Linking People Across Text and Imagescited by 16
  2. 2022Toward Explainable and Fine-Grained 3D Grounding through Referring Textual Phrasescited by 16
  3. 2021Weakly-Supervised Video Object Grounding via Causal Interventioncited by 13
  4. 2021Effectively Leveraging Attributes for Visual Similaritycited by 9
  5. 2021Weakly Supervised Human-Object Interaction Detection in Video via Contrastive Spatiotemporal Regionscited by 8
  6. 20212.5D Visual Relationship Detectioncited by 7
  7. 2022Unpaired Referring Expression Grounding via Bidirectional Cross-Modal Matchingcited by 7
  8. 2022Complex Scene Image Editing by Scene Graph Comprehensioncited by 7
  9. 2023OV-VG: A Benchmark for Open-Vocabulary Visual Groundingcited by 7
  10. 2022Neural Message Passing for Visual Relationship Detectioncited by 6
  11. 2023Adaptive Visual Scene Understanding: Incremental Scene Graph Generationcited by 6
  12. 2021Tackling the Challenges in Scene Graph Generation with Local-to-Global Interactionscited by 5
  13. 2023Context Does Matter: End-to-end Panoptic Narrative Grounding with Deformable Attention Refined Matching Networkcited by 5
  14. 2022Fine-Grained Visual Entailmentcited by 4
  15. 2023Language-Guided Diffusion Model for Visual Groundingcited by 3
  16. 2025Fine-Grained Open-Vocabulary Object Detection with Fined-Grained Prompts: Task, Dataset and Benchmarkcited by 2
  17. 2021Dataset Summarization by K Principal Conceptscited by 1
  18. 2021A Better Loss for Visual-Textual Groundingcited by 1
  19. 2022Real-Time Cattle Interaction Recognition via Triple-stream Networkcited by 1
  20. 2021From Coarse to Fine-grained Concept based Discrimination for Phrase Detectioncited by 0
  21. 2025Dynamic Relation Inference via Verb Embeddingscited by 0