mlsanityData to 14 Oct 2026

Neural Message Passing for Visual Relationship Detection

arXiv 2208.04165 ↗First posted 8 Aug 2022cs.CVcited by 6

Not on the map. Why?

Abstract (arXiv)

Visual relationship detection aims to detect the interactions between objects in an image; however, this task suffers from combinatorial explosion due to the variety of objects and interactions. Since the interactions associated with the same object are dependent, we explore the dependency of interactions to reduce the search space. We explicitly model objects and interactions by an interaction graph and then propose a message-passing-style algorithm to propagate the contextual information. We thus call the proposed method neural message passing (NMP). We further integrate language priors and spatial cues to rule out unrealistic interactions and capture spatial interactions. Experimental results on two benchmark datasets demonstrate the superiority of our proposed method. Our code is available at https://github.com/PhyllisH/NMP.

Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Builds on 28 of its 37 references that are in the map. First posted on arXiv 8 Aug 2022.

Builds on

28 of 37 references.

References · 28

  1. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  2. 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,361
  3. 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
  4. 2017Inductive Representation Learning on Large Graphscited by 6,320
  5. 2013Efficient Estimation of Word Representations in Vector Spacecited by 4,375
  6. 2017Neural Message Passing for Quantum Chemistrycited by 3,487
  7. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  8. 2015VQA: Visual Question Answeringcited by 2,506
  9. 2018Relational inductive biases, deep learning, and graph networkscited by 1,360
  10. 2014Show and Tell: A Neural Image Caption Generatorcited by 879
  11. 2016Visual Relationship Detection with Language Priorscited by 334
  12. 2018Graph R-CNN for Scene Graph Generationcited by 298
16 more
  1. 2018Learning Human-Object Interactions by Graph Parsing Neural Networkscited by 176
  2. 2018Graph HyperNetworks for Neural Architecture Searchcited by 132
  3. 2017Visual Translation Embedding Network for Visual Relation Detectioncited by 112
  4. 2017Detecting Visual Relationships with Deep Relational Networkscited by 97
  5. 2018Rethinking Knowledge Graph Propagation for Zero-Shot Learningcited by 87
  6. 2017Visual Relationship Detection with Internal and External Linguistic Knowledge Distillationcited by 61
  7. 2018LinkNet: Relational Embedding for Scene Graphcited by 45
  8. 2018Zoom-Net: Mining Deep Feature Interactions for Visual Relationship Recognitioncited by 41
  9. 2017Situation Recognition with Graph Neural Networkscited by 34
  10. 2016Phrase Localization and Visual Relationship Detection with Comprehensive Image-Language Cuescited by 33
  11. 2017Deep Variation-structured Reinforcement Learning for Visual Relationship and Attribute Detectioncited by 28
  12. 2021Conditional Neural Relational Inference for Interacting Systemscited by 28
  13. 2017Towards Context-aware Interaction Recognitioncited by 20
  14. 2017Generalized Value Iteration Networks: Life Beyond Latticescited by 16
  15. 2018Shuffle-Then-Assemble: Learning Object-Agnostic Visual Relationship Featurescited by 11
  16. 2018Context-Dependent Diffusion Network for Visual Relationship Detectioncited by 9

Built on by

Cited by year

Citing papers per year: 2022: 2; 2023: 3; 2024: 1.

6 papers.

  1. 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
  2. 2023HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generationcited by 19
  3. 2023VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generationcited by 12
  4. 2022Grounding Scene Graphs on Natural Images via Visio-Lingual Message Passingcited by 1
  5. 2023A Novel Neural-symbolic System under Statistical Relational Learningcited by 1
  6. 2022Multi-Task Edge Prediction in Temporally-Dynamic Video Graphscited by 0