mlsanityData to 7 Oct 2026

Image Scene Graph Generation (SGG) Benchmark

arXiv 2107.12604 ↗First posted 27 Jul 2021cs.CVcited by 15

Not on the map. Why?

Abstract (arXiv)

There is a surge of interest in image scene graph generation (object, attribute and relationship detection) due to the need of building fine-grained image understanding models that go beyond object detection. Due to the lack of a good benchmark, the reported results of different scene graph generation models are not directly comparable, impeding the research progress. We have developed a much-needed scene graph generation benchmark based on the maskrcnn-benchmark and several popular models. This paper presents main features of our benchmark and a comprehensive ablation study of scene graph generation models using the Visual Genome and OpenImages Visual relationship detection datasets. Our codebase is made publicly available at https://github.com/microsoft/scene_graph_benchmark.

Key facts. Cited by 15 papers in the map (data through 7 Oct 2026). Builds on 18 of its 23 references that are in the map. First posted on arXiv 27 Jul 2021.

Builds on

18 of 23 references.

References · 18

  1. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
  2. 2017Bottom-Up and Top-Down Attention for Image Captioning and Visual Question Answeringcited by 1,310
  3. 2017Scene Graph Generation by Iterative Message Passingcited by 462
  4. 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
  5. 2018Image Generation from Scene Graphscited by 324
  6. 2018Graph R-CNN for Scene Graph Generationcited by 296
  7. 20193D Scene Graph: A Structure for Unified Semantics, 3D Space, and Cameracited by 280
  8. 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
  9. 2018Auto-Encoding Scene Graphs for Image Captioningcited by 254
  10. 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 249
  11. 2017Scene Graph Generation from Objects, Phrases and Region Captionscited by 154
  12. 2021VinVL: Revisiting Visual Representations in Vision-Language Modelscited by 109
6 more
  1. 2019Graphical Contrastive Losses for Scene Graph Parsingcited by 100
  2. 2019Unpaired Image Captioning via Scene Graph Alignmentscited by 82
  3. 2019Cross-modal Scene Graph Matching for Relationship-aware Image-Text Retrievalcited by 66
  4. 2019BLOCK: Bilinear Superdiagonal Fusion for Visual Question Answering and Visual Relationship Detectioncited by 62
  5. 2020Object-Centric Image Generation from Layoutscited by 57
  6. 2019Generating Natural Language Explanations for Visual Question Answering using Scene Graphs and Visual Attentioncited by 26

Built on by

Cited by year

Citing papers per year: 2021: 1; 2022: 6; 2023: 4; 2024: 4.

15 papers.

Sort:

By area:

  1. 2021Grounded Language-Image Pre-trainingcited by 1,147
  2. 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
  3. 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoningcited by 49
  4. 2022Measuring Representational Harms in Image Captioningcited by 36
  5. 2022A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answeringcited by 13
  6. 2023Multitask Multimodal Prompted Training for Interactive Embodied Task Completioncited by 9
  7. 2024GeReA: Question-Aware Prompt Captions for Knowledge-based Visual Question Answeringcited by 9
  8. 2023Quality-agnostic Image Captioning to Safely Assist People with Vision Impairmentcited by 8
  9. 2024Towards Lifelong Scene Graph Generation with Knowledge-ware In-context Prompt Learningcited by 6
  10. 2022CLID: Controlled-Length Image Descriptions with Limited Datacited by 4
  11. 2023Towards Addressing the Misalignment of Object Proposal Evaluation for Vision-Language Tasks via Semantic Groundingcited by 2
  12. 2022CLOP: Video-and-Language Pre-Training with Knowledge Regularizationscited by 0
3 more
  1. 2022On Utilizing Relationships for Transferable Few-Shot Fine-Grained Object Detectioncited by 0
  2. 2024The Solution for the CVPR 2023 1st foundation model challenge-Track2cited by 0
  3. 2024Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generationcited by 0