Data to 7 Oct 2026

Scene Graph Generation with External Knowledge and Image Reconstruction

arXiv 1904.00560 ↗First posted 1 Apr 2019cs.CVcited by 102

Not on the map. Why?

Abstract (arXiv)

Scene graph generation has received growing attention with the advancements in image understanding tasks such as object detection, attributes and relationship prediction,~etc. However, existing datasets are biased in terms of object and relationship labels, or often come with noisy and missing annotations, which makes the development of a reliable scene graph prediction model very challenging. In this paper, we propose a novel scene graph generation algorithm with external knowledge and image reconstruction loss to overcome these dataset issues. In particular, we extract commonsense knowledge from the external knowledge base to refine object and phrase features for improving generalizability in scene graph generation. To address the bias of noisy object annotations, we introduce an auxiliary image reconstruction path to regularize the scene graph generation network. Extensive experiments show that our framework can generate better scene graphs, achieving the state-of-the-art performance on two benchmark datasets: Visual Relationship Detection and Visual Genome datasets.

Key facts. Cited by 102 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Apr 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 27; 2022: 33; 2023: 22; 2024: 15; 2025: 4; 2026: 1.

102 papers.

Sort:

By area:

2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
2022Panoptic Scene Graph Generationcited by 114
2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
2022Scene Graph Generation: A Comprehensive Surveycited by 73
2021Learning to Compose Visual Relationscited by 72
2021Recovering the Unbiased Scene Graphs from the Biased Onescited by 71
2021Learning of Visual Relations: The Devil is in the Tailscited by 65
2021Fully Convolutional Scene Graph Generationcited by 57
2021Semantics for Robotic Mapping, Perception and Interaction: A Surveycited by 56

38 more

2021From General to Specific: Informative Scene Graph Generation via Balance Adjustmentcited by 51
2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
2023CoTDet: Affordance Knowledge Prompting for Task Driven Object Detectioncited by 36
2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
2022Towards Data-and Knowledge-Driven Artificial Intelligence: A Survey on Neuro-Symbolic Computingcited by 34
2021In Defense of Scene Graphs for Image Captioningcited by 31
2022VAEL: Bridging Variational Autoencoders and Probabilistic Logic Programmingcited by 31
2021Linguistic Structures as Weak Supervision for Visual Scene Graph Generationcited by 29
2021Consensus Graph Representation Learning for Better Grounded Image Captioningcited by 28
2021Coarse-to-Fine Reasoning for Visual Question Answeringcited by 25
2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
2023Devil's on the Edges: Selective Quad Attention for Scene Graph Generationcited by 23
2022Resistance Training using Prior Bias: toward Unbiased Scene Graph Generationcited by 22
2021Zero-Shot Scene Graph Relation Prediction through Commonsense Knowledge Integrationcited by 21
2021Not All Relations are Equal: Mining Informative Labels for Scene Graph Generationcited by 21
2023HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generationcited by 19
2023Vision Relation Transformer for Unbiased Scene Graph Generationcited by 18
2022Label Semantic Knowledge Distillation for Unbiased Scene Graph Generationcited by 14
2023TextPSG: Panoptic Scene Graph Generation from Textual Descriptionscited by 14
2024HiKER-SGG: Hierarchical Knowledge Enhanced Robust Scene Graph Generationcited by 14
2021GoG: Relation-aware Graph-over-Graph Network for Visual Dialogcited by 13
2021Induce, Edit, Retrieve: Language Grounded Multimodal Schema for Instructional Video Retrievalcited by 13
2021Relational Graph Learning for Grounded Video Description Generationcited by 12
2023VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generationcited by 12
2021ACP++: Action Co-occurrence Priors for Human-Object Interaction Detectioncited by 11
2022Shadow-Aware Dynamic Convolution for Shadow Removalcited by 11
2022Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generationcited by 10
2022Knowledge-augmented Deep Learning and Its Applications: A Surveycited by 10
2024A Comprehensive Survey of 3D Dense Captioning: Localizing and Describing Objects in 3D Scenescited by 10
2024Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generationcited by 10
2025DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generationcited by 10
2022Spatial Commonsense Graph for Object Localisation in Partial Scenescited by 9
2022Unsupervised Vision-Language Parsing: Seamlessly Bridging Visual Scene Graphs with Language Structures via Dependency Relationshipscited by 9
2024DeiSAM: Segment Anything with Deictic Promptingcited by 9
2024External Knowledge Enhanced 3D Scene Generation from Sketchcited by 9

50 most cited of 102 All 102 (JSON)