mlsanityData to 14 Oct 2026

Attentive Relational Networks for Mapping Images to Scene Graphs

arXiv 1811.10696 ↗First posted 26 Nov 2018cs.CVcited by 73

Not on the map. Why?

Abstract (arXiv)

Scene graph generation refers to the task of automatically mapping an image into a semantic structural graph, which requires correctly labeling each extracted object and their interaction relationships. Despite the recent success in object detection using deep learning techniques, inferring complex contextual relationships and structured graph representations from visual data remains a challenging topic. In this study, we propose a novel Attentive Relational Network that consists of two key modules with an object detection backbone to approach this problem. The first module is a semantic transformation module utilized to capture semantic embedded relation features, by translating visual features and linguistic features into a common semantic space. The other module is a graph self-attention module introduced to embed a joint graph representation through assigning various importance weights to neighboring nodes. Finally, accurate scene graphs are produced by the relation inference module to recognize all entities and the corresponding relations. We evaluate our proposed method on the widely-adopted Visual Genome Dataset, and the results demonstrate the effectiveness and superiority of our model.

Key facts. Cited by 73 papers in the map (data through 14 Oct 2026). First posted on arXiv 26 Nov 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2021: 13; 2022: 18; 2023: 13; 2024: 8; 2025: 15; 2026: 6.

73 papers.

Sort:

By area:

  1. 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 163
  2. 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
  3. 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
  4. 2022Panoptic Scene Graph Generationcited by 114
  5. 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 103
  6. 2022RelTR: Relation Transformer for Scene Graph Generationcited by 96
  7. 2024The All-Seeing Project V2: Towards General Relation Comprehension of the Open Worldcited by 90
  8. 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
  9. 2022Scene Graph Generation: A Comprehensive Surveycited by 73
  10. 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
  11. 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
  12. 2024T2SG: Traffic Topology Scene Graph for Topology Reasoning in Autonomous Drivingcited by 35
38 more
  1. 2021Linguistic Structures as Weak Supervision for Visual Scene Graph Generationcited by 29
  2. 2025Global-Local Tree Search in VLMs for 3D Indoor Scene Generationcited by 29
  3. 2023SGFormer: Semantic Graph Transformer for Point Cloud-based 3D Scene Graph Generationcited by 27
  4. 2021Segmentation-grounded Scene Graph Generationcited by 25
  5. 2022Causal Reasoning Meets Visual Representation Learning: A Prospective Studycited by 24
  6. 2022Iterative Scene Graph Generationcited by 24
  7. 2023Devil's on the Edges: Selective Quad Attention for Scene Graph Generationcited by 23
  8. 2023Weakly-Supervised Temporal Action Localization by Inferring Salient Snippet-Featurecited by 22
  9. 2023SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstructioncited by 21
  10. 2025Action Quality Assessment via Hierarchical Pose-guided Multi-stage Contrastive Regressioncited by 21
  11. 2025Robust Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 20
  12. 2023Unsupervised Self-Driving Attention Prediction via Uncertainty Mining and Knowledge Embeddingcited by 19
  13. 2023HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generationcited by 19
  14. 2021BGT-Net: Bidirectional GRU Transformer Network for Scene Graph Generationcited by 18
  15. 2022Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Networkcited by 17
  16. 2025DC-SAM: In-Context Segment Anything in Images and Videos via Dual Consistencycited by 15
  17. 2025SafeDriveRAG: Towards Safe Autonomous Driving with Knowledge Graph-based Retrieval-Augmented Generationcited by 15
  18. 2025A Causal Adjustment Module for Debiasing Scene Graph Generationcited by 14
  19. 2025Explainable Action Form Assessment by Exploiting Multimodal Chain-of-Thoughts Reasoningcited by 14
  20. 2023Disentangled Counterfactual Learning for Physical Audiovisual Commonsense Reasoningcited by 13
  21. 2023VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generationcited by 12
  22. 2025Towards Balanced Multi-Modal Learning in 3D Human Pose Estimationcited by 12
  23. 2021ACP++: Action Co-occurrence Priors for Human-Object Interaction Detectioncited by 11
  24. 2025DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generationcited by 11
  25. 2024Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generationcited by 10
  26. 2021RelTransformer: A Transformer-Based Long-Tail Visual Relationship Recognitioncited by 9
  27. 2022Rethinking the Evaluation of Unbiased Scene Graph Generationcited by 9
  28. 2024Multi-Stage Contrastive Regression for Action Quality Assessmentcited by 8
  29. 2022Complex Scene Image Editing by Scene Graph Comprehensioncited by 7
  30. 2021Neural Belief Propagation for Scene Graph Generationcited by 6
  31. 2021Tackling the Challenges in Scene Graph Generation with Local-to-Global Interactionscited by 5
  32. 2022Importance Weighted Structure Learning for Scene Graph Generationcited by 4
  33. 2022Explore Contextual Information for 3D Scene Graph Generationcited by 4
  34. 2022DisPositioNet: Disentangled Pose and Identity in Semantic Image Manipulationcited by 4
  35. 2023HAtt-Flow: Hierarchical Attention-Flow Mechanism for Group Activity Scene Graph Generation in Videoscited by 4
  36. 2024Decomposed Vector-Quantized Variational Autoencoder for Human Grasp Generationcited by 4
  37. 2021Topic Scene Graph Generation by Attention Distillation from Captioncited by 3
  38. 2022Context-aware Mixture-of-Experts for Unbiased Scene Graph Generationcited by 3

50 most cited of 73 All 73 (JSON)