Graph R-CNN for Scene Graph Generation
Not on the map. Why?
Abstract (arXiv)
We propose a novel scene graph generation model called Graph R-CNN, that is both effective and efficient at detecting objects and their relations in images. Our model contains a Relation Proposal Network (RePN) that efficiently deals with the quadratic number of potential relations between objects in an image. We also propose an attentional Graph Convolutional Network (aGCN) that effectively captures contextual information between objects and relations. Finally, we introduce a new evaluation metric that is more holistic and realistic than existing metrics. We report state-of-the-art performance on scene graph generation as evaluated using both existing and our proposed metrics.
Key facts. Cited by 296 papers in the map (data through 7 Oct 2026). First posted on arXiv 1 Aug 2018.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 73; 2022: 82; 2023: 62; 2024: 36; 2025: 27; 2026: 16.
296 papers.
Sort:
By area:
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
- 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022Panoptic Scene Graph Generationcited by 114
- 2021Energy-Based Learning for Scene Graph Generationcited by 104
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
- 2021Spatial-Temporal Transformer for Dynamic Scene Graph Generationcited by 95
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
38 more
- 2024Open3DSG: Open-Vocabulary 3D Scene Graphs from Point Clouds with Queryable Objects and Open-Set Relationshipscited by 76
- 2021SUGAR: Subgraph Neural Network with Reinforcement Pooling and Self-Supervised Mutual Information Mechanismcited by 75
- 2022Multi-Modal Knowledge Graph Construction and Application: A Surveycited by 74
- 2021Graph-MLP: Node Classification without Message Passing in Graphcited by 73
- 2022Scene Graph Generation: A Comprehensive Surveycited by 73
- 2022A Comprehensive Survey on Deep Clustering: Taxonomy, Challenges, and Future Directionscited by 73
- 2021Recovering the Unbiased Scene Graphs from the Biased Onescited by 71
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2021Learning of Visual Relations: The Devil is in the Tailscited by 65
- 2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
- 2022The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generationcited by 60
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2022Instance Relation Graph Guided Source-Free Domain Adaptive Object Detectioncited by 55
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spacescited by 53
- 2021Target Adaptive Context Aggregation for Video Scene Graph Generationcited by 51
- 2021Hierarchical Representations and Explicit Memory: Learning Effective Navigation Policies on 3D Scene Graphs using Graph Neural Networkscited by 50
- 2024RoboEXP: Action-Conditioned Scene Graph via Interactive Exploration for Robotic Manipulationcited by 48
- 2021Exploiting Edge-Oriented Reasoning for 3D Point-based Scene Graph Analysiscited by 47
- 2023Panoptic Video Scene Graph Generationcited by 46
- 2022ClarET: Pre-training a Correlation-Aware Context-To-Event Transformer for Event-Centric Generation and Classificationcited by 45
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
- 2021Structured Sparse R-CNN for Direct Scene Graph Generationcited by 44
- 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 44
- 2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
- 2023VL-SAT: Visual-Linguistic Semantics Assisted Training for 3D Semantic Scene Graph Prediction in Point Cloudcited by 42
- 2022Continuous Scene Representations for Embodied AIcited by 39
- 2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
- 2021Unified Graph Structured Models for Video Understandingcited by 38
- 2021Edge-Cloud Polarization and Collaboration: A Comprehensive Survey for AIcited by 38
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2023Prototype-based Embedding Network for Scene Graph Generationcited by 37
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
- 2021MAAS: Multi-modal Assignation for Active Speaker Detectioncited by 35
- 2021Probabilistic Modeling of Semantic Ambiguity for Scene Graph Generationcited by 35
- 2022Contrastive Language-Image Pre-Training with Knowledge Graphscited by 34
- 2021DeepPanoContext: Panoramic 3D Scene Understanding with Holistic Scene Context Graph and Relation-based Optimizationcited by 33
- 2021In Defense of Scene Graphs for Image Captioningcited by 31
50 most cited of 296 All 296 (JSON)
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directions4 Sep 2026
- 2026Geometric 2D Scene Graph Generation24 Jul 2026
- 2026Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension6 Jul 2026
- 2026HyperDCM: Dynamic Cluster Memory Replay in Hyperbolic Space for Continual Robotic Navigation Across Scenes4 Jul 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Expanding Spatial and Temporal Context for Robotic Imitation Learning With Scene Graphs31 May 2026
- 2026RelWitness: Open-Vocabulary 3D Scene Graph Generation with Visual-Geometric Relation Witnesses20 May 2026
- 2026Multi-hop Relational Contrastive Learning: Extending Spatial Contrastive Pre-training Beyond Pairwise Relations15 May 2026
- 2026Dependency-Aware Discrete Diffusion for Scene Graph Generation9 May 2026
- 2026ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation24 Apr 2026
38 more
- 2026HSG: Hyperbolic Scene Graph19 Apr 2026
- 2026STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation3 Apr 2026
- 2026ReLaGS: Relational Language Gaussian Splatting18 Mar 2026
- 2026REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation6 Mar 2026
- 2025With Great Context Comes Great Prediction Power: Classifying Objects via Geo-Semantic Scene Graphs28 Dec 2025
- 2025Through the PRISm: Importance-Aware Scene Graphs for Image Retrieval20 Dec 2025
- 2025A graph generation pipeline for critical infrastructures based on heuristics, images and depth data8 Dec 2025
- 2025VOST-SGG: VLM-Aided One-Stage Spatio-Temporal Scene Graph Generation5 Dec 2025
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Grounding30 Nov 2025
- 2025Graph Query Networks for Object Detection with Automotive Radar19 Nov 2025
- 2025Object-Centric Representation Learning for Enhanced 3D Semantic Scene Graph Prediction6 Oct 2025
- 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep 2025
- 2025Towards Open-Vocabulary Multimodal 3D Object Detection with Attributes22 Aug 2025
- 2025D2-Mamba: Dual-Scale Fusion and Dual-Path Scanning with SSMs for Shadow Removal18 Aug 2025
- 2025Statistical Confidence Rescoring for Robust 3D Scene Graph Generation from Multi-View Images5 Aug 2025
- 2025Reusing Attention for One-stage Lane Topology Understanding23 Jul 2025
- 2025Dense Video Captioning using Graph-based Sentence Summarization25 Jun 2025
- 2025Hallucinate, Ground, Repeat: A Framework for Generalized Visual Relationship Detection6 Jun 2025
- 2025A Reverse Causal Framework to Mitigate Spurious Correlations for Debiasing Scene Graph Generation29 May 2025
- 2025Learning Isometric Embeddings of Road Networks using Multidimensional Scaling24 Apr 2025
- 2025Robo-SGG: Exploiting Layout-Oriented Normalization and Restitution Can Improve Robust Scene Graph Generation17 Apr 2025
- 2025SAMJAM: Zero-Shot Video Scene Graph Generation for Egocentric Kitchen Videos10 Apr 2025
- 2025Deep Reinforcement Learning via Object-Centric Attention3 Apr 2025
- 2025HomeEmergency -- Using Audio to Find and Respond to Emergencies in the Home1 Apr 2025
- 2025Open-Vocabulary Functional 3D Scene Graphs for Real-World Indoor Spaces24 Mar 2025
- 2025SG-Tailor: Inter-Object Commonsense Relationship Reasoning for Scene Graph Manipulation23 Mar 2025
- 2025A Closer Look at Dynamic Scene Graph Generation In the Era of Multimodal Large Language Models20 Mar 2025
- 2025DIFFVSGG: Diffusion-Driven Online Video Scene Graph Generation18 Mar 2025
- 2025Salient Temporal Encoding for Dynamic Scene Graph Generation15 Mar 2025
- 2025DreamRelation: Relation-Centric Video Customization10 Mar 2025
- 2025GaussianGraph: 3D Gaussian-based Scene Graph Generation for Open-world Scene Understanding6 Mar 2025
- 2024RelationField: Relate Anything in Radiance Fields18 Dec 2024
- 2024RA-SGG: Retrieval-Augmented Scene Graph Generation Framework via Multi-Prototype Learning17 Dec 2024
- 2024LLaVA-SpaceSGG: Visual Instruct Tuning for Open-vocabulary Scene Graph Generation with Enhanced Spatial Relations9 Dec 2024
- 2024Goal-Oriented Semantic Communication for Wireless Visual Question Answering3 Nov 2024
- 2024Situational Scene Graph for Structured Human-centric Situation Understanding30 Oct 2024
- 2024SceneGraMMi: Scene Graph-boosted Hybrid-fusion for Multi-Modal Misinformation Veracity Prediction20 Oct 2024
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
50 newest of 296 All 296 (JSON)
- 2022Deep Learning Approaches on Image Captioning: A Reviewcited by 43
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representationscited by 37
- 2022PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Modelscited by 30
- 2024RelationField: Relate Anything in Radiance Fieldscited by 16
- 2024CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Modelscited by 11
- 2022Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanationscited by 8
- 2025DescribeEarth: Describe Anything for Remote Sensing Imagescited by 5
- 2023CREPE: Learnable Prompting With CLIP Improves Visual Relationship Predictioncited by 4
- 2025A Closer Look at Dynamic Scene Graph Generation In the Era of Multimodal Large Language Modelscited by 0
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Groundingcited by 0
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Grounding30 Nov 2025
- 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep 2025
- 2025A Closer Look at Dynamic Scene Graph Generation In the Era of Multimodal Large Language Models20 Mar 2025
- 2024RelationField: Relate Anything in Radiance Fields18 Dec 2024
- 2024CODIS: Benchmarking Context-Dependent Visual Comprehension for Multimodal Large Language Models21 Feb 2024
- 2023CREPE: Learnable Prompting With CLIP Improves Visual Relationship Prediction10 Jul 2023
- 2023Structure-CLIP: Towards Scene Graph Knowledge to Enhance Multi-modal Structured Representations6 May 2023
- 2022Chunk-aware Alignment and Lexical Constraint for Visual Entailment with Natural Language Explanations23 Jul 2022
- 2022PEVL: Position-enhanced Pre-training and Prompt Tuning for Vision-language Models23 May 2022
- 2022Deep Learning Approaches on Image Captioning: A Review31 Jan 2022
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphscited by 44
- 2024Diffusion Models in 3D Vision: A Surveycited by 11
- 2022Complex Scene Image Editing by Scene Graph Comprehensioncited by 7
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Modelscited by 4
- 2026Dependency-Aware Discrete Diffusion for Scene Graph Generationcited by 0
- 2026Modular Diffusion Models for Structured Visual Recognitioncited by 0
- 2026HyperDCM: Dynamic Cluster Memory Replay in Hyperbolic Space for Continual Robotic Navigation Across Scenescited by 0
- 2026HyperDCM: Dynamic Cluster Memory Replay in Hyperbolic Space for Continual Robotic Navigation Across Scenes4 Jul 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Dependency-Aware Discrete Diffusion for Scene Graph Generation9 May 2026
- 2024Diffusion Models in 3D Vision: A Survey7 Oct 2024
- 2024Lane Graph Extraction from Aerial Imagery via Lane Segmentation Refinement with Diffusion Models1 May 2024
- 2023Act As You Wish: Fine-Grained Control of Motion Diffusion Model with Hierarchical Semantic Graphs2 Nov 2023
- 2022Complex Scene Image Editing by Scene Graph Comprehension24 Mar 2022
- 2023CoT3DRef: Chain-of-Thoughts Data-Efficient 3D Visual Groundingcited by 13
- 2023A Novel Neural-symbolic System under Statistical Relational Learningcited by 1
- 2022Commonsense Reasoning for Identifying and Understanding the Implicit Need of Help and Synthesizing Assistive Actionscited by 0
- 2026Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directionscited by 0
- 2026Commonsense Reasoning in Computer Vision: Foundations, Recent Advancements, and Future Directions4 Sep 2026
- 2023CoT3DRef: Chain-of-Thoughts Data-Efficient 3D Visual Grounding10 Oct 2023
- 2023A Novel Neural-symbolic System under Statistical Relational Learning16 Sep 2023
- 2022Commonsense Reasoning for Identifying and Understanding the Implicit Need of Help and Synthesizing Assistive Actions23 Feb 2022
- 2022Vision GNN: An Image is Worth Graph of Nodescited by 185
- 2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
- 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
- 2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
- 2022Panoptic Scene Graph Generationcited by 114
- 2021Energy-Based Learning for Scene Graph Generationcited by 104
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
- 2021Spatial-Temporal Transformer for Dynamic Scene Graph Generationcited by 95
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2021Holistic 3D Scene Understanding from a Single Image with Implicit Representationcited by 94
- 2021Chest ImaGenome Dataset for Clinical Reasoningcited by 89
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
12 most cited of 270 All 270 (JSON)
- 2026GraphWrit3R: End-to-End 3D Scene Graph Writing25 Sep 2026
- 2026Geometric 2D Scene Graph Generation24 Jul 2026
- 2026Learning Structured Visual Compositional Representations for Weakly Supervised Referring Expression Comprehension6 Jul 2026
- 2026RelWitness: Open-Vocabulary 3D Scene Graph Generation with Visual-Geometric Relation Witnesses20 May 2026
- 2026Multi-hop Relational Contrastive Learning: Extending Spatial Contrastive Pre-training Beyond Pairwise Relations15 May 2026
- 2026ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026HSG: Hyperbolic Scene Graph19 Apr 2026
- 2026STRNet: Visual Navigation with Spatio-Temporal Representation through Dynamic Graph Aggregation3 Apr 2026
- 2026ReLaGS: Relational Language Gaussian Splatting18 Mar 2026
- 2026REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation6 Mar 2026
- 2025With Great Context Comes Great Prediction Power: Classifying Objects via Geo-Semantic Scene Graphs28 Dec 2025
12 newest of 270 All 270 (JSON)