Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generation
Not on the map. Why?
Abstract (arXiv)
Scene graph generation is an important visual understanding task with a broad range of vision applications. Despite recent tremendous progress, it remains challenging due to the intrinsic long-tailed class distribution and large intra-class variation. To address these issues, we introduce a novel confidence-aware bipartite graph neural network with adaptive message propagation mechanism for unbiased scene graph generation. In addition, we propose an efficient bi-level data resampling strategy to alleviate the imbalanced data distribution problem in training our graph network. Our approach achieves superior or competitive performance over previous methods on several challenging datasets, including Visual Genome, Open Images V4/V6, demonstrating its effectiveness and generality.
Key facts. Cited by 137 papers in the map (data through 7 Oct 2026). Builds on 51 of its 63 references that are in the map. First posted on arXiv 1 Apr 2021.
Builds on
51 of 63 references.
References · 51
- 2017Attention Is All You Needcited by 59,932
- 2016Semi-Supervised Classification with Graph Convolutional Networkscited by 11,282
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2017Inductive Representation Learning on Large Graphscited by 6,284
- 2015SSD: Single Shot MultiBox Detectorcited by 3,125
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,646
- 2016Aggregated Residual Transformations for Deep Neural Networkscited by 2,540
- 2017Non-local Neural Networkscited by 2,290
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,239
- 2019LVIS: A Dataset for Large Vocabulary Instance Segmentationcited by 1,215
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 987
- 2019Decoupling Representation and Classifier for Long-Tailed Recognitioncited by 806
38 more
- 2015Gated Graph Sequence Neural Networkscited by 792
- 2019Heterogeneous Graph Attention Networkcited by 732
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 704
- 2018Exploring the Limits of Weakly Supervised Pretrainingcited by 604
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 413
- 2019BBN: Bilateral-Branch Network with Cumulative Learning for Long-Tailed Visual Recognitioncited by 403
- 2018Dynamic Few-Shot Visual Learning without Forgettingcited by 385
- 2020Unbiased Scene Graph Generation from Biased Trainingcited by 355
- 2018Graph R-CNN for Scene Graph Generationcited by 296
- 2020Equalization Loss for Long-Tailed Object Recognitioncited by 285
- 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 258
- 2018Auto-Encoding Scene Graphs for Image Captioningcited by 254
- 2015Cost Sensitive Learning of Deep Feature Representations from Imbalanced Datacited by 167
- 2020GPS-Net: Graph Property Sensing Network for Scene Graph Generationcited by 165
- 2019Knowledge-Embedded Routing Network for Scene Graph Generationcited by 163
- 2017Scene Graph Generation from Objects, Phrases and Region Captionscited by 154
- 2020Overcoming Classifier Imbalance for Long-tail Object Detection with Balanced Group Softmaxcited by 152
- 2016Graph-Structured Representations for Visual Question Answeringcited by 123
- 2018Explainable and Explicit Visual Reasoning over Scene Graphscited by 103
- 2019Scene Graph Generation with External Knowledge and Image Reconstructioncited by 102
- 2017Detecting Visual Relationships with Deep Relational Networkscited by 97
- 2018Rethinking Knowledge Graph Propagation for Zero-Shot Learningcited by 87
- 2020Bridging Knowledge Graphs to Generate Scene Graphscited by 86
- 2018Grid R-CNNcited by 85
- 2018Factorizable Net: An Efficient Subgraph-based Framework for Scene Graph Generationcited by 78
- 2020PCPL: Predicate-Correlation Perception Learning for Unbiased Scene Graph Generationcited by 75
- 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 72
- 2020Learning to Segment the Tailcited by 54
- 2020Scene Graph Reasoning for Visual Question Answeringcited by 49
- 2020Learning Visual Commonsense for Robust Scene Graph Generationcited by 47
- 2018LinkNet: Relational Embedding for Scene Graphcited by 45
- 2018Zoom-Net: Mining Deep Feature Interactions for Visual Relationship Recognitioncited by 41
- 2020Graph Density-Aware Losses for Novel Compositions in Scene Graph Generationcited by 31
- 2019LatentGNN: Learning Efficient Non-local Relations for Visual Recognitioncited by 25
- 2019Dynamically Pruned Message Passing Networks for Large-Scale Knowledge Graph Reasoningcited by 23
- 2020Sketching Image Gist: Human-Mimetic Hierarchical Scene Graph Generationcited by 19
- 2020Tackling the Unannotated: Scene Graph Generation with Bias-Reduced Modelscited by 19
50 most cited of 51 All 51 (JSON)
Built on by
Citing papers per year: 2021: 6; 2022: 34; 2023: 45; 2024: 27; 2025: 13; 2026: 12.
137 papers.
Sort:
By area:
- 2021CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Modelscited by 182
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2022Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generationcited by 67
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2021Learning of Visual Relations: The Devil is in the Tailscited by 65
- 2022The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generationcited by 60
- 2022Fine-Grained Scene Graph Generation with Data Transfercited by 57
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
- 2021Structured Sparse R-CNN for Direct Scene Graph Generationcited by 44
38 more
- 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
- 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Modelscited by 43
- 2023Panoptic Scene Graph Generation with Semantics-Prototype Learningcited by 42
- 2023Unbiased Scene Graph Generation in Videoscited by 38
- 2023Prototype-based Embedding Network for Scene Graph Generationcited by 37
- 2023Visually-Prompted Language Model for Fine-Grained Scene Graph Generation in an Open Worldcited by 35
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagerycited by 31
- 2023LLM4SGG: Large Language Models for Weakly Supervised Scene Graph Generationcited by 30
- 2023Expanding Scene Graph Boundaries: Fully Open-vocabulary Scene Graph Generation via Visual-Concept Alignment and Retentioncited by 29
- 2022RU-Net: Regularized Unrolling Network for Scene Graph Generationcited by 28
- 2022Fine-Grained Predicates Learning for Scene Graph Generationcited by 27
- 2022Iterative Scene Graph Generationcited by 24
- 2023Devil's on the Edges: Selective Quad Attention for Scene Graph Generationcited by 23
- 2022Resistance Training using Prior Bias: toward Unbiased Scene Graph Generationcited by 22
- 2022HL-Net: Heterophily Learning Network for Scene Graph Generationcited by 22
- 2022Iterative Scene Graph Generation with Generative Transformerscited by 22
- 2022Meta Spatio-Temporal Debiasing for Video Scene Graph Generationcited by 20
- 2023SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstructioncited by 20
- 2022NICEST: Noisy Label Correction and Training for Robust Scene Graph Generationcited by 19
- 2023HiLo: Exploiting High Low Frequency Relations for Unbiased Panoptic Scene Graph Generationcited by 19
- 2023Vision Relation Transformer for Unbiased Scene Graph Generationcited by 18
- 2023Lang3DSG: Language-based contrastive pre-training for 3D Scene Graph predictioncited by 18
- 2022Unbiased Directed Object Attention Graph for Object Navigationcited by 17
- 2022Unbiased Heterogeneous Scene Graph Generation with Relation-aware Message Passing Neural Networkcited by 17
- 2023Pair then Relation: Pair-Net for Panoptic Scene Graph Generationcited by 17
- 2024Scene Graph Generation with Role-Playing Large Language Modelscited by 16
- 2022Hierarchical Memory Learning for Fine-Grained Scene Graph Generationcited by 15
- 2023Compositional Feature Augmentation for Unbiased Scene Graph Generationcited by 15
- 2023Towards a Unified Transformer-based Framework for Scene Graph Generation and Human-object Interaction Detectioncited by 15
- 2022Adaptive Fine-Grained Predicates Learning for Scene Graph Generationcited by 14
- 2022Label Semantic Knowledge Distillation for Unbiased Scene Graph Generationcited by 14
- 2025A Causal Adjustment Module for Debiasing Scene Graph Generationcited by 14
- 2023Unified Visual Relationship Detection with Vision and Language Modelscited by 13
- 2023VLPrompt: Vision-Language Prompting for Panoptic Scene Graph Generationcited by 12
- 2024Adaptive Self-training Framework for Fine-grained Scene Graph Generationcited by 11
- 2024Can Transformers Capture Spatial Relations between Objects?cited by 11
- 2025Universal Scene Graph Generationcited by 11
- 2022Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generationcited by 10
50 most cited of 137 All 137 (JSON)
- 2026Geometric 2D Scene Graph Generation24 Jul 2026
- 2026T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video23 Jul 2026
- 2026Revisiting Scene Graph Generation from the Perspective of Detector-Conditioned Reachability7 Jul 2026
- 2026From Scene-Centric to Observer-Centric: Modeling Observer-Aware Relations for 3D Scene Graph Generation25 Jun 2026
- 2026Modular Diffusion Models for Structured Visual Recognition21 Jun 2026
- 2026Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs4 Jun 2026
- 2026Learning Context-Conditioned Predicate Semantics via Prototype Feedback28 May 2026
- 2026RelWitness: Open-Vocabulary 3D Scene Graph Generation with Visual-Geometric Relation Witnesses20 May 2026
- 2026ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation6 Mar 2026
- 2026Salience-SGG: Enhancing Unbiased Scene Graph Generation with Iterative Salience Estimation13 Jan 2026
38 more
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Grounding30 Nov 2025
- 2025Reusing Attention for One-stage Lane Topology Understanding23 Jul 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025Hallucinate, Ground, Repeat: A Framework for Generalized Visual Relationship Detection6 Jun 2025
- 2025A Reverse Causal Framework to Mitigate Spurious Correlations for Debiasing Scene Graph Generation29 May 2025
- 2025From Data to Modeling: Fully Open-vocabulary Scene Graph Generation26 May 2025
- 2025Leveraging Static Relationships for Intra-Type and Inter-Type Message Passing in Video Question Answering3 Apr 2025
- 2025PRISM-0: A Predicate-Rich Scene Graph Generation Framework for Zero-Shot Open-Vocabulary Tasks1 Apr 2025
- 2025A Causal Adjustment Module for Debiasing Scene Graph Generation22 Mar 2025
- 2025Universal Scene Graph Generation19 Mar 2025
- 2025Conformal Prediction and MLLM aided Uncertainty Quantification in Scene Graph Generation18 Mar 2025
- 2025Dynamic Relation Inference via Verb Embeddings17 Mar 2025
- 2025UniQ: Unified Decoder with Task-specific Queries for Efficient Scene Graph Generation10 Jan 2025
- 2024RA-SGG: Retrieval-Augmented Scene Graph Generation Framework via Multi-Prototype Learning17 Dec 2024
- 2024Unbiased Scene Graph Generation by Type-Aware Message Passing on Heterogeneous and Dual Graphs20 Nov 2024
- 2024Scene Graph Generation with Role-Playing Large Language Models20 Oct 2024
- 2024Hydra-SGG: Hybrid Relation Assignment for One-stage Scene Graph Generation16 Sep 2024
- 2024Ensemble Predicate Decoding for Unbiased Scene Graph Generation26 Aug 2024
- 2024Towards Flexible Visual Relationship Segmentation15 Aug 2024
- 2024Fine-Grained Scene Graph Generation via Sample-Level Bias Prediction27 Jul 2024
- 2024BCTR: Bidirectional Conditioning Transformer for Scene Graph Generation26 Jul 2024
- 2024Semantic Diversity-aware Prototype-based Learning for Unbiased Scene Graph Generation22 Jul 2024
- 2024From Easy to Hard: Learning Curricular Shape-aware Features for Robust Panoptic Scene Graph Generation12 Jul 2024
- 2024Enhanced Data Transfer Cooperating with Artificial Triplets for Scene Graph Generation27 Jun 2024
- 2024STAR: A First-Ever Dataset and A Large-Scale Benchmark for Scene Graph Generation in Large-Size Satellite Imagery13 Jun 2024
- 2024ReCon1M:A Large-scale Benchmark Dataset for Relation Comprehension in Remote Sensing Imagery10 Jun 2024
- 2024Leveraging Predicate and Triplet Learning for Scene Graph Generation4 Jun 2024
- 2024REACT: Real-time Efficiency and Accuracy Compromise for Tradeoffs in Scene Graph Generation25 May 2024
- 2024Scene Graph Generation Strategy with Co-occurrence Knowledge and Learnable Term Frequency21 May 2024
- 2024AUG: A New Dataset and An Efficient Model for Aerial Image Urban Scene Graph Generation11 Apr 2024
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generation2 Apr 2024
- 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models1 Apr 2024
- 2024Predicate Debiasing in Vision-Language Models Integration for Scene Graph Generation Enhancement24 Mar 2024
- 2024Can Transformers Capture Spatial Relations between Objects?1 Mar 2024
- 2024S^2Former-OR: Single-Stage Bi-Modal Transformer for Scene Graph Generation in OR22 Feb 2024
- 2024Towards Lifelong Scene Graph Generation with Knowledge-ware In-context Prompt Learning26 Jan 2024
- 2024Image Synthesis with Graph Conditioning: CLIP-Guided Diffusion Models for Scene Graphs25 Jan 2024
- 2024SGTR+: End-to-end Scene Graph Generation with Transformer23 Jan 2024
50 newest of 137 All 137 (JSON)
- 2021CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Modelscited by 182
- 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Modelscited by 43
- 2024Scene Graph Generation with Role-Playing Large Language Modelscited by 16
- 2024Predicate Debiasing in Vision-Language Models Integration for Scene Graph Generation Enhancementcited by 1
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Groundingcited by 0
- 2025SceneProp: Combining Neural Network and Markov Random Field for Scene-Graph Grounding30 Nov 2025
- 2024Scene Graph Generation with Role-Playing Large Language Models20 Oct 2024
- 2024From Pixels to Graphs: Open-Vocabulary Scene Graph Generation with Vision-Language Models1 Apr 2024
- 2024Predicate Debiasing in Vision-Language Models Integration for Scene Graph Generation Enhancement24 Mar 2024
- 2021CPT: Colorful Prompt Tuning for Pre-trained Vision-Language Models24 Sep 2021
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 102
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 95
- 2022Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generationcited by 67
- 2022Relationformer: A Unified Framework for Image-to-Graph Generationcited by 67
- 2021Learning of Visual Relations: The Devil is in the Tailscited by 65
- 2022The Devil is in the Labels: Noisy Label Correction for Robust Scene Graph Generationcited by 60
- 2022Fine-Grained Scene Graph Generation with Data Transfercited by 57
- 2022A Survey on Graph Neural Networks and Graph Transformers in Computer Vision: A Task-Oriented Perspectivecited by 56
- 2022Towards Open-vocabulary Scene Graph Generation with Prompt-based Finetuningcited by 54
- 2024EGTR: Extracting Graph from Transformer for Scene Graph Generationcited by 45
- 2021Structured Sparse R-CNN for Direct Scene Graph Generationcited by 44
- 2023RLIPv2: Fast Scaling of Relational Language-Image Pre-trainingcited by 44
12 most cited of 127 All 127 (JSON)
- 2026Geometric 2D Scene Graph Generation24 Jul 2026
- 2026T-STAR: A Large-Scale Benchmark for Spatio-Temporal Panoptic Scene Graph Generation in Satellite Video23 Jul 2026
- 2026Revisiting Scene Graph Generation from the Perspective of Detector-Conditioned Reachability7 Jul 2026
- 2026From Scene-Centric to Observer-Centric: Modeling Observer-Aware Relations for 3D Scene Graph Generation25 Jun 2026
- 2026Unveiling the Unknown: Open Vocabulary Object Detection with Scene Graphs4 Jun 2026
- 2026Learning Context-Conditioned Predicate Semantics via Prototype Feedback28 May 2026
- 2026RelWitness: Open-Vocabulary 3D Scene Graph Generation with Visual-Geometric Relation Witnesses20 May 2026
- 2026ReLIC-SGG: Relation Lattice Completion for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026CAGE-SGG: Counterfactual Active Graph Evidence for Open-Vocabulary Scene Graph Generation24 Apr 2026
- 2026REACT++: Efficient Cross-Attention for Real-Time Scene Graph Generation6 Mar 2026
- 2026Salience-SGG: Enhancing Unbiased Scene Graph Generation with Iterative Salience Estimation13 Jan 2026
- 2025Reusing Attention for One-stage Lane Topology Understanding23 Jul 2025
12 newest of 127 All 127 (JSON)