Geometric 2D Scene Graph Generation
Not on the map. Why?
Abstract (arXiv)
In production processes for consumer products, assembly instructions are essential not only for planning but also for executing the production process. Likewise in robotics, it is crucial for an assembly robot to understand how components fit together and can be assembled. To facilitate these tasks, we contribute a method for constructing scene graphs to represent and characterize assembly relationships between components. Our approach does not rely on semantic data and is capable of handling a very small dataset. To realize this, the output of a Faster R-CNN model is used to create geometric representations, which are then processed by a transformer architecture to generate an adjacency matrix. This matrix serves as input to a Siamese network that uses message passing based on an attentional graph convolutional network (aGCN) architecture to characterize the connections between the components. We validate our method on a study dataset of toy model components which can be assembled into transportation vehicles.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 40 of its 49 references that are in the map. First posted on arXiv 24 Jul 2026.
Builds on
40 of 49 references.
References · 40
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2020Deformable DETR: Deformable Transformers for End-to-End Object Detectioncited by 3,422
- 2020Exploring Simple Siamese Representation Learningcited by 2,866
- 2020Supervised Contrastive Learningcited by 2,829
- 2020Graph Contrastive Learning with Augmentationscited by 1,208
- 2019Adversarial Examples Are Not Bugs, They Are Featurescited by 953
- 2019DropEdge: Towards Deep Graph Convolutional Networks on Node Classificationcited by 680
- 2021Do Vision Transformers See Like Convolutional Neural Networks?cited by 675
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
- 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
28 more
- 2016Visual Relationship Detection with Language Priorscited by 334
- 2018Graph R-CNN for Scene Graph Generationcited by 298
- 2018Learning to Compose Dynamic Tree Structures for Visual Contextscited by 259
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
- 2020GPS-Net: Graph Property Sensing Network for Scene Graph Generationcited by 166
- 2017Scene Graph Generation from Objects, Phrases and Region Captionscited by 154
- 2021Bipartite Graph Network with Adaptive Message Passing for Unbiased Scene Graph Generationcited by 137
- 2021Global Self-Attention as a Replacement for Graph Convolutioncited by 114
- 2021SGTR: End-to-end Scene Graph Generation with Transformercited by 103
- 2022RelTR: Relation Transformer for Scene Graph Generationcited by 96
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2018Attentive Relational Networks for Mapping Images to Scene Graphscited by 73
- 2022Simple Contrastive Graph Clusteringcited by 56
- 2020KeepAugment: A Simple Information-Preserving Data Augmentation Approachcited by 52
- 2023SGAligner : 3D Scene Alignment with Scene Graphscited by 30
- 2023GRID: Scene-Graph-based Instruction-driven Robotic Task Planningcited by 27
- 2024GraphAD: Interaction Scene Graph for End-to-end Autonomous Drivingcited by 25
- 2019The Group Loss for Deep Metric Learningcited by 20
- 2023Permutation Equivariance of Transformers and Its Applicationscited by 20
- 2018Graph Partition Neural Networks for Semi-Supervised Classificationcited by 17
- 2016DeepSetNet: Predicting Sets with Deep Neural Networkscited by 15
- 2024Depth-Wise Convolutions in Vision Transformers for Efficient Training on Small Datasetscited by 14
- 2018Deep Graph Laplacian Regularization for Robust Denoising of Real Imagescited by 13
- 2020Learn to Predict Sets Using Feed-Forward Neural Networkscited by 10
- 2020Understanding Dynamic Scenes using Graph Convolution Networkscited by 10
- 2023Transformer-based Image Generation from Scene Graphscited by 8
- 2020Time for a Background Check! Uncovering the impact of Background Features on Deep Neural Networkscited by 5
- 2023Local Structure-aware Graph Contrastive Representation Learningcited by 4
Built on by
Not cited yet.