GraPLUS: Graph-based Placement Using Semantics for Image Composition
Not on the map. Why?
Abstract (arXiv)
We present GraPLUS (Graph-based Placement Using Semantics), a novel framework for plausible object placement in images that leverages scene graphs and large language models. Our approach uniquely combines graph-structured scene representation with semantic understanding to determine contextually appropriate object positions. The framework employs GPT-2 to transform categorical node and edge labels into rich semantic embeddings that capture both definitional characteristics and typical spatial contexts, enabling nuanced understanding of object relationships and placement patterns. GraPLUS achieves placement accuracy of 92.1% and an FID score of 28.83 on the OPA dataset, outperforming state-of-the-art methods by 8.1% while maintaining competitive visual quality. In human evaluation studies involving 964 samples assessed by 19 participants, our method was preferred in 52.1% of cases, significantly outperforming previous approaches. The framework's key innovations include: (i) leveraging pre-trained scene graph models that transfer knowledge from other domains, (ii) edge-aware graph neural networks that process scene semantics through structured relationships, (iii) a cross-modal attention mechanism that aligns categorical embeddings with enhanced scene features, and (iv) a multiobjective training strategy incorporating semantic consistency constraints.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 13 of its 22 references that are in the map. First posted on arXiv 20 Mar 2025.
Builds on
13 of 22 references.
References · 13
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2015Spatial Transformer Networkscited by 1,429
- 2017Neural Motifs: Scene Graph Parsing with Global Contextcited by 414
- 2020Unbiased Scene Graph Generation from Biased Trainingcited by 356
- 2019InstaBoost: Boosting Instance Segmentation via Probability Map Guided Copy-Pastingcited by 95
- 2019Learning to Generate Synthetic Data via Compositingcited by 52
- 2017Synthesizing Training Data for Object Detection in Indoor Scenescited by 48
- 2018Learning to Segment via Cut-and-Pastecited by 42
- 2022Learning Object Placement via Dual-path Graph Completioncited by 20
- 2019Data Augmentation for Object Detection via Progressive and Selective Instance-Switchingcited by 18
- 2023TopNet: Transformer-based Object Placement Network for Image Compositingcited by 16
- 2018What and Where: A Context-based Recommendation System for Object Insertioncited by 14
1 more
Built on by
Not cited yet.