Data to 7 Oct 2026

Semantic Image Manipulation Using Scene Graphs

arXiv 2004.03677 ↗First posted 7 Apr 2020cs.CVcited by 82

Not on the map. Why?

Abstract (arXiv)

Image manipulation can be considered a special case of image generation where the image to be produced is a modification of an existing image. Image generation and manipulation have been, for the most part, tasks that operate on raw pixels. However, the remarkable progress in learning rich image and object representations has opened the way for tasks such as text-to-image or layout-to-image generation that are mainly driven by semantics. In our work, we address the novel problem of image manipulation from scene graphs, in which a user can edit images by merely applying changes in the nodes or edges of a semantic graph that is generated from the image. Our goal is to encode image information in a given constellation and from there on generate new constellations, such as replacing objects or even changing relationships between objects, while respecting the semantics and style from the original image. We introduce a spatio-semantic scene graph network that does not require direct supervision for constellation changes or image edits. This makes it possible to train the system from existing real-world datasets with no additional annotation effort.

Key facts. Cited by 82 papers in the map (data through 7 Oct 2026). First posted on arXiv 7 Apr 2020.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 12; 2022: 23; 2023: 21; 2024: 11; 2025: 10; 2026: 5.

82 papers.

Sort:

By area:

2022DiffEdit: Diffusion-based semantic image editing with mask guidancecited by 643
2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
2021SceneGraphFusion: Incremental 3D Scene Graph Prediction from RGB-D Sequencescited by 159
2021PSCC-Net: Progressive Spatio-Channel Correlation Network for Image Manipulation Detection and Localizationcited by 133
2021A Comprehensive Survey of Scene Graphs: Generation and Applicationcited by 125
2022Panoptic Scene Graph Generationcited by 114
2023Street-View Image Generation from a Bird's-Eye View Layoutcited by 102
2023Motion-Conditioned Diffusion Model for Controllable Video Synthesiscited by 99
2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 83
2022ObjectFormer for Image Manipulation Detection and Localizationcited by 78
2022Neo-GNNs: Neighborhood Overlap-aware Graph Neural Networks for Link Predictioncited by 78
2022Stacked Hybrid-Attention and Group Collaborative Learning for Unbiased Scene Graph Generationcited by 67

38 more

2024EchoScene: Indoor Scene Generation via Information Echo over Scene Graph Diffusioncited by 66
2021Learning to Generate Scene Graph from Natural Language Supervisioncited by 64
2021Neuro-Symbolic Artificial Intelligence: Current Trendscited by 54
2023CommonScenes: Generating Commonsense 3D Indoor Scenes with Scene Graph Diffusioncited by 54
20224D-OR: Semantic Scene Graphs for OR Domain Modelingcited by 49
2022Modeling Image Composition for Complex Scene Generationcited by 43
2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
2023Incremental 3D Semantic Scene Graph Prediction from RGB Sequencescited by 39
2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
2022FlexIT: Towards Flexible Semantic Image Translationcited by 28
2023SG-Bot: Object Rearrangement via Coarse-to-Fine Robotic Imagination on Scene Graphscited by 24
2021Unconditional Scene Graph Generationcited by 22
2023SGRec3D: Self-Supervised 3D Scene Graph Learning via Object-Level Scene Reconstructioncited by 20
2023TextPSG: Panoptic Scene Graph Generation from Textual Descriptionscited by 14
2023Encoding Surgical Videos as Latent Spatiotemporal Graphs for Object and Anatomy-Driven Reasoningcited by 14
2024Latent Drifting in Diffusion Models for Counterfactual Medical Image Synthesiscited by 13
2023Text-to-image Editing by Image Information Removalcited by 12
2024Towards Scene Graph Anticipationcited by 10
2024SGEdit: Bridging LLM with Text2Image Generative Model for Scene Graph-based Image Editingcited by 10
2022Learning Neuro-symbolic Programs for Language Guided Robot Manipulationcited by 9
2023Environment-Invariant Curriculum Relation Learning for Fine-Grained Scene Graph Generationcited by 9
2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 9
2024Leveraging Predicate and Triplet Learning for Scene Graph Generationcited by 8
2021MIGS: Meta Image Generation from Scene Graphscited by 7
2022Complex Scene Image Editing by Scene Graph Comprehensioncited by 7
2021Multimodal Semantic Scene Graphs for Holistic Modeling of Surgical Procedurescited by 6
2022Incremental Object Grounding Using Scene Graphscited by 6
2021Scene Graph Embeddings Using Relative Similarity Supervisioncited by 5
2023TrainFors: A Large Benchmark Training Dataset for Image Manipulation Detection and Localizationcited by 5
2025PRISM-0: A Predicate-Rich Scene Graph Generation Framework for Zero-Shot Open-Vocabulary Taskscited by 5
2025Statistical Confidence Rescoring for Robust 3D Scene Graph Generation from Multi-View Imagescited by 5
2022"The Pedestrian next to the Lamppost" Adaptive Object Graphs for Better Instantaneous Mappingcited by 4
2022DisPositioNet: Disentangled Pose and Identity in Semantic Image Manipulationcited by 4
2024Joint Generative Modeling of Grounded Scene Graphs and Images via Diffusion Modelscited by 4
2025From Vision To Language through Graph of Events in Space and Time: An Explainable Self-supervised Approachcited by 4
2022ASSET: Autoregressive Semantic Scene Editing with Transformers at High Resolutionscited by 3
2022Context-aware Mixture-of-Experts for Unbiased Scene Graph Generationcited by 3
2023Location-Free Scene Graph Generationcited by 3

50 most cited of 82 All 82 (JSON)