MIGS: Meta Image Generation from Scene Graphs
Not on the map. Why?
Abstract (arXiv)
Generation of images from scene graphs is a promising direction towards explicit scene generation and manipulation. However, the images generated from the scene graphs lack quality, which in part comes due to high difficulty and diversity in the data. We propose MIGS (Meta Image Generation from Scene Graphs), a meta-learning based approach for few-shot image generation from graphs that enables adapting the model to different scenes and increases the image quality by training on diverse sets of tasks. By sampling the data in a task-driven fashion, we train the generator using meta-learning on different sets of tasks that are categorized based on the scene attributes. Our results show that using this meta-learning approach for the generation of images from scene graphs achieves state-of-the-art performance in terms of image quality and capturing the semantic relationships in the scene. Project Website: https://migs2021.github.io/
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 36 of its 42 references that are in the map. First posted on arXiv 22 Oct 2021.
Builds on
36 of 42 references.
References · 36
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2016Perceptual Losses for Real-Time Style Transfer and Super-Resolutioncited by 2,694
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2018Large Scale GAN Training for High Fidelity Natural Image Synthesiscited by 2,626
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2018Demystifying MMD GANscited by 1,293
- 2020Training Generative Adversarial Networks with Limited Datacited by 1,186
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
24 more
- 2018On First-Order Meta-Learning Algorithmscited by 1,018
- 2016Generative Adversarial Text to Image Synthesiscited by 735
- 2016StackGAN: Text to Photo-realistic Image Synthesis with Stacked Generative Adversarial Networkscited by 577
- 2017Scene Graph Generation by Iterative Message Passingcited by 462
- 2018Assessing Generative Models via Precision and Recallcited by 406
- 2020SCAN: Learning to Classify Images without Labelscited by 352
- 2018Image Generation from Scene Graphscited by 324
- 2019Action Genome: Actions as Composition of Spatio-temporal Scene Graphscited by 250
- 2017Photographic Image Synthesis with Cascaded Refinement Networkscited by 223
- 2019Few-Shot Unsupervised Image-to-Image Translationcited by 222
- 2020Learning 3D Semantic Scene Graphs from 3D Indoor Reconstructionscited by 208
- 2018StoryGAN: A Sequential Conditional GAN for Story Visualizationcited by 138
- 2018Image Generation from Layoutcited by 105
- 2019Image Synthesis From Reconfigurable Layout and Stylecited by 85
- 2021Graph-to-3D: End-to-End Generation and Manipulation of 3D Scenes Using Scene Graphscited by 84
- 2020Semantic Image Manipulation Using Scene Graphscited by 82
- 2019Specifying Object Attributes and Relations in Interactive Scene Generationcited by 76
- 2018Photographic Text-to-Image Synthesis with a Hierarchically-nested Adversarial Networkcited by 64
- 2019Learning Canonical Representations for Scene Graph to Image Generationcited by 60
- 2017Pixels to Graphs by Associative Embeddingcited by 58
- 2020Object-Centric Image Generation from Layoutscited by 57
- 2019FIGR: Few-shot Image Generation with Reptilecited by 56
- 2018Mapping Images to Scene Graphs with Permutation-Invariant Structured Predictioncited by 44
- 2021Unconditional Scene Graph Generationcited by 22
Built on by
Citing papers per year: 2022: 3; 2023: 3; 2024: 1.
7 papers.
- 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesiscited by 41
- 2022Latent Graph Representations for Critical View of Safety Assessmentcited by 37
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transportcited by 24
- 2024VISAGE: Video Synthesis using Action Graphs for Surgerycited by 11
- 2023Transformer-based Image Generation from Scene Graphscited by 8
- 2022DisPositioNet: Disentangled Pose and Identity in Semantic Image Manipulationcited by 4
- 2023PRISM: Progressive Restoration for Scene Graph-based Image Manipulationcited by 3
- 2024VISAGE: Video Synthesis using Action Graphs for Surgery23 Oct 2024
- 2023PRISM: Progressive Restoration for Scene Graph-based Image Manipulation3 Nov 2023
- 2023SceneGenie: Scene Graph Guided Diffusion Models for Image Synthesis28 Apr 2023
- 2023Transformer-based Image Generation from Scene Graphs8 Mar 2023
- 2022Latent Graph Representations for Critical View of Safety Assessment8 Dec 2022
- 2022DisPositioNet: Disentangled Pose and Identity in Semantic Image Manipulation10 Nov 2022
- 2022Bending Graphs: Hierarchical Shape Matching using Gated Optimal Transport3 Feb 2022