mlsanityData to 7 Oct 2026

Semi-parametric Image Synthesis

arXiv 1804.10992 ↗First posted 29 Apr 2018cs.CV cs.AI cs.GRcited by 50

Not on the map. Why?

Abstract (arXiv)

We present a semi-parametric approach to photographic image synthesis from semantic layouts. The approach combines the complementary strengths of parametric and nonparametric techniques. The nonparametric component is a memory bank of image segments constructed from a training set of images. Given a novel semantic layout at test time, the memory bank is used to retrieve photographic references that are provided as source material to a deep network. The synthesis is performed by a deep network that draws on the provided photographic material. Experiments on multiple semantic segmentation datasets show that the presented approach yields considerably more realistic images than recent purely parametric techniques. The results are shown in the supplementary video at https://youtu.be/U4Q98lenGLQ

Key facts. Cited by 50 papers in the map (data through 7 Oct 2026). First posted on arXiv 29 Apr 2018.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 17; 2022: 15; 2023: 11; 2024: 4; 2025: 2; 2026: 1.

50 papers.

Sort:

By area:

  1. 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 477
  2. 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 372
  3. 2022Semantic Image Synthesis via Diffusion Modelscited by 131
  4. 2021Instance-Conditioned GANcited by 119
  5. 2021GeoSim: Realistic Video Simulation via Geometry-Aware Composition for Self-Drivingcited by 75
  6. 2021Enhancing Photorealism Enhancementcited by 74
  7. 2023Freestyle Layout-to-Image Synthesiscited by 67
  8. 2023ImageBrush: Learning Visual In-Context Instructions for Exemplar-Based Image Manipulationcited by 59
  9. 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
  10. 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
  11. 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
  12. 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
38 more
  1. 2021Image Synthesis via Semantic Compositioncited by 45
  2. 2022Guided Co-Modulated GAN for 360deg Field of View Extrapolationcited by 32
  3. 2023Retrieving-to-Answer: Zero-Shot Video Question Answering with Frozen Large Language Modelscited by 27
  4. 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
  5. 2024PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesiscited by 20
  6. 2022Semantic-shape Adaptive Feature Modulation for Semantic Image Synthesiscited by 16
  7. 2022Retrieval-based Spatially Adaptive Normalization for Semantic Image Synthesiscited by 15
  8. 2021SinIR: Efficient General Image Manipulation with Single Image Reconstructioncited by 13
  9. 2022Memory-Driven Text-to-Image Generationcited by 10
  10. 2021A multi-stage GAN for multi-organ chest X-ray image generation and segmentationcited by 8
  11. 2021Deep Image Synthesis from Intuitive User Input: A Review and Perspectivescited by 8
  12. 2021Layout-to-Image Translation with Double Pooling Generative Adversarial Networkscited by 8
  13. 2021USIS: Unsupervised Semantic Image Synthesiscited by 8
  14. 2022Local and Global GANs with Semantic-Aware Upsampling for Image Generationcited by 8
  15. 2023Edge Guided GANs with Multi-Scale Contrastive Learning for Semantic Image Synthesiscited by 8
  16. 2022PatchRD: Detail-Preserving Shape Completion by Learning Patch Retrieval and Deformationcited by 7
  17. 2022Dual Pyramid Generative Adversarial Networks for Semantic Image Synthesiscited by 7
  18. 2024SCP-Diff: Spatial-Categorical Joint Prior for Diffusion Based Semantic Image Synthesiscited by 7
  19. 2024M2DA: Multi-Modal Fusion Transformer Incorporating Driver Attention for Autonomous Drivingcited by 7
  20. 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistancecited by 7
  21. 2022DeepPortraitDrawing: Generating Human Body Images from Freehand Sketchescited by 5
  22. 2023Controllable Image Generation via Collage Representationscited by 5
  23. 2022Semi-parametric Makeup Transfer via Semantic-aware Correspondencecited by 4
  24. 2025MagicQuillV2: Precise and Interactive Image Editing with Layered Visual Cuescited by 4
  25. 2021Remember What You have drawn: Semantic Image Manipulation with Memorycited by 3
  26. 2023FIANCEE: Faster Inference of Adversarial Networks via Conditional Early Exitscited by 3
  27. 2023Inferring and Leveraging Parts from Object Shape for Improving Semantic Image Synthesiscited by 2
  28. 2023Learning to Generate Training Datasets for Robust Semantic Segmentationcited by 2
  29. 2023Controllable Multi-domain Semantic Artwork Synthesiscited by 2
  30. 2021Guiding GANs: How to control non-conditional pre-trained GANs for conditional image generationcited by 1
  31. 2021SuperStyleNet: Deep Image Synthesis with Superpixel Based Style Encodercited by 1
  32. 2022Spatially Multi-conditional Image Generationcited by 1
  33. 2022Deepfake histological images for enhancing digital pathologycited by 1
  34. 2025Adversarial Appearance Learning in Augmented Cityscapes for Pedestrian Recognition in Autonomous Drivingcited by 1
  35. 2026Designing to Forget: Deep Semi-parametric Models for Unlearningcited by 1
  36. 2021MOC-GAN: Mixing Objects and Captions to Generate Realistic Imagescited by 0
  37. 2022Depth-SIMS: Semi-Parametric Image and Depth Synthesiscited by 0
  38. 2023Compositional Servoing by Recombining Demonstrationscited by 0