mlsanityData to 7 Oct 2026

Semantic Image Synthesis with Spatially-Adaptive Normalization

arXiv 1903.07291 ↗First posted 18 Mar 2019cs.CV cs.AI cs.GRcited by 1,295

Not on the map. Why?

Cited by 220 in Diffusion models, but placed by its own abstract, which didn’t fit.

Abstract (arXiv)

We propose spatially-adaptive normalization, a simple but effective layer for synthesizing photorealistic images given an input semantic layout. Previous methods directly feed the semantic layout as input to the deep network, which is then processed through stacks of convolution, normalization, and nonlinearity layers. We show that this is suboptimal as the normalization layers tend to ``wash away'' semantic information. To address the issue, we propose using the input layout for modulating the activations in normalization layers through a spatially-adaptive, learned transformation. Experiments on several challenging datasets demonstrate the advantage of the proposed method over existing approaches, regarding both visual fidelity and alignment with input layouts. Finally, our model allows user control over both semantic and style. Code is available at https://github.com/NVlabs/SPADE .

Key facts. Cited by 1,295 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Mar 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 326; 2022: 261; 2023: 300; 2024: 195; 2025: 135; 2026: 78.

1,295 papers.

Sort:

By area:

  1. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  2. 2022Generative Adversarial Networkscited by 5,603
  3. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
  4. 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
  5. 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
  6. 2021Alias-Free Generative Adversarial Networkscited by 1,181
  7. 2022Diffusion Models in Vision: A Surveycited by 1,008
  8. 2023One-step Diffusion with Distribution Matching Distillationcited by 978
  9. 2022eDiff-I: Text-to-Image Diffusion Models with an Ensemble of Expert Denoiserscited by 921
  10. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
  11. 2021Domain Generalization: A Surveycited by 760
  12. 2023Zip-NeRF: Anti-Aliased Grid-Based Neural Radiance Fieldscited by 667
38 more
  1. 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 640
  2. 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 634
  3. 2021Tackling the Generative Learning Trilemma with Denoising Diffusion GANscited by 515
  4. 2023Zero-shot Image-to-Image Translationcited by 503
  5. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  6. 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
  7. 2023Towards Universal Fake Image Detectors that Generalize Across Generative Modelscited by 483
  8. 2022GET3D: A Generative Model of High Quality 3D Textured Shapes Learned from Imagescited by 446
  9. 2021Dynamic Neural Networks: A Surveycited by 405
  10. 2023Uni-ControlNet: All-in-One Control to Text-to-Image Diffusion Modelscited by 358
  11. 2021Towards Real-World Blind Face Restoration with Generative Facial Priorcited by 347
  12. 2023OmniObject3D: Large-Vocabulary 3D Object Dataset for Realistic Perception, Reconstruction and Generationcited by 324
  13. 2023DreamSim: Learning New Dimensions of Human Visual Similarity using Synthetic Datacited by 322
  14. 2023Video-P2P: Video Editing with Cross-attention Controlcited by 312
  15. 2023Training-Free Layout Control with Cross-Attention Guidancecited by 312
  16. 2022MCVD: Masked Conditional Video Diffusion for Prediction, Generation, and Interpolationcited by 307
  17. 2022AudioGen: Textually Guided Audio Generationcited by 292
  18. 2021Pose-Controllable Talking Face Generation by Implicitly Modularized Audio-Visual Representationcited by 288
  19. 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
  20. 2022Diffusion Models for Medical Image Analysis: A Comprehensive Surveycited by 269
  21. 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
  22. 2021N"UWA: Visual Synthesis Pre-training for Neural visUal World creAtioncited by 253
  23. 2021SimSwap: An Efficient Framework For High Fidelity Face Swappingcited by 243
  24. 2023LLM-grounded Diffusion: Enhancing Prompt Understanding of Text-to-Image Diffusion Models with Large Language Modelscited by 242
  25. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 222
  26. 2021Large Scale Image Completion via Co-Modulated Generative Adversarial Networkscited by 219
  27. 2023Drag Your GAN: Interactive Point-based Manipulation on the Generative Image Manifoldcited by 218
  28. 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
  29. 2021GRAM: Generative Radiance Manifolds for 3D-Aware Image Generationcited by 216
  30. 2021More Control for Free! Image Synthesis with Semantic Diffusion Guidancecited by 211
  31. 2022The Role of ImageNet Classes in Fr'echet Inception Distancecited by 211
  32. 2023Controlling Text-to-Image Diffusion by Orthogonal Finetuningcited by 207
  33. 2021Projected GANs Converge Fastercited by 204
  34. 2024LivePortrait: Efficient Portrait Animation with Stitching and Retargeting Controlcited by 202
  35. 2021GAN Prior Embedded Network for Blind Face Restoration in the Wildcited by 197
  36. 2023Dreamix: Video Diffusion Models are General Video Editorscited by 189
  37. 2024A Sanity Check for AI-generated Image Detectioncited by 187
  38. 2023StableVideo: Text-driven Consistency-aware Diffusion Video Editingcited by 182

50 most cited of 1,295 All 1,295 (JSON)