SEAN: Image Synthesis with Semantic Region-Adaptive Normalization
Not on the map. Why?
Cited by 28 in Diffusion models, but placed by its own abstract, which didn’t fit.
Abstract (arXiv)
We propose semantic region-adaptive normalization (SEAN), a simple but effective building block for Generative Adversarial Networks conditioned on segmentation masks that describe the semantic regions in the desired output image. Using SEAN normalization, we can build a network architecture that can control the style of each semantic region individually, e.g., we can specify one style reference image per region. SEAN is better suited to encode, transfer, and synthesize style than the best previous method in terms of reconstruction quality, variability, and visual quality. We evaluate SEAN on multiple datasets and report better quantitative metrics (e.g. FID, PSNR) than the current state of the art. SEAN also pushes the frontier of interactive image editing. We can interactively edit images by changing segmentation masks or the style for any given region. We can also interpolate styles from two reference images per region.
Key facts. Cited by 253 papers in the map (data through 14 Oct 2026). First posted on arXiv 28 Nov 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 76; 2022: 63; 2023: 59; 2024: 33; 2025: 18; 2026: 4.
253 papers.
Sort:
By area:
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2021GAN Inversion: A Surveycited by 367
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2022Semantic Image Synthesis via Diffusion Modelscited by 132
- 2021Generative Adversarial Transformerscited by 120
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
38 more
- 2024One-Step Image Translation with Text-to-Image Modelscited by 116
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 80
- 2021Enhancing Photorealism Enhancementcited by 74
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
- 2022Fine-Grained Face Swapping via Regional GAN Inversioncited by 67
- 2023Freestyle Layout-to-Image Synthesiscited by 67
- 2021PISE: Person Image Synthesis and Editing with Decoupled GANcited by 62
- 2021Reverse Engineering of Generative Models: Inferring Model Hyperparameters from Generated Imagescited by 58
- 2021SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editingcited by 58
- 2021Multimodal Image Synthesis and Editing: The Generative AI Eracited by 52
- 2021OpenForensics: Large-Scale Challenging Dataset For Multi-Face Forgery Detection And Segmentation In-The-Wildcited by 50
- 2021Diverse Semantic Image Synthesis via Probability Distribution Modelingcited by 49
- 2021StyleAlign: Analysis and Applications of Aligned StyleGAN Modelscited by 48
- 2023Synthetic Datasets for Autonomous Driving: A Surveycited by 48
- 2021Image Synthesis via Semantic Compositioncited by 45
- 2022Region-Aware Face Swappingcited by 45
- 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Modelscited by 45
- 2021Learning Semantic Person Image Generation by Region-Adaptive Normalizationcited by 44
- 2022SceneComposer: Any-Level Semantic Image Synthesiscited by 43
- 2021Unbalanced Feature Transport for Exemplar-based Image Translationcited by 41
- 2021STEEX: Steering Counterfactual Explanations with Semanticscited by 40
- 2022Controllable 3D Face Synthesis with Conditional Generative Occupancy Fieldscited by 37
- 2022Can segmentation models be trained with fully synthetically generated data?cited by 37
- 2024Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Modelcited by 37
- 2021M6-UFC: Unifying Multi-Modal Controls for Conditional Image Synthesis via Non-Autoregressive Generative Transformerscited by 36
- 2021FaceScape: 3D Facial Dataset and Benchmark for Single-View 3D Face Reconstructioncited by 36
- 2022High-Fidelity Guided Image Synthesis with Latent Diffusion Modelscited by 36
- 2022Proactive Image Manipulation Detectioncited by 35
- 2022Detecting and Recovering Sequential DeepFake Manipulationcited by 34
- 2024FaceXFormer: A Unified Transformer for Facial Analysiscited by 34
- 2022StyleTTS: A Style-Based Generative Model for Natural and Diverse Text-to-Speech Synthesiscited by 33
- 2022HumanGen: Generating Human Radiance Fields with Explicit Priorscited by 33
- 2021Learned Spatial Representations for Few-shot Talking-Head Synthesiscited by 32
- 2021VariTex: Variational Neural Face Texturescited by 30
- 2021StyleFusion: A Generative Model for Disentangling Spatial Segmentscited by 28
- 2022OCTET: Object-aware Counterfactual Explanationscited by 28
50 most cited of 253 All 253 (JSON)
- 2026COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing22 May 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2026FBSDiff++: Improved Frequency Band Substitution of Diffusion Features for Efficient and Highly Controllable Text-Driven Image-to-Image Translation27 Jan 2026
- 2025Experts-Guided Unbalanced Optimal Transport for ISP Learning from Unpaired and/or Paired Data5 Dec 2025
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models21 Oct 2025
- 2025SISMA: Semantic Face Image Synthesis with Mamba22 Sep 2025
- 2025Introducing Resizable Region Packing Problem in Image Generation, with a Heuristic Solution19 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
- 2025PanoHair: Detailed Hair Strand Synthesis on Volumetric Heads26 Aug 2025
- 2025Geospatial Diffusion for Land Cover Imperviousness Change Forecasting14 Aug 2025
38 more
- 2025SynMatch: Rethinking Consistency in Medical Image Segmentation with Sparse Annotations10 Aug 2025
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars21 Jul 2025
- 2025Towards 3D Semantic Image Synthesis for Medical Imaging30 Jun 2025
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation29 Jun 2025
- 2025SemFaceEdit: Semantic Face Editing on Generative Radiance Manifolds28 Jun 2025
- 20253DGH: 3D Head Generation with Composable Hair and Face25 Jun 2025
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
- 2025Hadamard product in deep learning: Introduction, Advances and Challenges17 Apr 2025
- 2025Generative Adversarial Networks with Limited Data: A Survey and Benchmarking7 Apr 2025
- 2024FACEMUG: A Multimodal Generative and Fusion Framework for Local Facial Editing26 Dec 2024
- 2024Reconciling Semantic Controllability and Diversity for Remote Sensing Image Synthesis with Hybrid Semantic Embedding22 Nov 2024
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024Self-supervised Auxiliary Learning for Texture and Model-based Hybrid Robust and Fair Featuring in Face Analysis29 Sep 2024
- 2024Pomo3D: 3D-Aware Portrait Accessorizing and More22 Sep 2024
- 2024MM2Latent: Text-to-facial image generation and editing in GANs with multimodal assistance17 Sep 2024
- 2024Automatic Scene Generation: State-of-the-Art Techniques, Models, Datasets, Challenges, and Future Prospects14 Sep 2024
- 2024SAT3D: Image-driven Semantic Attribute Transfer in 3D3 Aug 2024
- 2024Changen2: Multi-Temporal Remote Sensing Generative Change Foundation Model26 Jun 2024
- 2024My Body My Choice: Human-Centric Full-Body Anonymization13 Jun 2024
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusion30 May 2024
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow30 May 2024
- 2024Sparse Domain Transfer via Elastic Net Regularization13 May 2024
- 2024GRANOLA: Adaptive Normalization for Graph Neural Networks20 Apr 2024
- 2024Rawformer: Unpaired Raw-to-Raw Translation for Learnable Camera ISPs16 Apr 2024
- 2024Adversarial Identity Injection for Semantic Face Image Synthesis16 Apr 2024
- 2024Reference-Based 3D-Aware Image Editing with Triplanes4 Apr 2024
- 2024GeneAvatar: Generic Expression-Aware Volumetric Head Avatar Editing from a Single Image2 Apr 2024
- 2024HairFastGAN: Realistic and Robust Hair Transfer with a Fast Encoder-Based Approach1 Apr 2024
- 2024Deep Generative Model based Rate-Distortion for Image Downscaling Assessment22 Mar 2024
- 2024IIDM: Image-to-Image Diffusion Model for Semantic Image Synthesis20 Mar 2024
- 2024FaceXFormer: A Unified Transformer for Facial Analysis19 Mar 2024
- 2024Controllable Face Synthesis with Semantic Latent Diffusion Models19 Mar 2024
- 2024One-Step Image Translation with Text-to-Image Models18 Mar 2024
- 20243D-aware Image Generation and Editing with Multi-modal Conditions11 Mar 2024
- 2024PLACE: Adaptive Layout-Semantic Fusion for Semantic Image Synthesis4 Mar 2024
- 2024Windowed-FourierMixer: Enhancing Clutter-Free Room Modeling with Fourier Transform28 Feb 2024
- 2024Stochastic Conditional Diffusion Models for Robust Semantic Image Synthesis26 Feb 2024
50 newest of 253 All 253 (JSON)
- 2021DiffusionCLIP: Text-Guided Diffusion Models for Robust Image Manipulationcited by 642
- 2021ILVR: Conditioning Method for Denoising Diffusion Probabilistic Modelscited by 635
- 2022EGSDE: Unpaired Image-to-Image Translation via Energy-Guided Stochastic Differential Equationscited by 172
- 2023Dense Text-to-Image Generation with Attention Modulationcited by 163
- 2022Semantic Image Synthesis via Diffusion Modelscited by 132
- 2024One-Step Image Translation with Text-to-Image Modelscited by 116
- 2023Freestyle Layout-to-Image Synthesiscited by 67
- 2022Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Modelscited by 45
- 2022High-Fidelity Guided Image Synthesis with Latent Diffusion Modelscited by 36
- 2022MIDMs: Matching Interleaved Diffusion Models for Exemplar-based Image Translationcited by 22
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flowcited by 20
- 2023SmartMask: Context Aware High-Fidelity Mask Generation for Fine-grained Object Insertion and Layout Controlcited by 18
12 most cited of 28 All 28 (JSON)
- 2026FBSDiff++: Improved Frequency Band Substitution of Diffusion Features for Efficient and Highly Controllable Text-Driven Image-to-Image Translation27 Jan 2026
- 2025TReFT: Taming Rectified Flow Models For One-Step Image Translation25 Nov 2025
- 2025SISMA: Semantic Face Image Synthesis with Mamba22 Sep 2025
- 2025Dream, Lift, Animate: From Single Images to Animatable Gaussian Avatars21 Jul 2025
- 2025Towards 3D Semantic Image Synthesis for Medical Imaging30 Jun 2025
- 2025Symmetrical Flow Matching: Unified Image Generation, Segmentation, and Classification with Score-Based Generative Models12 Jun 2025
- 2024EBDM: Exemplar-guided Image Translation with Brownian-bridge Diffusion Models13 Oct 2024
- 2024Don't drop your samples! Coherence-aware training benefits Conditional diffusion30 May 2024
- 2024SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow30 May 2024
- 2024IIDM: Image-to-Image Diffusion Model for Semantic Image Synthesis20 Mar 2024
- 2024Controllable Face Synthesis with Semantic Latent Diffusion Models19 Mar 2024
- 2024One-Step Image Translation with Text-to-Image Models18 Mar 2024
12 newest of 28 All 28 (JSON)
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,937
- 2021Dynamic Neural Networks: A Surveycited by 408
- 2021GAN Inversion: A Surveycited by 367
- 2021VITON-HD: High-Resolution Virtual Try-On via Misalignment-Aware Normalizationcited by 287
- 2021EditGAN: High-Precision Semantic Image Editingcited by 156
- 2021Generative Adversarial Transformerscited by 120
- 2021Image-to-Image Translation: Methods and Applicationscited by 116
- 2021FENeRF: Face Editing in Neural Radiance Fieldscited by 112
- 2021Exploiting Spatial Dimensions of Latent in GAN for Real-time Image Editingcited by 91
- 2021HairCLIP: Design Your Hair by Text and Reference Imagecited by 80
- 2021Enhancing Photorealism Enhancementcited by 74
- 2021Aligning Latent and Image Spaces to Connect the Unconnectablecited by 70
12 most cited of 225 All 225 (JSON)
- 2026COSY: Compositional 3DGS Synthesis for Disentangled Human Head Editing22 May 2026
- 2026Component-Aware Structure-Preserving Style Transfer for Satellite Visual Sim2Real Data Construction19 May 2026
- 2026A Backbone Benchmarking Study on Self-supervised Learning as a Auxiliary Task with Texture-based Local Descriptors for Face Analysis23 Mar 2026
- 2025Experts-Guided Unbalanced Optimal Transport for ISP Learning from Unpaired and/or Paired Data5 Dec 2025
- 2025Efficient Few-shot Identity Preserving Attribute Editing for 3D-aware Deep Generative Models21 Oct 2025
- 2025Introducing Resizable Region Packing Problem in Image Generation, with a Heuristic Solution19 Sep 2025
- 2025MedShift: Implicit Conditional Transport for X-Ray Domain Adaptation29 Aug 2025
- 2025PanoHair: Detailed Hair Strand Synthesis on Volumetric Heads26 Aug 2025
- 2025Geospatial Diffusion for Land Cover Imperviousness Change Forecasting14 Aug 2025
- 2025SynMatch: Rethinking Consistency in Medical Image Segmentation with Sparse Annotations10 Aug 2025
- 2025PARTE: Part-Guided Texturing for 3D Human Reconstruction from a Single Image23 Jul 2025
- 2025CycleVAR: Repurposing Autoregressive Model for Unsupervised One-Step Image Translation29 Jun 2025
12 newest of 225 All 225 (JSON)