Generative Hierarchical Features from Synthesizing Images
Not on the map. Why?
Abstract (arXiv)
Generative Adversarial Networks (GANs) have recently advanced image synthesis by learning the underlying distribution of the observed data. However, how the features learned from solving the task of image generation are applicable to other vision tasks remains seldom explored. In this work, we show that learning to synthesize images can bring remarkable hierarchical visual features that are generalizable across a wide range of applications. Specifically, we consider the pre-trained StyleGAN generator as a learned loss function and utilize its layer-wise representation to train a novel hierarchical encoder. The visual feature produced by our encoder, termed as Generative Hierarchical Feature (GH-Feat), has strong transferability to both generative and discriminative tasks, including image editing, image harmonization, image classification, face verification, landmark detection, and layout prediction. Extensive qualitative and quantitative experimental results demonstrate the appealing performance of GH-Feat.
Key facts. Cited by 83 papers in the map (data through 7 Oct 2026). First posted on arXiv 20 Jul 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 20; 2022: 28; 2023: 25; 2024: 5; 2025: 4; 2026: 1.
83 papers.
Sort:
By area:
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2021GAN Inversion: A Surveycited by 366
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
38 more
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
- 2021Data-Efficient Instance Generation from Instance Discriminationcited by 58
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
- 2021Low-Rank Subspaces in GANscited by 52
- 2022Region-Aware Face Swappingcited by 45
- 2022SceneComposer: Any-Level Semantic Image Synthesiscited by 43
- 2021One-Shot Generative Domain Adaptationcited by 41
- 2023DreamTeacher: Pretraining Image Backbones with Deep Generative Modelscited by 37
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2022State-of-the-Art in the Architecture, Methods and Applications of StyleGANcited by 34
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splattingcited by 25
- 2022High-fidelity GAN Inversion with Padding Spacecited by 23
- 2022Region-Based Semantic Factorization in GANscited by 22
- 2022Improving GANs with A Dynamic Discriminatorcited by 20
- 2022GLEAN: Generative Latent Bank for Image Super-Resolution and Beyondcited by 19
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generationcited by 19
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
- 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysiscited by 18
- 2021LARGE: Latent-Based Regression through GAN Semanticscited by 17
- 2022FEAT: Face Editing with Attentioncited by 16
- 2021Retrieve in Style: Unsupervised Facial Feature Transfer and Retrievalcited by 15
- 2022High-Fidelity Image Inpainting with GAN Inversioncited by 15
- 2023LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesiscited by 15
- 2021StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGANcited by 14
- 2022Editing Out-of-domain GAN Inversion via Differential Activationscited by 14
- 2023Learning 3D-aware Image Synthesis with Unknown Pose Distributioncited by 14
- 2021Attribute-specific Control Units in StyleGAN for Fine-grained Image Manipulationcited by 13
- 2023Exploring Sparse MoE in GANs for Text-conditioned Image Synthesiscited by 13
- 2022ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentencescited by 12
- 2023FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Featurescited by 12
- 2023Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Visioncited by 11
- 2024Real-time 3D-aware Portrait Editing from a Single Imagecited by 10
- 2024How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?cited by 10
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencodercited by 10
- 2023Make It So: Steering StyleGAN for Any Image Inversion and Editingcited by 9
- 2021Unsupervised Novel View Synthesis from a Single Imagecited by 8
- 2023Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wildcited by 8
- 2021InvGAN: Invertible GANscited by 7
50 most cited of 83 All 83 (JSON)
- 2026Towards Fine-Grained and Verifiable Concept Bottleneck Models14 May 2026
- 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation2 Jun 2025
- 2025SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generation23 May 2025
- 2025LoC-LIC: Low Complexity Learned Image Coding Using Hierarchical Feature Transforms30 Apr 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder2 Aug 2024
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting28 May 2024
- 2024How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?11 Mar 2024
- 2024Real-time 3D-aware Portrait Editing from a Single Image21 Feb 2024
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes8 Feb 2024
- 2023Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Vision25 Dec 2023
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov 2023
38 more
- 2023One-for-All: Towards Universal Domain Translation with a Single StyleGAN22 Oct 2023
- 2023In-Domain GAN Inversion for Faithful Reconstruction and Editability25 Sep 2023
- 2023Exploring Sparse MoE in GANs for Text-conditioned Image Synthesis7 Sep 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
- 2023FG-Net: Facial Action Unit Detection with Generalizable Pyramidal Features23 Aug 2023
- 2023LibreFace: An Open-Source Toolkit for Deep Facial Expression Analysis18 Aug 2023
- 2023Improving Out-of-Distribution Robustness of Classifiers via Generative Interpolation23 Jul 2023
- 2023DreamTeacher: Pretraining Image Backbones with Deep Generative Models14 Jul 2023
- 2023Facial Reenactment Through a Personalized Generator12 Jul 2023
- 2023NaturalInversion: Data-Free Image Synthesis Improving Real-World Consistency29 Jun 2023
- 2023Make It So: Steering StyleGAN for Any Image Inversion and Editing27 Apr 2023
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation24 Apr 2023
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classification17 Apr 2023
- 2023Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation22 Mar 2023
- 2023Semantic Latent Space Regression of Diffusion Autoencoders for Vertebral Fracture Grading21 Mar 2023
- 2023Fix the Noise: Disentangling Source Feature for Controllable Domain Translation21 Mar 2023
- 2023Multi-modal Facial Action Unit Detection with Large Pre-trained Models for the 5th Competition on Affective Behavior Analysis in-the-wild19 Mar 2023
- 2023Pedestrian Attribute Editing for Gait Recognition and Anonymization9 Mar 2023
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb 2023
- 2023Learning 3D-aware Image Synthesis with Unknown Pose Distribution18 Jan 2023
- 2023Img2Tab: Automatic Class Relevant Concept Discovery from StyleGAN Features for Explainable Image Classification16 Jan 2023
- 2023GH-Feat: Learning Versatile Generative Hierarchical Features from GANs12 Jan 2023
- 2023LinkGAN: Linking GAN Latents to Pixels for Controllable Image Synthesis11 Jan 2023
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesis22 Dec 2022
- 2022Texture Representation via Analysis and Synthesis with Generative Adversarial Networks20 Dec 2022
- 2022More comprehensive facial inversion for more effective expression recognition24 Nov 2022
- 2022SceneComposer: Any-Level Semantic Image Synthesis21 Nov 2022
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesis16 Nov 2022
- 2022Distilling Representations from GAN Generator via Squeeze and Span6 Nov 2022
- 2022Deep Generative Models on 3D Representations: A Survey27 Oct 2022
- 2022Improving GANs with A Dynamic Discriminator20 Sep 2022
- 2022High-Fidelity Image Inpainting with GAN Inversion25 Aug 2022
- 2022GLEAN: Generative Latent Bank for Image Super-Resolution and Beyond29 Jul 2022
- 2022Leveraging GAN Priors for Few-Shot Part Segmentation27 Jul 2022
- 2022A Survey on Leveraging Pre-trained Generative Adversarial Networks for Image Editing and Restoration21 Jul 2022
- 2022Editing Out-of-domain GAN Inversion via Differential Activations17 Jul 2022
- 2022Semantic Unfolding of StyleGAN Latent Space29 Jun 2022
- 2022ContraCLIP: Interpretable GAN generation driven by pairs of contrasting sentences5 Jun 2022
50 newest of 83 All 83 (JSON)
- 2021Label-Efficient Semantic Segmentation with Diffusion Modelscited by 495
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classificationcited by 326
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Modelscited by 203
- 2023Exploiting Diffusion Prior for Generalizable Dense Predictioncited by 37
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulationcited by 18
- 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generationcited by 7
- 2025SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generationcited by 4
- 2023Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentationcited by 0
- 2025TaxaDiffusion: Progressively Trained Diffusion Model for Fine-Grained Species Generation2 Jun 2025
- 2025SeaLion: Semantic Part-Aware Latent Point Diffusion Models for 3D Generation23 May 2025
- 2023Exploiting Diffusion Prior for Generalizable Dense Prediction30 Nov 2023
- 2023Hierarchical Diffusion Autoencoders and Disentangled Image Manipulation24 Apr 2023
- 2023Synthetic Data from Diffusion Models Improves ImageNet Classification17 Apr 2023
- 2023Distribution Aligned Diffusion and Prototype-guided network for Unsupervised Domain Adaptive Segmentation22 Mar 2023
- 2023Encoder-based Domain Tuning for Fast Personalization of Text-to-Image Models23 Feb 2023
- 2021Label-Efficient Semantic Segmentation with Diffusion Models6 Dec 2021
- 2021SDEdit: Guided Image Synthesis and Editing with Stochastic Differential Equationscited by 1,903
- 2021GAN Inversion: A Surveycited by 366
- 2021ReStyle: A Residual-Based StyleGAN Encoder via Iterative Refinementcited by 248
- 2022MAGE: MAsked Generative Encoder to Unify Representation Learning and Image Synthesiscited by 222
- 2021High-Fidelity GAN Inversion for Image Attribute Editingcited by 197
- 2021StyleGAN-NADA: CLIP-Guided Domain Adaptation of Image Generatorscited by 164
- 2021Explaining in Style: Training a GAN to explain a classifier in StyleSpacecited by 122
- 20213D-aware Image Synthesis via Learning Structural and Textural Representationscited by 109
- 2021D2C: Diffusion-Denoising Models for Few-shot Conditional Generationcited by 96
- 2022DisCoScene: Spatially Disentangled Generative Radiance Fields for Controllable 3D-aware Scene Synthesiscited by 61
- 2021Data-Efficient Instance Generation from Instance Discriminationcited by 58
- 2021Labels4Free: Unsupervised Segmentation using StyleGANcited by 53
12 most cited of 74 All 74 (JSON)
- 2026Towards Fine-Grained and Verifiable Concept Bottleneck Models14 May 2026
- 2025LoC-LIC: Low Complexity Learned Image Coding Using Hierarchical Feature Transforms30 Apr 2025
- 2025High-Fidelity Image Inpainting with Multimodal Guided GAN Inversion17 Apr 2025
- 2024Counterfactual Explanations for Medical Image Classification and Regression using Diffusion Autoencoder2 Aug 2024
- 20243DitScene: Editing Any Scene via Language-guided Disentangled Gaussian Splatting28 May 2024
- 2024How to Handle Sketch-Abstraction in Sketch-Based Image Retrieval?11 Mar 2024
- 2024Real-time 3D-aware Portrait Editing from a Single Image21 Feb 2024
- 2024CTGAN: Semantic-guided Conditional Texture Generator for 3D Shapes8 Feb 2024
- 2023Scalable Face Image Coding via StyleGAN Prior: Towards Compression for Human-Machine Collaborative Vision25 Dec 2023
- 2023One-for-All: Towards Universal Domain Translation with a Single StyleGAN22 Oct 2023
- 2023In-Domain GAN Inversion for Faithful Reconstruction and Editability25 Sep 2023
- 2023StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation31 Aug 2023
12 newest of 74 All 74 (JSON)